-- Logs begin at Sat 2022-09-03 20:01:17 UTC, end at Sat 2022-09-03 22:07:55 UTC. -- Sep 03 20:37:55.994392 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 20:37:56.004393 ncdv-master-1 devstack@n-api.service[124102]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 20:37:56 2022] *** Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: nodename: ncdv-master-1 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: machine: x86_64 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: clock source: unix Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: pcre jit disabled Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: detected number of CPU cores: 4 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: current working directory: / Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: detected binary path: /usr/bin/uwsgi-core Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: your processes number limit is 47680 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: your memory page size is 4096 bytes Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: detected max file descriptor number: 2048 Sep 03 20:37:56.006055 ncdv-master-1 devstack@n-api.service[124102]: lock engine: pthread robust mutexes Sep 03 20:37:56.006983 ncdv-master-1 devstack@n-api.service[124102]: thunder lock: enabled Sep 03 20:37:56.006983 ncdv-master-1 devstack@n-api.service[124102]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 20:37:56.006983 ncdv-master-1 devstack@n-api.service[124102]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 20:37:56.050553 ncdv-master-1 devstack@n-api.service[124102]: Python main interpreter initialized at 0x55a45e7ee9c0 Sep 03 20:37:56.050553 ncdv-master-1 devstack@n-api.service[124102]: python threads support enabled Sep 03 20:37:56.050553 ncdv-master-1 devstack@n-api.service[124102]: your server socket listen backlog is limited to 100 connections Sep 03 20:37:56.050553 ncdv-master-1 devstack@n-api.service[124102]: your mercy for graceful operations on workers is 90 seconds Sep 03 20:37:56.050890 ncdv-master-1 devstack@n-api.service[124102]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 20:37:56.050977 ncdv-master-1 devstack@n-api.service[124102]: *** Operational MODE: preforking *** Sep 03 20:37:56.051204 ncdv-master-1 devstack@n-api.service[124102]: *** uWSGI is running in multiple interpreter mode *** Sep 03 20:37:56.051204 ncdv-master-1 devstack@n-api.service[124102]: spawned uWSGI master process (pid: 124102) Sep 03 20:37:56.051386 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 03 20:37:56.051934 ncdv-master-1 devstack@n-api.service[124102]: spawned uWSGI worker 1 (pid: 124103, cores: 1) Sep 03 20:37:56.052257 ncdv-master-1 devstack@n-api.service[124102]: spawned uWSGI worker 2 (pid: 124104, cores: 1) Sep 03 20:37:56.052423 ncdv-master-1 devstack@n-api.service[124102]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 20:37:57.340358 ncdv-master-1 devstack@n-api.service[124103]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 20:37:57.356782 ncdv-master-1 devstack@n-api.service[124104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 20:37:58.014271 ncdv-master-1 devstack@n-api.service[124103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:37:58.014271 ncdv-master-1 devstack@n-api.service[124103]: from cryptography.utils import int_from_bytes Sep 03 20:37:58.014645 ncdv-master-1 devstack@n-api.service[124103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:37:58.014645 ncdv-master-1 devstack@n-api.service[124103]: from cryptography.utils import int_from_bytes Sep 03 20:37:58.020526 ncdv-master-1 devstack@n-api.service[124104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:37:58.020526 ncdv-master-1 devstack@n-api.service[124104]: from cryptography.utils import int_from_bytes Sep 03 20:37:58.020841 ncdv-master-1 devstack@n-api.service[124104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:37:58.020841 ncdv-master-1 devstack@n-api.service[124104]: from cryptography.utils import int_from_bytes Sep 03 20:38:00.591408 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:38:00.591979 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:38:00.592196 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:38:00.592558 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:38:00.592812 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:38:00.593107 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:38:00.593501 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.593599 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:38:00.593694 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.593855 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.593951 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:38:00.594175 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.594268 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:38:00.594506 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.594599 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:38:00.594823 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.594915 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595141 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595234 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595459 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595553 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595786 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.595878 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596043 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596146 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596358 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596482 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596681 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.596777 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597030 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597140 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597337 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597423 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597646 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597762 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.597966 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598074 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598267 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598371 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598588 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598682 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598893 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.598981 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.599209 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.599386 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.599535 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.599826 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.599935 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600133 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600225 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600441 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600543 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600777 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.600984 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601105 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601304 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601398 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601616 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601710 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.601931 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602022 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602277 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602369 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602598 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602689 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.602912 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603003 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603239 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603325 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603556 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603665 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603883 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.603982 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.604198 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.604291 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.604590 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.604676 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.604942 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605051 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605260 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605349 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605579 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605672 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.605884 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606001 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606210 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606378 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606529 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606624 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606844 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.606936 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607159 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607257 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607460 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607551 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607766 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.607857 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608076 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608218 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608484 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608587 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608792 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.608889 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609123 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609232 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609371 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609469 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609678 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609765 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.609999 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610086 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610317 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610410 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610634 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610724 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.610881 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611014 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611133 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611225 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611431 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611531 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611751 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.611845 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612056 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612148 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612361 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612460 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612616 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612707 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.612962 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613065 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613268 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613360 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613568 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613655 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613872 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.613964 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614176 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614269 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614484 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614569 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614794 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.614885 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615103 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615190 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615404 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615497 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615710 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.615801 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616032 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616128 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616343 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616451 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616652 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616776 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.616986 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617074 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617313 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617414 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617617 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617711 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.617935 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618022 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618251 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618346 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618556 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618650 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618861 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.618946 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619166 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619266 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619486 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619590 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619808 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.619893 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620110 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620200 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620381 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620468 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620681 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.620765 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621006 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621095 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621326 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621418 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621630 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621721 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.621929 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622020 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622228 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622313 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622528 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622620 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622831 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.622917 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623135 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623221 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623436 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623520 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623738 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.623832 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624039 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624128 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624341 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624432 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624647 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624743 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.624976 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625061 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625280 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625372 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625583 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625677 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625893 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.625983 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626205 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626291 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626505 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626604 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626806 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.626891 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627108 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627196 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627409 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627504 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627726 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.627817 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628028 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628113 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628332 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628429 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628638 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628730 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.628961 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629059 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629266 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629360 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629581 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629666 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629882 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.629972 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630184 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630281 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630498 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630590 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630797 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.630884 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631098 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631195 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631417 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631559 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631720 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.631805 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632021 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632152 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632320 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632454 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632621 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632767 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.632939 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633131 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633232 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633443 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633535 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633754 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.633849 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634062 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634146 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634371 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634455 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634679 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634774 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.634988 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635079 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635288 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635372 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635590 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635683 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.635906 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.636487 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.636736 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.636828 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.637088 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.637177 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.637405 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.637490 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.637717 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.637811 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.638026 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.638119 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.638351 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:38:00.638472 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.638666 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.638764 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.638979 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639075 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639291 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639384 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639617 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639714 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.639925 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640017 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640236 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640328 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640547 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640641 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640863 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.640975 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641202 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641288 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641530 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641627 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641843 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.641949 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642155 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642256 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642468 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642567 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642775 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.642861 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643088 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643184 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643414 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643509 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643730 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.643815 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644037 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644123 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644356 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644447 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644672 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.644768 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645024 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645116 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645363 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645457 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645681 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645766 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.645992 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646077 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646301 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646387 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646611 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646697 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.646949 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647079 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647257 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647347 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647565 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647650 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647880 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.647980 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.648189 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.648284 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.648509 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.648596 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.648818 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649008 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649169 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649256 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649478 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649576 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649786 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.649880 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650092 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650179 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650419 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650511 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650729 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.650827 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.651043 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.651135 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.651353 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.651438 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652217 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652325 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652534 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652627 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652842 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.652965 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653177 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653265 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653486 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653573 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653790 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.653876 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654095 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654182 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654398 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654484 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654710 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.654795 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655011 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655098 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655326 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655418 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655638 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655723 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.655946 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656032 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656256 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656344 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656569 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656667 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.656877 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657001 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657208 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657315 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657516 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657612 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657821 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.657907 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658130 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658215 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658437 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658535 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658743 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.658832 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659065 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659150 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659372 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659466 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659675 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659763 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.659990 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660076 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660291 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660376 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660595 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660682 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.660922 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661013 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661237 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661325 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661545 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661638 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661855 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.661941 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662164 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662257 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662475 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662560 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662780 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.662868 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663087 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663174 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663401 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663486 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663720 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.663818 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664022 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664115 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664347 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664433 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664661 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.664753 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665001 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665092 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665307 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665393 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665614 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665710 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.665915 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666007 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666215 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666302 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666516 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666611 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666822 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.666918 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667126 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667251 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667466 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667557 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667767 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.667852 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668068 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668160 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668370 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668468 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668734 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.668835 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669016 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669104 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669318 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669405 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669617 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669702 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.669918 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670005 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670226 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670311 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670548 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670639 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670859 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.670999 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671169 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671256 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671480 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671565 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671789 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.671883 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672115 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672202 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672428 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672514 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672738 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.672837 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673082 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673169 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673391 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673479 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673699 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.673798 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674015 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674100 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674321 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674413 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674641 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674736 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.674949 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675034 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675264 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675347 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675568 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675662 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675889 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.675973 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676192 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676276 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676509 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676596 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676821 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.676926 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677179 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677278 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677496 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677591 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677815 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.677907 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678125 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678210 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678438 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678531 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678748 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.678885 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679058 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679153 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679366 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679451 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679674 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679769 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.679989 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680083 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680297 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680383 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680612 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680703 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.680952 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681057 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681261 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681347 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681573 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681657 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681886 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.681980 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682190 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682285 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682503 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682590 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682849 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.682944 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683184 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683269 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683491 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683583 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683801 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.683897 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684110 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684194 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684416 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684507 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684733 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.684820 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685065 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685154 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685371 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685458 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685673 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685760 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.685983 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686077 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686296 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686382 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686602 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686689 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686909 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.686994 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687211 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687316 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687522 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687608 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687829 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.687931 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688131 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688236 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688432 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688525 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688738 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.688823 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689090 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689226 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689397 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689497 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689716 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.689805 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690039 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690135 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690339 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690432 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690642 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690728 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.690962 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691077 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691270 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691366 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691570 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691665 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691870 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.691965 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692172 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692260 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692504 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692595 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692807 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.692916 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693132 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693220 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693444 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693531 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693753 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.693857 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694056 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694150 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694366 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694462 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694680 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694767 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.694985 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695071 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695306 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695415 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695610 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695697 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.695914 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696001 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696221 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696527 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696615 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696833 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.696955 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697165 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697262 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697486 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697604 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697795 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.697897 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.698093 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.698182 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.698904 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699029 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699222 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699321 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699526 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699615 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699840 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.699926 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.700156 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.700417 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.700520 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.700745 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.700832 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701093 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701182 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701408 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701506 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701733 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.701819 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702054 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702302 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702389 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702646 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702746 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.702971 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703065 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703282 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703368 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703591 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703686 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703895 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.703991 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704197 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704284 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704510 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704628 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704816 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.704960 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705142 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705229 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705446 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705590 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705754 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.705848 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706055 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706147 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706354 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706449 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706654 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706746 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.706958 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707054 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707268 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707368 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707568 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707669 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707878 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.707977 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.708176 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.708272 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.708495 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.708589 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709087 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709239 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709395 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709489 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709679 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709766 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.709979 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710064 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710298 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710383 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710605 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710693 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.710928 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711019 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711237 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711331 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711546 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711633 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711857 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.711949 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712162 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712248 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712484 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712569 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712787 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.712882 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713115 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713201 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713420 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713507 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713727 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.713822 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.714052 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.714723 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.714872 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.714959 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715180 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715275 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715488 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715574 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715795 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.715881 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716102 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716196 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716400 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716489 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716708 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.716793 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717034 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717137 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717356 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717443 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717665 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717750 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.717969 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718075 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718269 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718355 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718576 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718663 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.718887 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719005 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719187 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719293 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719496 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719606 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719794 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.719883 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720101 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720187 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720400 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720495 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720702 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.720796 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721037 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721142 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721356 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721453 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721667 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721767 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.721974 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722071 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722289 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722394 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722592 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722689 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722896 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.722994 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723199 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723309 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723504 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723608 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723806 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.723903 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724107 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724205 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724412 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724509 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724736 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.724832 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725074 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725171 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725389 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725492 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725686 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725771 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.725986 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726073 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726289 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726376 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726593 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726685 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726898 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.726992 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727199 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727292 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727499 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727596 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727800 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.727886 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728102 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728202 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728402 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728499 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728713 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.728799 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.729040 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.729132 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.729343 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.729441 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.729667 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.730321 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.730464 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.730602 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.730742 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.730887 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731074 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731213 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731390 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731523 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731699 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.731851 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732007 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732152 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732448 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732638 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732774 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.732932 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733065 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733238 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733420 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733704 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733845 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.733980 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734120 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734258 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734403 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734545 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734682 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734824 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.734959 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735093 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735260 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735399 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735572 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735716 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.735893 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736046 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736211 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736298 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736528 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736613 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736836 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.736966 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737169 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737255 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737477 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737563 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737797 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.737891 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738183 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738294 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738424 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738525 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738735 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.738829 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739060 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739149 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739356 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739443 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739666 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739872 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.739962 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740049 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740267 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740352 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740571 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740667 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.740879 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741006 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741208 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741294 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741514 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741614 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741833 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.741924 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742140 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742234 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742442 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742538 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742751 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.742836 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743053 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743250 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743347 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743428 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743652 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743802 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.743984 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744076 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744303 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744389 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744617 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744702 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.744955 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.745046 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.745293 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.745896 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746120 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746206 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746435 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746529 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746745 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.746870 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747047 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747192 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747465 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747631 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747769 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.747865 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748070 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748157 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748382 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748495 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748683 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.748770 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749008 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749097 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749318 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749414 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749643 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749768 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.749947 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750089 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750249 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750405 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750552 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750724 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.750874 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751036 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751175 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751348 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751498 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751664 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.751926 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752019 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752238 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752332 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752543 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752628 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.752911 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753015 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753243 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753337 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753555 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753640 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753884 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.753979 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754204 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754296 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754528 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754613 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754838 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.754937 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755149 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755456 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755635 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755782 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.755950 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.756091 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.756280 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.756400 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.756610 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.756696 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757027 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757129 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757343 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757437 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757663 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757748 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.757974 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758067 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758297 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758408 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758630 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758728 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.758945 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759031 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759265 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759353 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759578 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759672 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.759909 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760050 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760229 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760315 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760535 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760623 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760845 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.760966 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761193 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761346 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761497 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761680 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761820 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.761998 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762125 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762337 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762424 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762678 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762777 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.762996 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763082 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763310 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763396 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763612 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763711 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.763928 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764012 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764240 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764332 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764567 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764670 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764878 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.764997 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765220 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765318 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765537 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765638 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765841 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.765963 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766153 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766238 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766459 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766554 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766764 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.766852 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767066 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767152 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767369 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767457 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767709 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.767795 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768017 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768118 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768326 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768421 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768658 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.768790 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769009 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769111 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769319 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769410 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769630 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769716 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.769941 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770059 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770256 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770356 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770561 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770648 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770878 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.770977 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771203 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771298 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771508 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771602 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771814 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.771919 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772121 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772209 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772423 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772509 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772725 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.772820 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773052 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773155 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773362 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773449 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773665 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773760 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.773968 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774070 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774270 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774366 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774593 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774678 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774899 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.774991 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775213 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775520 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775609 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775822 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.775909 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776123 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776217 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776424 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776525 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776786 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.776880 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777118 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777225 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777444 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777533 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777753 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.777839 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778076 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778173 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778390 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778476 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778714 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.778859 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779012 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779112 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779320 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779416 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779632 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779718 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.779944 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780040 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780253 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780378 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780560 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780654 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.780871 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781015 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781214 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781301 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781528 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781616 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.781849 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782046 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782172 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782374 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782495 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782688 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.782823 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783000 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783145 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783310 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783462 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783622 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783784 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.783934 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.784116 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.784247 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.784431 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.784527 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.784845 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785069 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785181 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785406 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785492 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785728 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.785824 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786049 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786142 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786368 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786462 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786689 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.786777 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787008 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787102 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787325 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787500 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787640 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787727 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.787956 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788049 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788274 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788369 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788580 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788665 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.788925 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789052 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789228 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789321 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789541 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789640 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789852 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.789939 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790159 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790248 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790473 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790575 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790783 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.790880 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791092 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791182 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791400 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791487 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791712 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.791856 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.792023 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.792112 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.792852 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.792964 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793209 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793312 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793529 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793626 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793839 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.793934 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794151 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794264 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794466 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794574 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794781 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.794993 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795090 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795312 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795406 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795648 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795734 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.795975 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796070 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796301 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796395 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796617 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796712 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.796954 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797060 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797287 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797376 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797599 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797692 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.797907 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798135 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798230 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798460 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798546 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798803 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.798914 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799124 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799219 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799433 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799520 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799736 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.799832 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800055 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800143 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800366 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800453 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800693 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.800917 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801020 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801273 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801361 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801589 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801685 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.801918 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802014 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802242 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802329 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802557 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802653 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802862 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.802946 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.803183 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.803269 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.803486 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.803581 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.803794 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804026 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804113 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804381 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804485 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804706 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.804804 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805034 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805125 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805346 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805446 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805653 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805740 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.805957 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806052 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806267 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806364 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806571 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806658 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806895 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.806982 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807201 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807296 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807505 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807593 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807851 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.807939 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808168 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808264 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808471 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808566 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808775 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.808862 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809108 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809208 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809412 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809499 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809721 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.809815 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810023 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810111 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810331 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810418 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810634 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810721 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.810941 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811036 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811257 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811349 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811570 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811664 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.811871 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812001 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812181 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812268 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812483 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812579 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812786 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.812874 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813130 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813239 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813438 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813552 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813745 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.813840 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814054 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814141 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814361 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814463 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814714 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.814821 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815024 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815112 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815355 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815568 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815656 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815902 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.815997 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.816221 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.816317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.816553 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.816647 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.816886 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817032 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817218 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817391 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817524 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817612 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817831 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.817929 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.818151 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.818250 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.818459 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.818720 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.818807 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819061 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819249 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819372 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819469 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819678 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819766 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.819986 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820086 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820293 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820381 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820600 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820687 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.820920 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821084 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821235 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821324 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821544 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821631 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821852 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.821952 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822158 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822251 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822465 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822552 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822774 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.822870 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.823095 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.823182 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.823930 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824074 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824303 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824428 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824619 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824763 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.824958 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825106 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825277 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825418 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825593 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825728 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.825912 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826038 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826228 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826348 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826548 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826663 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826896 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.826992 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.827220 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.827327 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.827544 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.827633 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.827865 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.828188 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.828287 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.828505 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.828593 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.828821 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829009 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829223 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829355 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829463 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829575 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829784 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.829928 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830122 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830210 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830431 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830517 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830745 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.830840 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.831055 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.831386 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.831473 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.831727 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.831824 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832055 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832193 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832389 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832477 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832685 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.832787 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.833013 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.833105 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.833322 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.833422 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.833634 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834000 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834201 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834335 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834509 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834655 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834818 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.834997 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.835122 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.835346 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.835432 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.835687 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.835786 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836009 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836108 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836311 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836399 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836614 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836709 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.836938 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837027 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837245 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837332 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837549 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837650 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837852 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.837939 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838155 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838242 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838457 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838551 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838759 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.838846 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.839130 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.839773 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.839947 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840038 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840249 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840334 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840552 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840640 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840854 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.840971 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841183 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841290 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841539 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841631 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841806 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.841895 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842124 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842245 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842437 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842549 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842747 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.842844 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843060 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843155 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843365 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843479 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843673 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843775 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.843984 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844081 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844295 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844405 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844600 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844695 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.844951 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845063 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845262 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845376 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845569 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845664 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845879 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.845973 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846185 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846274 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846491 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846579 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846798 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.846892 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847120 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847207 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847451 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847538 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847758 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.847844 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848071 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848167 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848389 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848492 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848708 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.848794 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849044 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849136 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849354 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849453 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849666 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849776 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.849983 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850082 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850286 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850371 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850595 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850692 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850905 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.850991 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851216 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851312 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851528 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851624 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851836 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.851922 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852146 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852234 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852460 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852556 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852773 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.852867 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853125 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853226 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853445 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853531 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853754 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.853839 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854067 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854151 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854386 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854480 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854746 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.854833 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855058 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855152 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855378 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855475 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855694 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.855787 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856016 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856115 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856327 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856421 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856633 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856719 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.856874 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:38:00.856999 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.857313 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.857659 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.857997 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.858350 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.858671 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.859019 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.859358 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.859679 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.860005 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.860317 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:38:00.860565 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:38:00.922615 ncdv-master-1 devstack@n-api.service[124103]: INFO dbcounter [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Registered counter for database nova_api Sep 03 20:38:00.927150 ncdv-master-1 devstack@n-api.service[124104]: INFO dbcounter [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Registered counter for database nova_api Sep 03 20:38:00.944686 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:00.947092 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:00.951998 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:00.954116 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.008271 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.context [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=124103) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 20:38:01.009974 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.context [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=124104) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 20:38:01.012773 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:38:01.013280 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:38:01.014392 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:38:01.014869 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:38:01.014958 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:38:01.015610 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:38:01.016068 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:38:01.016445 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:38:01.017194 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:38:01.017644 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:38:01.018061 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:38:01.019635 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:38:01.020023 ncdv-master-1 devstack@n-api.service[124103]: INFO dbcounter [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Registered counter for database nova_cell0 Sep 03 20:38:01.021611 ncdv-master-1 devstack@n-api.service[124104]: INFO dbcounter [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Registered counter for database nova_cell0 Sep 03 20:38:01.025483 ncdv-master-1 devstack@n-api.service[124103]: INFO dbcounter [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Registered counter for database nova_cell1 Sep 03 20:38:01.026855 ncdv-master-1 devstack@n-api.service[124104]: INFO dbcounter [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Registered counter for database nova_cell1 Sep 03 20:38:01.032871 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.036338 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.037721 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.037856 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.039371 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.044341 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.046429 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.181535 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.190799 ncdv-master-1 devstack@n-api.service[124103]: INFO dbcounter [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Registered counter for database nova_cell0 Sep 03 20:38:01.192521 ncdv-master-1 devstack@n-api.service[124104]: INFO dbcounter [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Registered counter for database nova_cell0 Sep 03 20:38:01.200484 ncdv-master-1 devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.204040 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:38:01.204871 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.208498 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:38:01.660739 ncdv-master-1 devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:38:01.666417 ncdv-master-1 devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:38:01.668045 ncdv-master-1 devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:38:01.673775 ncdv-master-1 devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:38:01.890478 ncdv-master-1 devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:38:01.896432 ncdv-master-1 devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:38:01.901718 ncdv-master-1 devstack@n-api.service[124104]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a45e7ee9c0 pid: 124104 (default app) Sep 03 20:38:01.901975 ncdv-master-1 devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:38:01.903734 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:38:01.904917 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001690 Sep 03 20:38:01.905329 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Sat Sep 3 20:38:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:38:01.908056 ncdv-master-1 devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-245dd074-cb2f-419e-9483-0893b5371bd4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:38:01.913456 ncdv-master-1 devstack@n-api.service[124103]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a45e7ee9c0 pid: 124103 (default app) Sep 03 20:39:26.782250 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:26.783166 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 03 20:39:26.783555 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:26.795519 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:26.796471 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:26.797711 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:26.798574 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:27.679996 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-80950695-fbfb-45ee-9ba3-21b410647df3 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:27.726212 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-80950695-fbfb-45ee-9ba3-21b410647df3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935788 Sep 03 20:39:27.727132 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 20:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:30.483109 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:30.484100 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f70cac9c-e59b-4d8b-b59a-002d8d1bfe44 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 03 20:39:30.484654 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:30.909151 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-82b04d48-ed8a-4eb2-ae8d-dbb65068a227 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:30.958268 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-82b04d48-ed8a-4eb2-ae8d-dbb65068a227 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.467758 Sep 03 20:39:30.958992 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:30.976720 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:30.978835 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:30.979962 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:30.981866 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:31.185210 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e1c6695b-4436-4e79-8fe1-25f87a5a43a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:31.251333 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e1c6695b-4436-4e79-8fe1-25f87a5a43a0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279973 Sep 03 20:39:31.251909 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 3 20:39:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:34.000808 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-82b04d48-ed8a-4eb2-ae8d-dbb65068a227 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:34.002582 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-82b04d48-ed8a-4eb2-ae8d-dbb65068a227 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 Sep 03 20:39:34.012998 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:34.758107 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0cafef49-fe6b-4ce0-aed7-c6dc78f6afef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:34.810784 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0cafef49-fe6b-4ce0-aed7-c6dc78f6afef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799803 Sep 03 20:39:34.814029 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:34.832499 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0a16db2e-6ca1-4e80-a8ad-ff4f9f9981ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:34.886755 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0a16db2e-6ca1-4e80-a8ad-ff4f9f9981ec admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063663 Sep 03 20:39:34.892919 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 3 20:39:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:39:37.856550 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0cafef49-fe6b-4ce0-aed7-c6dc78f6afef admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:37.858387 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0cafef49-fe6b-4ce0-aed7-c6dc78f6afef admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002491 Sep 03 20:39:37.864382 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:38.323994 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c877605-e21d-41a2-8d0d-d4733bcee25b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:38.347792 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7c877605-e21d-41a2-8d0d-d4733bcee25b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481951 Sep 03 20:39:38.348368 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:38.365097 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b135e3dd-3e97-40dc-bb28-dabb6eb840c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:38.394005 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b135e3dd-3e97-40dc-bb28-dabb6eb840c7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036375 Sep 03 20:39:38.396310 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 3 20:39:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:41.317282 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c877605-e21d-41a2-8d0d-d4733bcee25b admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:41.318239 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7c877605-e21d-41a2-8d0d-d4733bcee25b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 03 20:39:41.318657 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:41.765100 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-11f6e4aa-1127-4ca2-821b-82c82696d70e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "id": "d3"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:41.788492 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-11f6e4aa-1127-4ca2-821b-82c82696d70e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462740 Sep 03 20:39:41.789066 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:41.800938 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-13028b0b-3644-412e-a8fc-d667a07b51a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:41.824769 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-13028b0b-3644-412e-a8fc-d667a07b51a9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027464 Sep 03 20:39:41.825348 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 3 20:39:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:44.612134 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-11f6e4aa-1127-4ca2-821b-82c82696d70e admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:44.613335 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-11f6e4aa-1127-4ca2-821b-82c82696d70e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Sep 03 20:39:44.614227 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:45.086543 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:45.110532 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490252 Sep 03 20:39:45.111269 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:45.123519 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ba7d2995-8528-4e64-93a1-a4a6f5d7a57f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:45.148860 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ba7d2995-8528-4e64-93a1-a4a6f5d7a57f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029148 Sep 03 20:39:45.150063 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Sat Sep 3 20:39:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:47.869444 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:47.870462 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 03 20:39:47.870869 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:48.325329 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b4680668-11dc-4027-a78c-ad7c86c7b8d9 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:48.350683 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b4680668-11dc-4027-a78c-ad7c86c7b8d9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.473557 Sep 03 20:39:48.351359 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 20:39:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:39:51.399562 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:51.400472 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-df5249b3-93aa-401d-b816-dce60dcd0578 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 03 20:39:51.400829 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:39:51.846699 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b7860a83-9c76-45e9-bedc-f6b6e1960b62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "swap": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:51.866282 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b7860a83-9c76-45e9-bedc-f6b6e1960b62 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459285 Sep 03 20:39:51.873016 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:39:51.883189 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3aa934ad-c168-495f-a3ac-7f60e2c5ce07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:51.907285 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3aa934ad-c168-495f-a3ac-7f60e2c5ce07 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027842 Sep 03 20:39:51.907855 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 3 20:39:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:54.779041 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b7860a83-9c76-45e9-bedc-f6b6e1960b62 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:54.780386 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b7860a83-9c76-45e9-bedc-f6b6e1960b62 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Sep 03 20:39:54.780944 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:55.217626 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-25559dfb-561e-4e4e-bde6-eca31d73176e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:55.237170 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-25559dfb-561e-4e4e-bde6-eca31d73176e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449145 Sep 03 20:39:55.237724 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:55.249843 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-aad8cc39-9605-4223-9fc6-517fa94dec73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:55.275105 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-aad8cc39-9605-4223-9fc6-517fa94dec73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028929 Sep 03 20:39:55.275982 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 3 20:39:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:39:57.945358 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-25559dfb-561e-4e4e-bde6-eca31d73176e admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:39:57.946893 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-25559dfb-561e-4e4e-bde6-eca31d73176e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Sep 03 20:39:57.947298 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:39:58.357944 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-91d7a303-3471-4235-9c9f-c03696c6490e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:58.377216 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-91d7a303-3471-4235-9c9f-c03696c6490e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.423825 Sep 03 20:39:58.377855 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:39:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:39:58.390102 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d86ac910-7908-442f-9b63-ad56b7b1b3aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:39:58.395248 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:58.418951 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d86ac910-7908-442f-9b63-ad56b7b1b3aa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032502 Sep 03 20:39:58.419694 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 3 20:39:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:40:01.204834 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-91d7a303-3471-4235-9c9f-c03696c6490e admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:01.206057 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-91d7a303-3471-4235-9c9f-c03696c6490e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Sep 03 20:40:01.206547 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:01.682428 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-962719b9-f4ed-4c0e-83f6-c83f5905195d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:01.703008 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-962719b9-f4ed-4c0e-83f6-c83f5905195d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.489594 Sep 03 20:40:01.703567 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:40:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:01.717305 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64082d3a-fb2e-432c-b52c-c2589c6556c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:01.725669 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:01.746566 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64082d3a-fb2e-432c-b52c-c2589c6556c5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032957 Sep 03 20:40:01.753076 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 3 20:40:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:40:04.558300 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-962719b9-f4ed-4c0e-83f6-c83f5905195d admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:04.559314 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-962719b9-f4ed-4c0e-83f6-c83f5905195d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 03 20:40:04.559891 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:05.044000 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:05.063734 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496110 Sep 03 20:40:05.064431 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Sat Sep 3 20:40:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:05.077545 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c6fb8f2d-e3ab-4ad7-9ff7-da9fde04839f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:05.106467 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c6fb8f2d-e3ab-4ad7-9ff7-da9fde04839f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032540 Sep 03 20:40:05.107362 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Sat Sep 3 20:40:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:40:26.569813 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:26.570826 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 03 20:40:26.571226 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:26.581913 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:26.976983 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-40fe66f9-888c-4468-bbd4-ce703a4e79cd admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:26.995409 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-40fe66f9-888c-4468-bbd4-ce703a4e79cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417976 Sep 03 20:40:26.995939 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 20:40:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:28.163410 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:28.164409 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bb6c251b-d4a0-4cff-a19e-467eb53c28f4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 03 20:40:28.164795 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:28.770308 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ae4d80b4-a562-4273-8a45-3c1aed3c3b91 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:28.776352 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-ae4d80b4-a562-4273-8a45-3c1aed3c3b91 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ae4d80b4-a562-4273-8a45-3c1aed3c3b91 admin admin] Request method failure captured: Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Accept: application/json Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Accept-Encoding: gzip, deflate Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Connection: keep-alive Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Content-Length: 0 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Host: 10.222.0.16 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: Openstack-System-Scope: None Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: User-Agent: python-novaclient Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Auth-Token: gAAAAABjE7u8_2JNWyytTaEV5OKYBxULFWvch6-h8yh_QQyNCSB8N38ToS1i_2II1JXz6drgJ4tNexlnp9_tQW5OeLRDBoHAqpZkpCdwE-Ygz7t9qwkGDSqU9JBfU_h5S4aEsMzNcnwwTPXHxlRu9kjccHZ4uKEV5W9RTHLc_myocVVTNJRZPcQ Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Id: None Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Name: None Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Identity-Status: Confirmed Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Is-Admin-Project: True Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Id: default Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Name: Default Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Name: admin Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Role: admin,member,reader Sep 03 20:40:28.787550 ncdv-master-1 devstack@n-api.service[124103]: X-Roles: admin,member,reader Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant: admin Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Name: admin Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-User: admin Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Id: default Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Name: Default Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: X-User-Name: admin Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: method: > Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: exception: Flavor 42 could not be found. Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: action_args: {'id': '42'} Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:28.789802 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:28.790749 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.791854 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ae4d80b4-a562-4273-8a45-3c1aed3c3b91 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:28.792882 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ae4d80b4-a562-4273-8a45-3c1aed3c3b91 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396461 Sep 03 20:40:28.792882 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:40:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:28.799382 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-393af571-6625-4f56-af5e-b2eedf42fe14 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:28.803483 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:28.822682 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-393af571-6625-4f56-af5e-b2eedf42fe14 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027066 Sep 03 20:40:28.823216 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:40:28.832670 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2e63ef41-0a6d-4eb1-ba51-86e029c2d948 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:28.855931 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2e63ef41-0a6d-4eb1-ba51-86e029c2d948 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026743 Sep 03 20:40:28.856468 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:28.866521 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-78cbc7f3-3818-424f-8b0c-3d46b870421f admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:28.873010 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-78cbc7f3-3818-424f-8b0c-3d46b870421f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-78cbc7f3-3818-424f-8b0c-3d46b870421f admin admin] Request method failure captured: Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Accept: application/json Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Accept-Encoding: gzip, deflate Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Connection: keep-alive Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Content-Length: 0 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Host: 10.222.0.16 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: Openstack-System-Scope: None Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: User-Agent: python-novaclient Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Auth-Token: gAAAAABjE7u8_2JNWyytTaEV5OKYBxULFWvch6-h8yh_QQyNCSB8N38ToS1i_2II1JXz6drgJ4tNexlnp9_tQW5OeLRDBoHAqpZkpCdwE-Ygz7t9qwkGDSqU9JBfU_h5S4aEsMzNcnwwTPXHxlRu9kjccHZ4uKEV5W9RTHLc_myocVVTNJRZPcQ Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Id: None Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Name: None Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Identity-Status: Confirmed Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Is-Admin-Project: True Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Id: default Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Name: Default Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Name: admin Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Role: admin,member,reader Sep 03 20:40:28.876191 ncdv-master-1 devstack@n-api.service[124104]: X-Roles: admin,member,reader Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant: admin Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Name: admin Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-User: admin Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Id: default Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Name: Default Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: X-User-Name: admin Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: method: > Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: exception: Flavor 42 could not be found. Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: action_args: {'id': '42'} Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:28.877771 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:28.878689 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:28.879768 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-78cbc7f3-3818-424f-8b0c-3d46b870421f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:28.880780 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-78cbc7f3-3818-424f-8b0c-3d46b870421f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015398 Sep 03 20:40:28.880780 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:40:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:29.843856 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2e63ef41-0a6d-4eb1-ba51-86e029c2d948 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:29.844873 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2e63ef41-0a6d-4eb1-ba51-86e029c2d948 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 03 20:40:29.845295 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:30.376091 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f1e47542-96b2-4332-8c9b-4bf8f7894ead admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:30.382269 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-f1e47542-96b2-4332-8c9b-4bf8f7894ead admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f1e47542-96b2-4332-8c9b-4bf8f7894ead admin admin] Request method failure captured: Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Accept: application/json Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Accept-Encoding: gzip, deflate Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Connection: keep-alive Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Content-Length: 0 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Host: 10.222.0.16 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: Openstack-System-Scope: None Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: User-Agent: python-novaclient Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Auth-Token: gAAAAABjE7u9muOM2WFd-N701I32F9C5S2Ol9IRqtPpBb7LLyEU-g9BIOs6EpxmUVI4FzIuRnm-sbzsdYQqVJfK1QFpHIitWFoYGoYGt4CngOm3Hin4uIQOMUiDsNfn_mV7OSwM7egj5FXdETA9j0gURvAsNgVXS7m1P0lTtH1bBNWSmn8Yq_ps Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Id: None Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Name: None Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Identity-Status: Confirmed Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Is-Admin-Project: True Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Id: default Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Name: Default Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Name: admin Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Role: admin,member,reader Sep 03 20:40:30.383948 ncdv-master-1 devstack@n-api.service[124104]: X-Roles: admin,member,reader Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant: admin Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Name: admin Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-User: admin Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Id: default Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Name: Default Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: X-User-Name: admin Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: method: > Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: exception: Flavor 84 could not be found. Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: action_args: {'id': '84'} Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:30.386213 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:30.387371 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.388679 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f1e47542-96b2-4332-8c9b-4bf8f7894ead admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:30.389995 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f1e47542-96b2-4332-8c9b-4bf8f7894ead admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393417 Sep 03 20:40:30.389995 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:40:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:30.395447 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-da47a4af-79bf-42c1-b955-63e760530131 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:30.411957 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-da47a4af-79bf-42c1-b955-63e760530131 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020067 Sep 03 20:40:30.412472 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:30.421961 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fce7b6a2-80eb-4529-ba76-2d63e482a01d admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:30.437172 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fce7b6a2-80eb-4529-ba76-2d63e482a01d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018639 Sep 03 20:40:30.437685 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:30.447261 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e28b5b9a-0a36-4d3c-973f-32f1b40d44d7 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:30.452506 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-e28b5b9a-0a36-4d3c-973f-32f1b40d44d7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e28b5b9a-0a36-4d3c-973f-32f1b40d44d7 admin admin] Request method failure captured: Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Accept: application/json Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Accept-Encoding: gzip, deflate Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Connection: keep-alive Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Content-Length: 0 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Host: 10.222.0.16 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: Openstack-System-Scope: None Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: User-Agent: python-novaclient Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Auth-Token: gAAAAABjE7u9muOM2WFd-N701I32F9C5S2Ol9IRqtPpBb7LLyEU-g9BIOs6EpxmUVI4FzIuRnm-sbzsdYQqVJfK1QFpHIitWFoYGoYGt4CngOm3Hin4uIQOMUiDsNfn_mV7OSwM7egj5FXdETA9j0gURvAsNgVXS7m1P0lTtH1bBNWSmn8Yq_ps Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Id: None Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Name: None Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Identity-Status: Confirmed Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Is-Admin-Project: True Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Id: default Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Name: Default Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Name: admin Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Role: admin,member,reader Sep 03 20:40:30.454020 ncdv-master-1 devstack@n-api.service[124103]: X-Roles: admin,member,reader Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant: admin Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Name: admin Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-User: admin Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Id: default Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Name: Default Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: X-User-Name: admin Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: method: > Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: exception: Flavor 84 could not be found. Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: action_args: {'id': '84'} Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:30.455483 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:30.456418 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:30.457682 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e28b5b9a-0a36-4d3c-973f-32f1b40d44d7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:30.458728 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e28b5b9a-0a36-4d3c-973f-32f1b40d44d7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012198 Sep 03 20:40:30.458728 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:40:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:31.447485 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fce7b6a2-80eb-4529-ba76-2d63e482a01d admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:31.448491 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fce7b6a2-80eb-4529-ba76-2d63e482a01d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 03 20:40:31.448880 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:31.978739 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c2a5ea17-3a3a-4a75-9a2b-d6e1c0618337 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:31.984444 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-c2a5ea17-3a3a-4a75-9a2b-d6e1c0618337 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c2a5ea17-3a3a-4a75-9a2b-d6e1c0618337 admin admin] Request method failure captured: Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Accept: application/json Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Accept-Encoding: gzip, deflate Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Connection: keep-alive Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Content-Length: 0 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Host: 10.222.0.16 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: Openstack-System-Scope: None Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: User-Agent: python-novaclient Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Auth-Token: gAAAAABjE7u_SvABEWWapITN0IFUtIvLA_PgPrM1SR-NDwdXFdEfmCglvaAaJMiacH8eIx1-ByzJtte5vGfWyoi4U7Km12gvOZRr6FmlbXoyQP7zAS4B19EyrFFtCGg31-s0lQAEhMneSgSrNBApbi8DSzmQnmaues5eCW7qyK9-BIzBggmFlbc Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Id: None Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Domain-Name: None Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Identity-Status: Confirmed Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Is-Admin-Project: True Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Id: default Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Domain-Name: Default Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Project-Name: admin Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Role: admin,member,reader Sep 03 20:40:31.986000 ncdv-master-1 devstack@n-api.service[124103]: X-Roles: admin,member,reader Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant: admin Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-Tenant-Name: admin Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-User: admin Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Id: default Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-User-Domain-Name: Default Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: X-User-Name: admin Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: method: > Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: exception: Flavor 451 could not be found. Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: action_args: {'id': '451'} Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:31.987525 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:31.988468 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Sep 03 20:40:31.989736 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c2a5ea17-3a3a-4a75-9a2b-d6e1c0618337 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:31.991022 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c2a5ea17-3a3a-4a75-9a2b-d6e1c0618337 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392866 Sep 03 20:40:31.991022 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:40:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:31.997507 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d8bcc381-28ec-4f2c-a13a-2a00b9769795 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:32.012953 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d8bcc381-28ec-4f2c-a13a-2a00b9769795 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018949 Sep 03 20:40:32.013481 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:32.022861 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:32.037431 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018091 Sep 03 20:40:32.037949 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Sat Sep 3 20:40:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:40:32.047656 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0114d172-1ff3-4371-b075-c4fa338b1bb3 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:32.052957 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-0114d172-1ff3-4371-b075-c4fa338b1bb3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0114d172-1ff3-4371-b075-c4fa338b1bb3 admin admin] Request method failure captured: Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Accept: application/json Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Accept-Encoding: gzip, deflate Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Connection: keep-alive Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Content-Length: 0 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Host: 10.222.0.16 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Openstack-Api-Version: compute 2.92 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: Openstack-System-Scope: None Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: User-Agent: python-novaclient Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Auth-Token: gAAAAABjE7u_SvABEWWapITN0IFUtIvLA_PgPrM1SR-NDwdXFdEfmCglvaAaJMiacH8eIx1-ByzJtte5vGfWyoi4U7Km12gvOZRr6FmlbXoyQP7zAS4B19EyrFFtCGg31-s0lQAEhMneSgSrNBApbi8DSzmQnmaues5eCW7qyK9-BIzBggmFlbc Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Id: None Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Domain-Name: None Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Identity-Status: Confirmed Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Is-Admin-Project: True Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Id: default Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Domain-Name: Default Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Project-Name: admin Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Role: admin,member,reader Sep 03 20:40:32.054430 ncdv-master-1 devstack@n-api.service[124104]: X-Roles: admin,member,reader Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53641d46504c444d9350b7e021f6a4a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant: admin Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Id: 53641d46504c444d9350b7e021f6a4a4 Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-Tenant-Name: admin Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-User: admin Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Id: default Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-User-Domain-Name: Default Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-User-Id: efa1ecf6d7f2438dad00007510b3e878 Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: X-User-Name: admin Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: method: > Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: exception: Flavor 451 could not be found. Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: action_args: {'id': '451'} Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:40:32.056622 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:32.057601 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Sep 03 20:40:32.058847 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0114d172-1ff3-4371-b075-c4fa338b1bb3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:40:32.060021 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0114d172-1ff3-4371-b075-c4fa338b1bb3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011588 Sep 03 20:40:32.060021 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:40:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:33.026263 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:33.027296 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 03 20:40:33.027722 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:33.675291 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3f6d529b-58ca-4fe3-8a4a-5b355ec9de5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:33.694779 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3f6d529b-58ca-4fe3-8a4a-5b355ec9de5c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.522660 Sep 03 20:40:33.695308 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 3 20:40:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:34.676160 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:34.677197 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 03 20:40:34.677591 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:35.225765 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1931a072-1bed-40db-b493-d89a07e45d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:35.244049 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1931a072-1bed-40db-b493-d89a07e45d07 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.415781 Sep 03 20:40:35.244588 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 3 20:40:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:36.228757 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:36.229800 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 03 20:40:36.230191 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:36.766399 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1603151b-81e3-4957-9cda-536929f682d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:36.785701 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1603151b-81e3-4957-9cda-536929f682d1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.411732 Sep 03 20:40:36.786227 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 3 20:40:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:37.758036 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:37.759121 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 03 20:40:37.759510 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:38.286643 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a57bd0be-dbca-4e3f-a8cd-0967aa48a594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:40:38.304985 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a57bd0be-dbca-4e3f-a8cd-0967aa48a594 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399086 Sep 03 20:40:38.305518 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Sat Sep 3 20:40:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:40:39.284102 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:39.285215 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 03 20:40:39.285695 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:40:39.811971 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2b01938-7741-4847-a0c0-a4f1493fe55a admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:40:39.832646 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2b01938-7741-4847-a0c0-a4f1493fe55a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401037 Sep 03 20:40:39.833207 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Sep 3 20:40:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:41:41.799278 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:41.800370 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f9d3389-44f5-47d0-802b-e769887b6e4f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 03 20:41:41.800771 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Sat Sep 3 20:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:41:41.808424 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:42.187924 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e05cc8dd-5bec-44c4-a4bd-f0c9afbc28e7 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:42.208217 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e05cc8dd-5bec-44c4-a4bd-f0c9afbc28e7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401301 Sep 03 20:41:42.208740 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 20:41:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:41:42.229914 ncdv-master-1 devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=14 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:42.233807 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-db4ab8d6-9f7c-4dbb-accc-141579bb7705 admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:42.242161 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-db4ab8d6-9f7c-4dbb-accc-141579bb7705 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013052 Sep 03 20:41:42.242743 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Sep 3 20:41:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:41:42.254487 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d4c38b4e-6779-4844-87e2-b223bb336f2a admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:42.262720 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d4c38b4e-6779-4844-87e2-b223bb336f2a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011866 Sep 03 20:41:42.263221 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Sep 3 20:41:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:41:42.274357 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:42.282055 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011221 Sep 03 20:41:42.282560 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Sat Sep 3 20:41:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:41:42.293500 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-636ec3f7-ec33-4459-b3ff-a1cb9725aeda admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:41:42.301117 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-636ec3f7-ec33-4459-b3ff-a1cb9725aeda admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011082 Sep 03 20:41:42.301626 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Sat Sep 3 20:41:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:47:08.554881 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:47:08.555899 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 03 20:47:08.556292 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:47:08.703502 ncdv-master-1 devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=6 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:08.855176 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:47:08.858577 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:47:08.859050 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:47:08.859470 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:47:08.860197 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:47:08.860645 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:47:08.861098 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:47:08.901593 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a79f59f6-b23a-4da4-885e-2c2e54fd72ca admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.199577 Sep 03 20:47:08.902145 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:47:08 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:47:09.729527 ncdv-master-1 devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:47:09.730536 ncdv-master-1 devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-873a8bdd-96de-4697-a89e-99bbdf12384c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 03 20:47:09.731478 ncdv-master-1 devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Sat Sep 3 20:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:47:09.945411 ncdv-master-1 devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:47:09.948887 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:47:09.949867 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:47:09.950286 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:47:09.950986 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:47:09.951431 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:47:09.951844 ncdv-master-1 devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:47:09.975178 ncdv-master-1 devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a8565770-56f3-49a9-a246-4216788915a8 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.080864 Sep 03 20:47:09.975729 ncdv-master-1 devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:47:09 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:47:56.042826 ncdv-master-1 devstack@n-api.service[124102]: Sat Sep 3 20:47:56 2022 - graceful shutdown triggered... Sep 03 20:47:56.043377 ncdv-master-1 devstack@n-api.service[124103]: Gracefully killing worker 1 (pid: 124103)... Sep 03 20:47:56.042955 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 03 20:47:56.044299 ncdv-master-1 devstack@n-api.service[124104]: Gracefully killing worker 2 (pid: 124104)... Sep 03 20:47:57.043949 ncdv-master-1 devstack@n-api.service[124102]: worker 1 buried after 1 seconds Sep 03 20:47:57.043949 ncdv-master-1 devstack@n-api.service[124102]: worker 2 buried after 1 seconds Sep 03 20:47:57.044551 ncdv-master-1 devstack@n-api.service[124102]: goodbye to uWSGI. Sep 03 20:47:57.045659 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 03 20:47:57.046721 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 03 20:47:57.049483 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 20:47:57.084822 ncdv-master-1 devstack@n-api.service[140505]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 20:47:57 2022] *** Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: nodename: ncdv-master-1 Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: machine: x86_64 Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: clock source: unix Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: pcre jit disabled Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: detected number of CPU cores: 4 Sep 03 20:47:57.086947 ncdv-master-1 devstack@n-api.service[140505]: current working directory: / Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: detected binary path: /usr/bin/uwsgi-core Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: your processes number limit is 47680 Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: your memory page size is 4096 bytes Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: detected max file descriptor number: 2048 Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: lock engine: pthread robust mutexes Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: thunder lock: enabled Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 20:47:57.087625 ncdv-master-1 devstack@n-api.service[140505]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 20:47:57.134842 ncdv-master-1 devstack@n-api.service[140505]: Python main interpreter initialized at 0x561a173159c0 Sep 03 20:47:57.134842 ncdv-master-1 devstack@n-api.service[140505]: python threads support enabled Sep 03 20:47:57.135029 ncdv-master-1 devstack@n-api.service[140505]: your server socket listen backlog is limited to 100 connections Sep 03 20:47:57.135029 ncdv-master-1 devstack@n-api.service[140505]: your mercy for graceful operations on workers is 90 seconds Sep 03 20:47:57.135193 ncdv-master-1 devstack@n-api.service[140505]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 20:47:57.135282 ncdv-master-1 devstack@n-api.service[140505]: *** Operational MODE: preforking *** Sep 03 20:47:57.135526 ncdv-master-1 devstack@n-api.service[140505]: *** uWSGI is running in multiple interpreter mode *** Sep 03 20:47:57.135526 ncdv-master-1 devstack@n-api.service[140505]: spawned uWSGI master process (pid: 140505) Sep 03 20:47:57.135719 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 03 20:47:57.136460 ncdv-master-1 devstack@n-api.service[140505]: spawned uWSGI worker 1 (pid: 140519, cores: 1) Sep 03 20:47:57.138850 ncdv-master-1 devstack@n-api.service[140505]: spawned uWSGI worker 2 (pid: 140520, cores: 1) Sep 03 20:47:57.138850 ncdv-master-1 devstack@n-api.service[140505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 20:47:58.459204 ncdv-master-1 devstack@n-api.service[140520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 20:47:58.473527 ncdv-master-1 devstack@n-api.service[140519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 20:47:59.231739 ncdv-master-1 devstack@n-api.service[140520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:47:59.231739 ncdv-master-1 devstack@n-api.service[140520]: from cryptography.utils import int_from_bytes Sep 03 20:47:59.232077 ncdv-master-1 devstack@n-api.service[140520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:47:59.232077 ncdv-master-1 devstack@n-api.service[140520]: from cryptography.utils import int_from_bytes Sep 03 20:47:59.247791 ncdv-master-1 devstack@n-api.service[140519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:47:59.247791 ncdv-master-1 devstack@n-api.service[140519]: from cryptography.utils import int_from_bytes Sep 03 20:47:59.248116 ncdv-master-1 devstack@n-api.service[140519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:47:59.248116 ncdv-master-1 devstack@n-api.service[140519]: from cryptography.utils import int_from_bytes Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:48:01.729792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.730845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.730845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.730845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.731057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.731510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.731510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.731795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:48:01.732172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.732276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:48:01.732361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.732361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.732507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:48:01.732790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.732936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:48:01.733016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.733244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:48:01.733423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.733576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.733782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.733907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.734981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.735194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.735371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.735519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.735775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.735980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.737196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.737465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.737691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.737914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.738139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.738357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.738578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.738806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.739027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.739027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.739455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.739703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.739932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.740157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.740388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.740608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.740842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.740842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.741318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.741548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.741759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.741978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.742202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.742448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.742665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.742850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.743910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.744760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.745075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.745572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.745819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.745970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.746117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.746888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.747877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.748957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.749892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.750913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.751071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.751071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.751547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.751547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.751858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.752781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.753940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.754891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.755038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.755198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.755399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.755788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.755952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.756100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.756258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.756809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.757172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.757368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.757528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.757676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.757852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.758894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.759972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.760858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.761942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.762552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.763907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.764064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.764295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.764981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.765144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.765144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.765478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.765912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.765912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.766229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.766384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.766925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.767287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.767497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.767652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.767652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.767943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.768099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.768253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.768413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.768413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.768864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.769992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.770772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.771982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.772888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.773891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.774869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.775030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.775177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.775330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.775499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.775647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.776060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.776475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.777150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.777630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.777803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.777962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.778942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.779098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.779256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.779402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.779556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.779709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.780036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.780864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.781149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.781352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.781575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.781766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.782026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.782268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.782500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.782699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.782910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.783127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.783360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.783584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.783786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.783972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.784159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.784352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.784599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.784817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.785082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.785267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.785415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.785593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:48:01.785753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.786184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.786352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.786513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.786667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.787106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.787682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.787682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.788961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.789158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.789315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.789507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.789657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.789847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.790976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.791128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.791321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.791511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.791674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.791865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.792829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.793979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.794788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.795922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.796085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.796617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.796773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.796773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.797498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.797902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.798936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.799083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.799238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.799419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.799686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.799876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.800836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.801851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.802988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.803808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.803967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.804126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.804286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.804441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.804633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.804817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.805102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.805297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.805456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.805653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.805873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.806843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.809216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.810160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.811060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.811060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.811060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.811060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.811060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.812936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.813883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.814893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.815019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.815316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.815506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.815757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.815949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.816083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.816346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.816707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.817119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.817567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.817974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.818298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.818434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.818564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.818694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.818866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.819956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.820100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.820376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.820511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.820704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.820878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.821085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.821377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.821512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.821711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.821904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.822083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.822356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.822522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.822679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.822848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.823990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.824253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.824404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.824647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.824788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.825960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.826169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.826316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.826658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.826940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.828962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.829896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.830921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.831061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.831239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.831487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.831631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.831876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.832014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.832218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.832395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.832623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.832825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.833900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.834089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.834248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.834418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.834714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.834875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.835961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.836134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.836309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.836578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.836733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.837093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.837231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.837361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.838241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.838487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.838646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.838918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.838918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.839191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.839322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.839322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.839884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.840877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.841975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.842168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.842330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.842521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.842841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.843879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.844055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.844239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.844381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.844675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.844810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.845954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.846101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.846271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.846556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.846689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.846895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.847190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.847338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.847494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.847636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.847817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.848405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.848716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.849834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.850862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.851837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.852786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.853974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.854909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.855985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.856160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.856312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.856475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.856697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.856825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.857807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.858003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.858170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.858170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.858956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.858956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.859783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.859783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.860889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.861946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.862797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.863882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.864836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.865977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.866068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.866287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.866370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.866700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.866987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.867939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.868022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.868256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.868365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.869941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.870823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.871997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.872971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.873263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.873627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.873627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.874396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.874510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.874659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.874909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.875044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.875229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.875357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.875476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.875621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.876752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.877912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.878043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.878218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.878338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.878463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.878604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.879330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.879484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.879603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.879716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.879837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.880933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.881977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.882901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.883975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.884949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.885986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.886999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.887962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.888095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.888239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.888368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.888556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.889212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.889990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.890958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.891903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.892878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.893805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.894879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.895990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.896110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.896724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.896863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.897862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.898916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.899558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.899683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.899795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.899906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.900999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.901953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.902907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.903039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.903160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.904761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.905892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.906956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.907979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.908112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.908234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.908367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.909045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.909714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.909815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.909899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.909981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.910941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.911936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.912879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.913953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.914913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.915753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.915868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.915868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.916037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.916226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.916544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.916696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.916850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.917304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.917459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.917739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.917913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.918906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.919051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.919264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.919437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.919838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.919939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.920960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.921927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.922968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.923917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.924967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.925257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.925368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.925571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.925663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.925895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.926846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.927844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.928821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.929987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.930922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.931912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.932013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.932249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.932349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.932567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.932828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.933910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.934997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.935963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.936175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.936796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.937922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.938896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.939873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.940838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.941906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.942148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.942473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.942807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.943015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.943344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.943690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.944010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.944372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.944706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.945070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.945366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.945462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.945717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.945817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.946790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.947013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.968980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.969873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.970633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.971808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.972606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.972709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.972781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.972862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.973062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.973816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.973977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.974105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.974196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.974279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.974350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.974916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.975075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.975230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.975324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.975469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.975574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.976669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.977955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.978359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.979984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.980885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.981974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.982979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.983747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.984843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.985934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.986987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.987995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.988877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.989028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.989028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.989307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.989386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.989821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.990263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.990672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.991223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.992245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.992245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.992792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.993229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.993729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.994192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.994624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.995092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.995589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.995923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.996318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.996484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.996690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.996779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.997977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.998240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.998334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.998639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.999292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.999509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.999633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.999865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:01.999966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.000223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.000302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.000565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.000694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.000888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.001956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.002974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.003989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.004963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.005945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.006967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.007982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.008206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.008305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.008553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.008630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.008947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.009959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.010905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.011856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.012915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.013167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.013270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.013487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.013856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.014076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.014168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.015029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.015382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.015517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.015746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.016772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.017970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.018962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.019918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.020048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.020178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.020446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.020576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.020871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.021042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.021343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.021484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.021717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.021825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.022082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.022172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.022467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.022616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.022807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.023017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.023164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.023266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.024945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.025934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.026943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.027097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.027451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.027596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.027738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.027880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.028959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.029990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.030857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.031921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.032992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.033968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.034245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.034397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.034590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.034724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.034915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.035047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.035176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:48:02.035314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.035598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.035942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.036282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.036653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.036999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.037382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.037724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.038076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.038401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.038817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.039203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.039585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.039942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.040311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.040662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.041018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.041399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.041792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.042074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.042416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.042748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.043083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.043414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.043738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.044082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.044410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.044734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.045104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.045431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.045789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.046119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.046440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.046774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.047103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.047434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.047773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.048111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.048431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.048769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.049134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.049505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.049830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.050192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.050535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.050862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.051190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.051514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:48:02.051767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:48:02.105002 ncdv-master-1 devstack@n-api.service[140520]: INFO dbcounter [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Registered counter for database nova_api Sep 03 20:48:02.125858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_db.sqlalchemy.engines [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.130869 ncdv-master-1 devstack@n-api.service[140519]: INFO dbcounter [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Registered counter for database nova_api Sep 03 20:48:02.140937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writer thread running {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.152699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_db.sqlalchemy.engines [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.159338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writer thread running {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.200709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.context [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140520) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 20:48:02.204643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:02.205155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:02.206746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:02.207494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:02.207961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:02.210020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:02.212074 ncdv-master-1 devstack@n-api.service[140520]: INFO dbcounter [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Registered counter for database nova_cell0 Sep 03 20:48:02.216643 ncdv-master-1 devstack@n-api.service[140520]: INFO dbcounter [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Registered counter for database nova_cell1 Sep 03 20:48:02.218116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.context [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140519) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 20:48:02.222210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:02.222700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:02.224354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:02.225150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:02.225620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:02.227688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:02.228495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_db.sqlalchemy.engines [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.229360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_db.sqlalchemy.engines [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.229971 ncdv-master-1 devstack@n-api.service[140519]: INFO dbcounter [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Registered counter for database nova_cell0 Sep 03 20:48:02.234787 ncdv-master-1 devstack@n-api.service[140519]: INFO dbcounter [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Registered counter for database nova_cell1 Sep 03 20:48:02.236049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writer thread running {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.242087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_db.sqlalchemy.engines [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.244521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_db.sqlalchemy.engines [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.252553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writer thread running {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.253861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writer thread running {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.385779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writer thread running {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.395728 ncdv-master-1 devstack@n-api.service[140520]: INFO dbcounter [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Registered counter for database nova_cell0 Sep 03 20:48:02.403175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_db.sqlalchemy.engines [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.408237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writer thread running {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.409056 ncdv-master-1 devstack@n-api.service[140519]: INFO dbcounter [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Registered counter for database nova_cell0 Sep 03 20:48:02.416733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_db.sqlalchemy.engines [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:48:02.422566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writer thread running {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:48:02.866636 ncdv-master-1 devstack@n-api.service[140519]: WARNING keystonemiddleware.auth_token [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:48:02.867247 ncdv-master-1 devstack@n-api.service[140520]: WARNING keystonemiddleware.auth_token [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:48:02.874502 ncdv-master-1 devstack@n-api.service[140519]: WARNING keystonemiddleware.auth_token [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:48:02.874659 ncdv-master-1 devstack@n-api.service[140520]: WARNING keystonemiddleware.auth_token [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:48:03.103613 ncdv-master-1 devstack@n-api.service[140519]: WARNING keystonemiddleware.auth_token [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:48:03.109021 ncdv-master-1 devstack@n-api.service[140520]: WARNING keystonemiddleware.auth_token [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 20:48:03.109869 ncdv-master-1 devstack@n-api.service[140519]: WARNING keystonemiddleware.auth_token [None req-5315f53b-c46e-4881-9731-591d311d30cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:48:03.114974 ncdv-master-1 devstack@n-api.service[140519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a173159c0 pid: 140519 (default app) Sep 03 20:48:03.115073 ncdv-master-1 devstack@n-api.service[140520]: WARNING keystonemiddleware.auth_token [None req-4611ca7a-bd66-42fc-8339-525285ba23bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 20:48:03.120479 ncdv-master-1 devstack@n-api.service[140520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a173159c0 pid: 140520 (default app) Sep 03 20:48:43.989069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:43.989937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:43.990767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:43.991770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:45.050518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:45.055153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:45.055644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:45.056256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:45.057015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:45.057478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:45.057908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:45.099765 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d925b5fe-369c-425c-9948-7bcbd41afe09 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.122051 Sep 03 20:48:45.100449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:48:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:45.337640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4173e5a4-6149-4a38-ba34-a68c5a7841d2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-962957450"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:45.360030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-4173e5a4-6149-4a38-ba34-a68c5a7841d2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid a4442bce-baf1-4288-ba66-90adbaa6d42f for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:45.368405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:45.369450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:45.370436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:45.371553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:45.449818 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4173e5a4-6149-4a38-ba34-a68c5a7841d2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.336249 Sep 03 20:48:45.457465 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:45.463737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6d3d3a1-953a-4eb9-9eb8-9ce9e0a3c9e2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:45.499334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3a1-953a-4eb9-9eb8-9ce9e0a3c9e2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:45.499939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3a1-953a-4eb9-9eb8-9ce9e0a3c9e2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:45.500730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d3d3a1-953a-4eb9-9eb8-9ce9e0a3c9e2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.272331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28659d8e-9dfd-4276-85e5-e90d76bf7287 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1302362236", "id": 1814236896, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:46.306879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28659d8e-9dfd-4276-85e5-e90d76bf7287 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.781803 Sep 03 20:48:46.307601 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2/3] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:48:45 2022] POST /compute/v2.1/flavors => generated 449 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:48:46.475043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6d3d3a1-953a-4eb9-9eb8-9ce9e0a3c9e2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.015007 Sep 03 20:48:46.475955 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:45 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:46.547819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '.version_select at 0x7fae687e2940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:46.555297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140520) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 03 20:48:46.556499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.557018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.557461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.584133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.584613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.585096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.598769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.599184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.599628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.605791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a755b022-f6ad-4b00-b607-5debbdafb168 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.297011 Sep 03 20:48:46.618868 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 3 20:48:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:46.695629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-196402359", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:46.774845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Calling method '.version_select at 0x7fae67ef69d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:46.778612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.779802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.780224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.798128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.798614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.799051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.810359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:46.811378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:46.811865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:46.822957 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29539c4c-bd34-4599-9ff1-28e87561e0ad tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.215573 Sep 03 20:48:46.823529 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 4/6] 10.222.0.16 () {60 vars in 1208 bytes} [Sat Sep 3 20:48:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:47.011198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55885dcf-6180-4d7a-bda8-c832a65e1a45 tempest-InstanceUsageAuditLogTestJSON-1366628681 tempest-InstanceUsageAuditLogTestJSON-1366628681-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:47.029390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:48:47.031927 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55885dcf-6180-4d7a-bda8-c832a65e1a45 tempest-InstanceUsageAuditLogTestJSON-1366628681 tempest-InstanceUsageAuditLogTestJSON-1366628681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-03 20:48:45" status: 200 len: 318 microversion: 2.1 time: 0.207383 Sep 03 20:48:47.032646 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 5/7] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 3 20:48:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-03%2020%3A48%3A45 => generated 318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:47.148727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1435996033", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:47.445470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:48:47.445905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:48:47.446526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:48:47.447110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:48:47.447534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:48:47.463070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:48:47.463565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:47.464166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:47.464653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:47.465683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:47.466140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:47.466738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:47.498793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Getting quotas for project 123134ed03c540b79122e8ecaa021d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:48:47.505142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Getting quotas for user c34f1d07f48c4b4dadf97fd38709fd33 and project 123134ed03c540b79122e8ecaa021d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:48:47.518723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:48:47.521825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:48:47.579889 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc61133d-417e-4e2b-8350-c13b89e36b4a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102326 Sep 03 20:48:47.581087 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3/8] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:48:47.698540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:48:47.699035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:48:47.699425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:48:47.699836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:48:47.700246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:48:47.713718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:47.714200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:47.714639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:47.715786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:47.716415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:47.717537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:47.745902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Getting quotas for project 993b7f76855c47e58427d7542a0f41c2. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:48:47.752561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Getting quotas for user 4c3a73b54fd54a23808657c7ed9e62cb and project 993b7f76855c47e58427d7542a0f41c2. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:48:47.765531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:48:47.768266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:48:47.821136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-734d017b-9c6c-4682-8314-56122750ea4e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787526 Sep 03 20:48:47.821786 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 6/9] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:48:47.826906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:47.840511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:47.841211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:47.842519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:47.880556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3d5ac4c-18af-4a45-9a9f-944f5c5fb107 tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:47.894710 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3d5ac4c-18af-4a45-9a9f-944f5c5fb107 tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] 10.222.0.16 "GET /compute/v2.1/flavors/1814236896" status: 200 len: 449 microversion: 2.55 time: 0.311922 Sep 03 20:48:47.903254 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Sep 03 20:48:47.903920 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 4/10] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Sep 3 20:48:47 2022] GET /compute/v2.1/flavors/1814236896 => generated 449 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:48:47.909125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-393faf88-d7e0-4b30-95dd-60d7aae5273e tempest-InstanceUsageAuditLogTestJSON-1366628681 tempest-InstanceUsageAuditLogTestJSON-1366628681-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:47.933949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-393faf88-d7e0-4b30-95dd-60d7aae5273e tempest-InstanceUsageAuditLogTestJSON-1366628681 tempest-InstanceUsageAuditLogTestJSON-1366628681-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030325 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 39 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:48:47.940462 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: {"add_host": {"host": "nch2-master-1"}} Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:47.942136 ncdv-master-1 devstack@n-api.service[140520]: exception: Aggregate 1 already has host nch2-master-1. Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:48:47.942793 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi session.flush() Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 20:48:47.943889 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 20:48:47.945509 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:48:47.946531 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 3, 20, 48, 47, 886103), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 1}] Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:47.947459 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch2-master-1. Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.948440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch2-master-1. Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:47.953330 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:47.954558 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch2-master-1. Sep 03 20:48:47.954558 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:47.954558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:47.954558 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c98435f5-07a2-457c-9078-e001330cb3c2 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.119226 Sep 03 20:48:47.954828 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:48:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:47.957210 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 7/12] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:47 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 03 20:48:47.959424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c452add2-0e8e-4e45-a977-3ce61a50516d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:47.960168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c452add2-0e8e-4e45-a977-3ce61a50516d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:48.104713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32201beb-3a42-491e-b402-8b8a5723e8af tempest-AZAdminNegativeTestJSON-2053824766 tempest-AZAdminNegativeTestJSON-2053824766-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.108642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32201beb-3a42-491e-b402-8b8a5723e8af tempest-AZAdminNegativeTestJSON-2053824766 tempest-AZAdminNegativeTestJSON-2053824766-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a999bf00dd8845db88dcd3eb919e569d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33dd8b3c5f2346fcbcac1f6f7d61390b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:48.110086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c452add2-0e8e-4e45-a977-3ce61a50516d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32201beb-3a42-491e-b402-8b8a5723e8af tempest-AZAdminNegativeTestJSON-2053824766 tempest-AZAdminNegativeTestJSON-2053824766-project] Request method failure captured: Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72vGX91hJNTng-f9jMyZWVLu58xXIvIVLXLY2dC2QWCGkNljdDd6N7Yw97JrwDg2fDJfXEp9jWMl7pQGS84ExltI3GS8VfJ_Z0xUEzX0Dl-4LojpHPJvfF1TfNSkBK4Sep7Ejm8nPgVAL5LQPuCLuBCBkQ80XsvQHogi9woaa7oprM Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 33dd8b3c5f2346fcbcac1f6f7d61390b Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2053824766 Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:48:48.113339 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33dd8b3c5f2346fcbcac1f6f7d61390b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_33dd8b3c5f2346fcbcac1f6f7d61390b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/33dd8b3c5f2346fcbcac1f6f7d61390b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/33dd8b3c5f2346fcbcac1f6f7d61390b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AZAdminNegativeTestJSON-2053824766 Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 33dd8b3c5f2346fcbcac1f6f7d61390b Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2053824766 Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AZAdminNegativeTestJSON-2053824766-project Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: a999bf00dd8845db88dcd3eb919e569d Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AZAdminNegativeTestJSON-2053824766-project Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 03 20:48:48.114631 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:48.115373 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 03 20:48:48.116460 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:48.118426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32201beb-3a42-491e-b402-8b8a5723e8af tempest-AZAdminNegativeTestJSON-2053824766 tempest-AZAdminNegativeTestJSON-2053824766-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:48.119436 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-32201beb-3a42-491e-b402-8b8a5723e8af tempest-AZAdminNegativeTestJSON-2053824766 tempest-AZAdminNegativeTestJSON-2053824766-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.161243 Sep 03 20:48:48.120137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:48:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:48:48.126297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d246d95-38b9-44d5-b4df-49c3e1ec5169 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.127374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d246d95-38b9-44d5-b4df-49c3e1ec5169 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:48.131029 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c452add2-0e8e-4e45-a977-3ce61a50516d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1219 microversion: 2.1 time: 0.179744 Sep 03 20:48:48.146720 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 6/14] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:47 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1219 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:48.155903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88fc6291-48ab-4401-9a61-7b6e0e96ee83 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] Action: 'update', calling method: .version_select at 0x7fae68ce2790>, body: {"flavor": {"description": "new"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:48.266436 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88fc6291-48ab-4401-9a61-7b6e0e96ee83 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1814236896" status: 200 len: 450 microversion: 2.55 time: 0.118479 Sep 03 20:48:48.267051 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 7/15] 10.222.0.16 () {62 vars in 1219 bytes} [Sat Sep 3 20:48:48 2022] PUT /compute/v2.1/flavors/1814236896 => generated 450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:48:48.290355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f731adf-1f97-4553-b108-482782fc2adf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:48.304283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d246d95-38b9-44d5-b4df-49c3e1ec5169 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:48.324220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f731adf-1f97-4553-b108-482782fc2adf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:48.325367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f731adf-1f97-4553-b108-482782fc2adf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:48.327021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f731adf-1f97-4553-b108-482782fc2adf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:48.332783 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d246d95-38b9-44d5-b4df-49c3e1ec5169 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1219 microversion: 2.1 time: 0.211429 Sep 03 20:48:48.345500 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:48 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:48.345500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c77a489b-8837-4876-a369-81b0480c5a68 tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.390924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c77a489b-8837-4876-a369-81b0480c5a68 tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.055934 Sep 03 20:48:48.403329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 10/17] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:48.412158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b9feb475-5737-4745-bfd3-82552a43d0cb tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.433229 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b9feb475-5737-4745-bfd3-82552a43d0cb tempest-FlavorsV255TestJSON-2078339970 tempest-FlavorsV255TestJSON-2078339970-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.024861 Sep 03 20:48:48.434295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 11/18] 10.222.0.16 () {60 vars in 1166 bytes} [Sat Sep 3 20:48:48 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:48.454587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e61de6d2-373d-4a5c-9527-f4108bf50ce5 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.489366 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e61de6d2-373d-4a5c-9527-f4108bf50ce5 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1814236896" status: 202 len: 0 microversion: 2.55 time: 0.040769 Sep 03 20:48:48.490423 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 12/19] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Sep 3 20:48:48 2022] DELETE /compute/v2.1/flavors/1814236896 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:48:48.506634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02ceaf87-655f-48e0-ad65-964371b48463 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.555582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-02ceaf87-655f-48e0-ad65-964371b48463 tempest-FlavorsV255TestJSON-1118318677 tempest-FlavorsV255TestJSON-1118318677-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.060489 Sep 03 20:48:48.556464 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 13/20] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:48:48 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:48:48.657326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f731adf-1f97-4553-b108-482782fc2adf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.379114 Sep 03 20:48:48.658918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 8/21] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:48.673352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f1d24e5-0338-4eb2-9f8d-3e975f6b23fb tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.725907 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f1d24e5-0338-4eb2-9f8d-3e975f6b23fb tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.059256 Sep 03 20:48:48.731189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:48 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:48:48.741120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-876ada6f-e61b-4d7c-ab7b-bba52389b9e4 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1238037952"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:48.745283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-876ada6f-e61b-4d7c-ab7b-bba52389b9e4 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid dcc973ee-4f8d-49fb-b2e7-b56601e2cebb for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:48.792358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1304c1ce-6413-4f58-824d-160a45c30c61 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-959358133", "name": "tempest-test_aggregate-585713599"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:48.815090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-876ada6f-e61b-4d7c-ab7b-bba52389b9e4 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078333 Sep 03 20:48:48.816553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 9/23] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:48.834014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-1304c1ce-6413-4f58-824d-160a45c30c61 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 87368bfc-1c73-4d95-8236-9f3829bfda24 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:48.883639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1304c1ce-6413-4f58-824d-160a45c30c61 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.101833 Sep 03 20:48:48.885041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 15/24] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Sep 3 20:48:48 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:48.897049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fdf24b04-5317-4fee-8218-a19485c4b2d8 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:48.926709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fdf24b04-5317-4fee-8218-a19485c4b2d8 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.033255 Sep 03 20:48:48.928425 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:48:48 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:48.943822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66545b50-13da-4591-b985-4c4435de3379 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:48.984509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66545b50-13da-4591-b985-4c4435de3379 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:48.985338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66545b50-13da-4591-b985-4c4435de3379 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:48.985797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66545b50-13da-4591-b985-4c4435de3379 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:49.384958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8b39784-6f9d-4086-8ba2-c0e696e2e608 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:49.389935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8b39784-6f9d-4086-8ba2-c0e696e2e608 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8b39784-6f9d-4086-8ba2-c0e696e2e608 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 39 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:48:49.394923 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: {"add_host": {"host": "nch2-master-1"}} Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:49.396004 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:49.396766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 03 20:48:49.397712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:49.401188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8b39784-6f9d-4086-8ba2-c0e696e2e608 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:49.404915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8b39784-6f9d-4086-8ba2-c0e696e2e608 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.580479 Sep 03 20:48:49.406409 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 10/26] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:48 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 583 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:48:49.413009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:49.413926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:49.463673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:49.464207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:49.464667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:49.465687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:49.466143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:49.466617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:49.687073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:49.710237 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47a80966-b7e3-4d2f-a167-0c81b3290d22 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1223 microversion: 2.1 time: 0.302558 Sep 03 20:48:49.713633 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 11/27] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:49 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1223 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:49.719999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:49.729748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:49.745550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:49.746303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:49.746965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:49.748031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:49.748401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:49.748838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:49.866243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:49.879148 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-69417720-5584-4596-bb08-ba7e67f76a27 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1223 microversion: 2.1 time: 0.163611 Sep 03 20:48:49.882404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 12/28] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:49 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:49.892375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1ca8c0c-f022-4d26-ad11-3408112909c4 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:49.936064 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a1ca8c0c-f022-4d26-ad11-3408112909c4 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.052007 Sep 03 20:48:49.936961 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 13/29] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:49 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:48:49.947502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a838915-68d4-4a5a-95e2-12f0df8d52da tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2028678445"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:49.952985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-7a838915-68d4-4a5a-95e2-12f0df8d52da tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid 24d233f4-f02f-49ba-b51b-2fc9786a2a80 for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:49.979101 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a838915-68d4-4a5a-95e2-12f0df8d52da tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036889 Sep 03 20:48:49.980749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 14/30] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:49.992375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-587150018"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.009040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140519) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 03 20:48:50.009826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.010374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.010849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.021162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.021659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.022279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.032766 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-587150018 could not be found. Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 57 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:48:50.046943 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: {"add_host": {"host": "tempest-nonexist_host-587150018"}} Sep 03 20:48:50.048055 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: exception: Compute host tempest-nonexist_host-587150018 could not be found. Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-587150018'}}} Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-587150018' is not mapped to any cell Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.048695 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 03 20:48:50.050899 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-587150018 could not be found. Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-587150018 could not be found. Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.051837 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-587150018 could not be found. Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-587150018 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c1e2203-07d0-4677-94ba-697d88e7b4ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.059747 Sep 03 20:48:50.052882 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 15/31] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:48:50.059241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fc28c37-de1d-4e49-bb54-6553126d7f89 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.161782 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66545b50-13da-4591-b985-4c4435de3379 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 312 microversion: 2.1 time: 1.224631 Sep 03 20:48:50.163461 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 17/32] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:48:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 312 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:50.266690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fc28c37-de1d-4e49-bb54-6553126d7f89 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.211036 Sep 03 20:48:50.267814 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 16/33] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:48:50.277558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f51b6ecb-2299-4c1e-8b84-f555354579c1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f51b6ecb-2299-4c1e-8b84-f555354579c1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 283 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:48:50.288257 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.289703 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:48:50.290327 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.290949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.291981 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.292825 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:48:50.292825 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:48:50.292825 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:48:50.292825 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.292825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f51b6ecb-2299-4c1e-8b84-f555354579c1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.293163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f51b6ecb-2299-4c1e-8b84-f555354579c1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017123 Sep 03 20:48:50.295633 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 18/34] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:48:50.301531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e7c86b5-a663-4429-a38f-ffdb2289e5fe tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e7c86b5-a663-4429-a38f-ffdb2289e5fe tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 27 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:48:50.307041 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: {"aggregate": {"name": ""}} Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:50.308209 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi '' Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.309633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:48:50.311357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.314325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e7c86b5-a663-4429-a38f-ffdb2289e5fe tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.316199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9e7c86b5-a663-4429-a38f-ffdb2289e5fe tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018633 Sep 03 20:48:50.317250 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 20:48:50.330384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa60c8d4-659a-4b58-b2a9-9a684808b7cb tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2140968500"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.336716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa60c8d4-659a-4b58-b2a9-9a684808b7cb tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa60c8d4-659a-4b58-b2a9-9a684808b7cb tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 60 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:48:50.338868 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: {"aggregate": {"name": "tempest-test_aggregate-2140968500"}} Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:50.340449 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2140968500'}}} Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:50.341252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:50.342467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 03 20:48:50.349625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.351765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa60c8d4-659a-4b58-b2a9-9a684808b7cb tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.353384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa60c8d4-659a-4b58-b2a9-9a684808b7cb tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029536 Sep 03 20:48:50.359354 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:48:50.363768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-102290f7-70c5-4e49-9a63-d944b3f16527 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-886495860"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.367847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-102290f7-70c5-4e49-9a63-d944b3f16527 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid 8471e651-8d3d-4cca-b98f-07cbcfe2425b for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:50.428410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-102290f7-70c5-4e49-9a63-d944b3f16527 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068015 Sep 03 20:48:50.428782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:50.450487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-886495860"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.458767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid 454c4086-df24-4ae7-94a7-551f16081901 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:50.484841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-886495860 already exists. Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 59 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:48:50.487451 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: {"aggregate": {"name": "tempest-test_aggregate-886495860"}} Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:50.488577 ncdv-master-1 devstack@n-api.service[140520]: exception: Aggregate tempest-test_aggregate-886495860 already exists. Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-886495860'}}} Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 03 20:48:50.489257 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-886495860 already exists. Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:50.490171 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-886495860 already exists. Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-886495860 already exists. Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-886495860 already exists. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.491663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94129671-f119-40e3-8bac-fdea1388b206 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.052047 Sep 03 20:48:50.492376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:48:50.499814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-322b0cc7-6586-44e7-85e6-63d9fafbe787 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.554892 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-322b0cc7-6586-44e7-85e6-63d9fafbe787 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057962 Sep 03 20:48:50.556270 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:48:50.578529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-35deae20-2942-4b6a-a9c3-8223e41b1d2a tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1268581361"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.584798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-35deae20-2942-4b6a-a9c3-8223e41b1d2a tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid ae5524b9-eb28-4e4b-9284-1c653965c99a for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:50.640265 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-35deae20-2942-4b6a-a9c3-8223e41b1d2a tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077602 Sep 03 20:48:50.647959 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:50.655111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c524ca2c-d6a6-4d32-a8d0-1c2c05f8fbed tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.657252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c524ca2c-d6a6-4d32-a8d0-1c2c05f8fbed tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c524ca2c-d6a6-4d32-a8d0-1c2c05f8fbed tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:48:50.658838 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 03 20:48:50.659947 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6'} Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:50.660538 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.662602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c524ca2c-d6a6-4d32-a8d0-1c2c05f8fbed tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.663443 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c524ca2c-d6a6-4d32-a8d0-1c2c05f8fbed tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.011269 Sep 03 20:48:50.663443 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:48:50.668708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b39575f-46a2-4edd-9942-1411a5131685 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.696104 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b39575f-46a2-4edd-9942-1411a5131685 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.030835 Sep 03 20:48:50.702835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 03 20:48:50.708763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6def05f4-1170-4fbe-8c4d-2c5662c57ff3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.721650 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-6def05f4-1170-4fbe-8c4d-2c5662c57ff3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6def05f4-1170-4fbe-8c4d-2c5662c57ff3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:48:50.724583 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: exception: Aggregate -1 could not be found. Sep 03 20:48:50.725748 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '-1'} Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:48:50.726365 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.727296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 03 20:48:50.729510 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:50.731445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6def05f4-1170-4fbe-8c4d-2c5662c57ff3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:50.733196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6def05f4-1170-4fbe-8c4d-2c5662c57ff3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028778 Sep 03 20:48:50.734196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:48:50 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:48:50.742986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.744198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:50.752590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.753146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.755083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.756537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.758620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.758620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.829196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:50.838678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9404430-ab2e-4d36-bd56-4681300f86b1 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1271 microversion: 2.1 time: 0.099445 Sep 03 20:48:50.845932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:50 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:50.856638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-301eb4b2-2d2a-462a-a1a9-a671331748cf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-216357257"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.860668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-301eb4b2-2d2a-462a-a1a9-a671331748cf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid 1dce9fed-cbf3-4de1-abb0-3636abd8a6b1 for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:48:50.874457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:50.912468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-301eb4b2-2d2a-462a-a1a9-a671331748cf tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065237 Sep 03 20:48:50.913254 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 25/45] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:50.916097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1981470660", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "availability_zone": "tempest-test_az-959358133"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:50.921095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:50.921967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:50.931509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.932008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.932449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.934877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.935364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.935799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.943173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.945043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.945603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:50.947650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:50.949264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:50.949588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:51.055364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:51.066381 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e8f0ba58-923d-4ef4-9169-4f68ab7a1647 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1215 microversion: 2.1 time: 0.150939 Sep 03 20:48:51.068796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 26/46] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:50 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:51.071150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:48:51.083938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a9d0b0-ae3c-42de-936a-757f1ff680d2 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.088639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47a9d0b0-ae3c-42de-936a-757f1ff680d2 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a9d0b0-ae3c-42de-936a-757f1ff680d2 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:48:51.095041 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 03 20:48:51.096142 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '7'} Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:51.096825 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 03 20:48:51.097900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.100258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a9d0b0-ae3c-42de-936a-757f1ff680d2 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:51.101315 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47a9d0b0-ae3c-42de-936a-757f1ff680d2 tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.031184 Sep 03 20:48:51.107286 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 27/47] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:48:51 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:48:51.115721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3f8c4e3-3c18-4421-82e3-c086aa6879a3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.169551 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3f8c4e3-3c18-4421-82e3-c086aa6879a3 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.059260 Sep 03 20:48:51.173579 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 28/48] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:51 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:48:51.184047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3aa4ad6f-7801-4488-923c-2b2d8790a6a1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.202826 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3aa4ad6f-7801-4488-923c-2b2d8790a6a1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3aa4ad6f-7801-4488-923c-2b2d8790a6a1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:48:51.204745 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: exception: Aggregate -1 could not be found. Sep 03 20:48:51.205902 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '-1'} Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.206559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 03 20:48:51.207578 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.214471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3aa4ad6f-7801-4488-923c-2b2d8790a6a1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:51.214471 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3aa4ad6f-7801-4488-923c-2b2d8790a6a1 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026574 Sep 03 20:48:51.214471 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 29/49] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:48:51 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 20:48:51.222880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71904f6f-4e44-4608-b92e-4793cbda789b tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.224968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-71904f6f-4e44-4608-b92e-4793cbda789b tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71904f6f-4e44-4608-b92e-4793cbda789b tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:48:51.241974 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 03 20:48:51.243307 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:48:51.243941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:48:51.244865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71904f6f-4e44-4608-b92e-4793cbda789b tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:51.245730 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-71904f6f-4e44-4608-b92e-4793cbda789b tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.030845 Sep 03 20:48:51.245730 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 30/50] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:48:51 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:48:51.515710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:48:51.516132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:48:51.516811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:48:51.517398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:48:51.518191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:48:51.528120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:51.528615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:51.529132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:51.529862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:51.530315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:51.530883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:51.548385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Getting quotas for project 1dacf31e1f0b4a4f9b27fc1f49006170. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:48:51.552964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Getting quotas for user 403b2dcf1b3f4e1fbead88207efa9ea0 and project 1dacf31e1f0b4a4f9b27fc1f49006170. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:48:51.555466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:51.570624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:48:51.573244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:48:51.641722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-865d07ff-a919-4af3-ba01-e888e68a5d88 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110159 Sep 03 20:48:51.643255 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 21/51] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:48:51.654866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b60b712-f057-4f05-af1b-3861980efe34 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.656427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b60b712-f057-4f05-af1b-3861980efe34 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:51.792229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b60b712-f057-4f05-af1b-3861980efe34 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:51.815582 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b60b712-f057-4f05-af1b-3861980efe34 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1242 microversion: 2.1 time: 0.163083 Sep 03 20:48:51.817916 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 31/52] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:51 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:51.866290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:51.866923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:51.880680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:51.881225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:51.881677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:51.882399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:51.882864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:51.883300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:52.091166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:52.092351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:52.108007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:52.110981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:52.111480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:52.112226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:52.116250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:52.116734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:52.287479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:52.303828 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-533a7ab4-bf15-49b0-8988-53d03e241d39 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1279 microversion: 2.1 time: 0.215631 Sep 03 20:48:52.306417 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 32/53] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:52 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:48:52.420820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:52.444255 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-490f0f72-62b0-4dc7-8a7c-46905c0a25e0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1277 microversion: 2.1 time: 0.580280 Sep 03 20:48:52.446640 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 22/54] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:51 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1277 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:52.843767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:52.844991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:52.858004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:52.859271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:52.860426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:52.861556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:52.862222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:52.862845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:53.057537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:53.073426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b9d8de8b-37d9-486a-9f95-8245d0e0f06f tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1290 microversion: 2.1 time: 0.232365 Sep 03 20:48:53.074154 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 33/55] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:52 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:53.331371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:53.332015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:53.351095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:53.356654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:53.357408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:53.358577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:53.359187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:53.359770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:53.471122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:53.472134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:53.497680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:53.500082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:53.505698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:53.517306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:53.520774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:53.523636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:53.595895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:53.607434 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-434fa839-8ad3-4f60-ade5-b4b5178dc02e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1277 microversion: 2.1 time: 0.280955 Sep 03 20:48:53.608301 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 23/56] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:53 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:54.100813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:54.101644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:54.114430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:54.116751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:54.125210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:54.126200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:54.127110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:54.127763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:54.480231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:54.496252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3924d11-9043-45bf-bcf1-fa59145dab7f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 1.032370 Sep 03 20:48:54.501599 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 34/57] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:53 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:54.626130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:54.640207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:54.641440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:54.642975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-60b4feb7-f1f5-4e32-8e04-9e7587b35a85 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1296 microversion: 2.1 time: 0.546168 Sep 03 20:48:54.643582 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 24/58] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:54 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1296 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:54.666044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:54.666974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:54.667634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:54.669165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:54.670892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:54.672129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:55.206352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:55.220958 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-740d9fae-102e-4fee-b5d3-c601066fc5b4 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1277 microversion: 2.1 time: 0.587815 Sep 03 20:48:55.226704 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 35/59] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:54 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1277 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:48:55.525843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:55.526488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:55.555056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:55.555056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:55.555056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:55.555056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:55.558476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:55.559622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:55.788059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7d8250b-7831-4044-ac9c-35c2ad2fffec tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1395419853", "id": 1712621618, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:55.886942 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7d8250b-7831-4044-ac9c-35c2ad2fffec tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.834341 Sep 03 20:48:55.888137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 25/60] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:55 2022] POST /compute/v2.1/flavors => generated 430 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:55.894604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:55.896613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:55.906555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:55.907325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:55.908030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:55.909170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:55.909850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:55.911563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:56.198292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:56.208508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a53d7771-2abd-4c17-9a2f-17fd677e821b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.687052 Sep 03 20:48:56.209444 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 36/61] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:55 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:56.214356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0efcca5-8876-46c0-8a39-727faf63596b tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:56.259398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0efcca5-8876-46c0-8a39-727faf63596b tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1712621618" status: 202 len: 0 microversion: 2.1 time: 0.048114 Sep 03 20:48:56.263300 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 37/62] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:48:56 2022] DELETE /compute/v2.1/flavors/1712621618 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:56.292809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:56.302045 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-18fbffc6-9524-4e50-92ff-b6f76c65db3c tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1296 microversion: 2.1 time: 0.412557 Sep 03 20:48:56.308571 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 26/63] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:55 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1296 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:56.322055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:56.323036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:56.332279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:56.336248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:56.336706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:56.337498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:56.337962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:56.338397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:56.553748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57194a6e-54be-4f5d-b67c-136aef07318a tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-862378631", "id": 1864648400, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:56.611036 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57194a6e-54be-4f5d-b67c-136aef07318a tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.347347 Sep 03 20:48:56.639890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 38/64] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:48:56 2022] POST /compute/v2.1/flavors => generated 467 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:48:56.653035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6475debd-2c9d-412f-9d17-f0531a381b14 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:56.694106 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6475debd-2c9d-412f-9d17-f0531a381b14 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.052114 Sep 03 20:48:56.694707 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 39/65] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:56 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:56.869638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-987c4fc0-2c75-4ea7-bf39-564652ca1ec9 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:56.893161 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-987c4fc0-2c75-4ea7-bf39-564652ca1ec9 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] 10.222.0.16 "GET /compute/v2.1/flavors/1864648400" status: 200 len: 467 microversion: 2.61 time: 0.196408 Sep 03 20:48:56.905512 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 40/66] 10.222.0.16 () {60 vars in 1199 bytes} [Sat Sep 3 20:48:56 2022] GET /compute/v2.1/flavors/1864648400 => generated 467 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:48:56.912283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9332ab47-e3a0-40e9-8b95-32edf0a99d4c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1564087874", "id": 1975756186, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:56.957628 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9332ab47-e3a0-40e9-8b95-32edf0a99d4c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.049312 Sep 03 20:48:56.962162 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 41/67] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:56 2022] POST /compute/v2.1/flavors => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:56.968260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae0e6b53-7e33-4389-b9a8-35055345d92c tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:57.000613 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae0e6b53-7e33-4389-b9a8-35055345d92c tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1864648400" status: 200 len: 468 microversion: 2.61 time: 0.036944 Sep 03 20:48:57.001748 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 42/68] 10.222.0.16 () {62 vars in 1219 bytes} [Sat Sep 3 20:48:56 2022] PUT /compute/v2.1/flavors/1864648400 => generated 468 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:48:57.007100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ce68b81-6143-4269-acfe-4600fb17787e tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.030660 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ce68b81-6143-4269-acfe-4600fb17787e tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.027597 Sep 03 20:48:57.031514 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 43/69] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:57.037150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f625eda0-d592-4a21-acc9-5ebb21756e78 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.077991 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f625eda0-d592-4a21-acc9-5ebb21756e78 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.044857 Sep 03 20:48:57.078886 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 44/70] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:57.084134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d6c3aafa-a658-4316-bcd5-f0d3354a2689 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.098659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:57.107805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d6c3aafa-a658-4316-bcd5-f0d3354a2689 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1975756186" status: 202 len: 0 microversion: 2.1 time: 0.027110 Sep 03 20:48:57.108635 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 45/71] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:48:57 2022] DELETE /compute/v2.1/flavors/1975756186 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:57.113805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7378e64-922c-425d-a62b-7b639e5c4e89 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.129148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1f59c8fd-c8ce-46fc-abfc-8aba2b599d71 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.809340 Sep 03 20:48:57.133010 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 27/72] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:56 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:57.156164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b89edc5-516a-46ea-ad4e-2c0621f88d84 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.171711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7378e64-922c-425d-a62b-7b639e5c4e89 tempest-FlavorsV261TestJSON-657031575 tempest-FlavorsV261TestJSON-657031575-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.061720 Sep 03 20:48:57.172311 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 46/73] 10.222.0.16 () {60 vars in 1166 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:57.194150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9abc8fcb-e290-4be8-9408-a75051d164e5 tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.211433 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b89edc5-516a-46ea-ad4e-2c0621f88d84 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.077160 Sep 03 20:48:57.218757 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 28/74] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:57.241111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.242749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:57.246678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9abc8fcb-e290-4be8-9408-a75051d164e5 tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1864648400" status: 202 len: 0 microversion: 2.61 time: 0.061239 Sep 03 20:48:57.253015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 47/75] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Sep 3 20:48:57 2022] DELETE /compute/v2.1/flavors/1864648400 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:48:57.259748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:57.265445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:57.265445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:57.265445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:57.265957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c123cc3-5e59-4376-bd4c-71a38779787b tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-589711600", "id": 2132057648, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:57.266964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:57.270226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:57.301971 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c123cc3-5e59-4376-bd4c-71a38779787b tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.047442 Sep 03 20:48:57.313093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 48/76] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:57 2022] POST /compute/v2.1/flavors => generated 428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:57.319088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-688c63f7-fe78-4e73-b79b-28fc94bf60f2 tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.378786 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-688c63f7-fe78-4e73-b79b-28fc94bf60f2 tempest-FlavorsV261TestJSON-1733137207 tempest-FlavorsV261TestJSON-1733137207-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.064363 Sep 03 20:48:57.380970 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 49/77] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:48:57.387090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13052c77-714f-4321-a01c-0b1ef30484a4 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.438946 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13052c77-714f-4321-a01c-0b1ef30484a4 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2132057648" status: 202 len: 0 microversion: 2.1 time: 0.056464 Sep 03 20:48:57.439906 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 50/78] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:48:57 2022] DELETE /compute/v2.1/flavors/2132057648 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:57.446209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.448987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:57.460342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:57.464571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:57.467034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:57.472816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:57.473673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:57.474491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:57.651210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:57.672572 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bdbff648-67e3-4bfe-bda9-1e7ded8b6416 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.436362 Sep 03 20:48:57.674541 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 29/79] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:48:57.687790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06a22bb3-6c7f-4a02-9378-d097f60c5789 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.741616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06a22bb3-6c7f-4a02-9378-d097f60c5789 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065801 Sep 03 20:48:57.754284 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 30/80] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:57.767925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8592d914-08a7-4ce4-823c-74e9ba6bf3b2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1226687180", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:57.805804 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8592d914-08a7-4ce4-823c-74e9ba6bf3b2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.044578 Sep 03 20:48:57.814440 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 31/81] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:57 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:57.824768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-69e68b99-0063-4724-82fe-779868112c39 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.865983 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-69e68b99-0063-4724-82fe-779868112c39 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/f66c8591-1e17-4efc-ad0c-5f45755ec66c" status: 202 len: 0 microversion: 2.1 time: 0.049997 Sep 03 20:48:57.871577 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 32/82] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:48:57 2022] DELETE /compute/v2.1/flavors/f66c8591-1e17-4efc-ad0c-5f45755ec66c => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:57.877447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15e6b08c-81d9-403e-a073-c15360f22be5 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:57.924099 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15e6b08c-81d9-403e-a073-c15360f22be5 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051896 Sep 03 20:48:57.926069 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 33/83] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:48:57.949233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38e564ca-26dc-4278-8aea-597755efb119 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-551716997", "id": "34a2d93b-36fb-4339-9aa7-3e0f3fef2123", "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:57.985122 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38e564ca-26dc-4278-8aea-597755efb119 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040410 Sep 03 20:48:57.987491 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 34/84] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:57 2022] POST /compute/v2.1/flavors => generated 506 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:58.001355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e836a60d-afae-481e-9ca0-1fd7d94e685d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.043777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e836a60d-afae-481e-9ca0-1fd7d94e685d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/34a2d93b-36fb-4339-9aa7-3e0f3fef2123" status: 202 len: 0 microversion: 2.1 time: 0.048316 Sep 03 20:48:58.046627 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 35/85] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:48:57 2022] DELETE /compute/v2.1/flavors/34a2d93b-36fb-4339-9aa7-3e0f3fef2123 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:58.055899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-949c91c4-3374-466f-8b3f-951c66f37990 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.091223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:58.100931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-949c91c4-3374-466f-8b3f-951c66f37990 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050355 Sep 03 20:48:58.102403 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a39b2c5d-a149-4602-80c4-75ba2d963234 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.661233 Sep 03 20:48:58.112372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 51/86] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:57 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:58.113155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 36/87] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:58.145272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb842880-dedc-4082-8c79-56a033076e59 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1820025057", "id": 208398400, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:58.161072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.162139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:58.170434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:58.171345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:58.171948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:58.172926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:58.173536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:58.174111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:58.196713 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb842880-dedc-4082-8c79-56a033076e59 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056028 Sep 03 20:48:58.202895 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 52/88] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:58.225033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e9764b7-ac1c-4877-b9b8-34f122fb5904 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.252768 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e9764b7-ac1c-4877-b9b8-34f122fb5904 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/208398400" status: 200 len: 411 microversion: 2.1 time: 0.044817 Sep 03 20:48:58.255506 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 53/89] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/flavors/208398400 => generated 411 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:58.544604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-041dccaa-b35b-41a6-9afc-56a4f496dfff tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.572424 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-041dccaa-b35b-41a6-9afc-56a4f496dfff tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.307348 Sep 03 20:48:58.574671 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 54/90] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:58.598955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab80d5ab-56c2-48fd-bb1b-72f1966338bc tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.626307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5,nova_api:DELETE=16,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:58.634374 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab80d5ab-56c2-48fd-bb1b-72f1966338bc tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/208398400" status: 202 len: 0 microversion: 2.1 time: 0.039811 Sep 03 20:48:58.640717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 55/91] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:48:58 2022] DELETE /compute/v2.1/flavors/208398400 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:58.655116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8679b81b-1f68-46d5-ade0-e8d846df15d7 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.716346 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8679b81b-1f68-46d5-ade0-e8d846df15d7 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072270 Sep 03 20:48:58.735787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 56/92] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:58.740868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:58.749594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:58.767773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:58.768497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:58.769115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:58.771865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:58.772450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:58.775408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.208573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:59.226925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e07c706-266a-4afd-8a09-9af9f6778391 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 1.067024 Sep 03 20:48:59.231122 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 37/93] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:48:59.251194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9cfbb72-0e96-4280-9fe3-e99dcdab2bc7 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-310772832", "id": 1085455230, "os-flavor-access:is_public": "False"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:59.270937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:48:59.283342 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5702a36f-5ea9-4c2b-9435-2a9405a9710d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.546139 Sep 03 20:48:59.286807 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 57/94] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:58 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:59.305991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:59.307159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:48:59.320093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9cfbb72-0e96-4280-9fe3-e99dcdab2bc7 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.087590 Sep 03 20:48:59.321394 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 38/95] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:59 2022] POST /compute/v2.1/flavors => generated 429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:59.329398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:59.329398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:59.329398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.329398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:59.330040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:59.330040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.347587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1567a4ac-e11d-4205-abca-b7d2a352e883 tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "1085455230"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:59.373374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1567a4ac-e11d-4205-abca-b7d2a352e883 tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] HTTP exception thrown: Flavor 1085455230 could not be found. Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1567a4ac-e11d-4205-abca-b7d2a352e883 tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Request method failure captured: Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 107 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE720ZmFnKw3zL4RH-XD6SGYlLlcoUrQoqkZabomihXiQ1t69dVw-oTcEkPcl0DLS6jhdfumBvXLZ1-QA4mfH2siOwn-Ik4ZMn_gNnCoVoLGDcLJhE7dBEgL8b9E21R6-R2Eo2Mbg1_cRxPHfINouF0FVdrv7N8CTZar_LdD-bz7ZiH0 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e005609cdb7945ebbf75b805621a2592 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAdminTestJSON-2130859989 Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:48:59.398826 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e005609cdb7945ebbf75b805621a2592"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e005609cdb7945ebbf75b805621a2592"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e005609cdb7945ebbf75b805621a2592"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e005609cdb7945ebbf75b805621a2592"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAdminTestJSON-2130859989 Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e005609cdb7945ebbf75b805621a2592 Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2130859989 Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAdminTestJSON-2130859989-project Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 64b7035c42e04fef99215dbd84b841c3 Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAdminTestJSON-2130859989-project Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "test", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "1085455230"}} Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:48:59.400020 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor 1085455230 could not be found. Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '1085455230'}}} Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1085455230 could not be found. Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:59.401371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1085455230 could not be found. Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:48:59.402874 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:48:59.404043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:48:59.404043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:48:59.404043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:48:59.404043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1085455230 could not be found. Sep 03 20:48:59.404043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:48:59.416482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1567a4ac-e11d-4205-abca-b7d2a352e883 tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Returning 400 to user: Flavor 1085455230 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:48:59.418837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1567a4ac-e11d-4205-abca-b7d2a352e883 tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.086604 Sep 03 20:48:59.424343 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 39/96] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:59 2022] POST /compute/v2.1/servers => generated 81 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:48:59.430051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10eb0d62-2341-45bf-9e17-ee525eb6a6f2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:59.475148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-10eb0d62-2341-45bf-9e17-ee525eb6a6f2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1085455230" status: 202 len: 0 microversion: 2.1 time: 0.044787 Sep 03 20:48:59.490133 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 40/97] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:48:59 2022] DELETE /compute/v2.1/flavors/1085455230 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:48:59.505283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad7314d8-ceb1-4bc9-b4b6-2c4e7d9698c3 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:59.569406 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad7314d8-ceb1-4bc9-b4b6-2c4e7d9698c3 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070807 Sep 03 20:48:59.570575 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 41/98] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:48:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:48:59.598375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79e38fd5-d42d-4723-89fe-59abc3336249 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-172817133", "id": 1264522197, "os-flavor-access:is_public": "False"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:59.643131 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79e38fd5-d42d-4723-89fe-59abc3336249 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.054425 Sep 03 20:48:59.645034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 42/99] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:59 2022] POST /compute/v2.1/flavors => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:48:59.656816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b04cfa61-a6ee-41cc-af7c-7f30add2600d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1159202840", "id": 750023858, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:59.697963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b04cfa61-a6ee-41cc-af7c-7f30add2600d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.045404 Sep 03 20:48:59.700810 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 43/100] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:48:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:59.713051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66c291b7-8e5f-41a3-9e77-4c652bc1184c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:48:59.756749 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66c291b7-8e5f-41a3-9e77-4c652bc1184c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.047869 Sep 03 20:48:59.758484 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 44/101] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Sep 3 20:48:59 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:48:59.873970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f9b4bc-e12f-4f12-841a-336d1dcda4fa", "tag": "0827f4fd-c782-4c0a-b491-023e9a459266"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:48:59.910273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:59.910877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:59.911343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.955069 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Creating event network-changed:0827f4fd-c782-4c0a-b491-023e9a459266 for instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa on nch1-master-1 Sep 03 20:48:59.955674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:48:59.956052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0b2c689b-09ef-4272-9df1-1c4e8c1aea91 req-faf76099-3d81-4b82-bc35-b3a206cdf08f service nova] Acquired lock "compute-rpcapi-router" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:48:59.957748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:59.958572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:59.959202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.960452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:48:59.962209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:48:59.962899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:48:59.993072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.compute.rpcapi [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 20:48:59.993999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] Releasing lock "compute-rpcapi-router" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:49:00.013346 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-43d98380-853b-4544-a947-0c7e1190bed1 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253185 Sep 03 20:49:00.013983 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 45/102] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:00.017159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:00.021584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-109ed613-ba05-4ca4-9939-e164d96acaf8 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.048793 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-109ed613-ba05-4ca4-9939-e164d96acaf8 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.033411 Sep 03 20:49:00.052954 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 46/103] 10.222.0.16 () {58 vars in 1177 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:00.078542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:00.093341 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a5d090d-fc51-4fad-9174-30d3b985f5cf tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.802840 Sep 03 20:49:00.104959 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 58/104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:48:59 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:00.112027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d8fefe0-0260-4e0b-8931-c6adee56e890 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.167097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74be2b2e-c86c-4cbe-b6c1-756c58c7698e", "tag": "24caafa8-d397-458f-87e1-4d7863d49497"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:00.189612 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d8fefe0-0260-4e0b-8931-c6adee56e890 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.079144 Sep 03 20:49:00.190567 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 59/105] 10.222.0.16 () {58 vars in 1171 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:00.205201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a726c3bb-93d1-41c1-810c-c5f82d552f97 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.206927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:00.207419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:00.207854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:00.242433 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a726c3bb-93d1-41c1-810c-c5f82d552f97 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.042280 Sep 03 20:49:00.245028 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 60/106] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:00.254652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] Creating event network-changed:24caafa8-d397-458f-87e1-4d7863d49497 for instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e on nch1-master-1 Sep 03 20:49:00.270898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.271698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:00.275053 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-271c3451-b6aa-4b86-b384-0d1605eefd0f req-4521be7e-299e-49a5-9a3b-63d95f9479b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223991 Sep 03 20:49:00.275678 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 47/107] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:00.315448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-227cff40-1fca-4391-a5bd-db6ec2172c65 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.323273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:00.324698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:00.325351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:00.326663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:00.327154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:00.327562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:00.398919 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-227cff40-1fca-4391-a5bd-db6ec2172c65 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.115289 Sep 03 20:49:00.412225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 48/108] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:00.422563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:00.429878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:00.446986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:00.448637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:00.449387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:00.451636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:00.452310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:00.452919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:01.123675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:01.132501 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c906938c-9696-4494-ae96-ed6cd1156887 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.719113 Sep 03 20:49:01.140512 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 49/109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.150437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91e87225-4469-4b56-a301-4cd85a74633d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.221524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91e87225-4469-4b56-a301-4cd85a74633d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.072165 Sep 03 20:49:01.224769 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 50/110] 10.222.0.16 () {58 vars in 1175 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.232757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.246157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:01.273941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:01.274644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:01.292299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:01.304246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:01.304246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:01.312403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:01.507743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:01.516544 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9b045182-9aaf-463f-9d75-dafa2a486292 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 1.258679 Sep 03 20:49:01.517184 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 61/111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:00 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.536931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d4f932c-43ac-4a6e-802d-cabc4a1f7527 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.561966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=18 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:01.600688 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d4f932c-43ac-4a6e-802d-cabc4a1f7527 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.075608 Sep 03 20:49:01.629199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 62/112] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.636514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-450d8b39-6991-4a55-8527-4bf40dafcefe tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.687459 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-450d8b39-6991-4a55-8527-4bf40dafcefe tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.054151 Sep 03 20:49:01.703472 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 63/113] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.711693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb83eabd-bd5e-47a0-8d29-6b3546ec7807 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.753427 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb83eabd-bd5e-47a0-8d29-6b3546ec7807 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/750023858" status: 202 len: 0 microversion: 2.1 time: 0.048409 Sep 03 20:49:01.759213 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 64/114] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:49:01 2022] DELETE /compute/v2.1/flavors/750023858 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:01.769517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70d6b1e2-c679-4de3-832d-122f9d13d15a tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.800993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:01.817717 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-70d6b1e2-c679-4de3-832d-122f9d13d15a tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057044 Sep 03 20:49:01.840972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 65/115] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.847081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21ea2760-6a69-42e4-83b2-91dfeabea74c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.899767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21ea2760-6a69-42e4-83b2-91dfeabea74c tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1264522197" status: 202 len: 0 microversion: 2.1 time: 0.056731 Sep 03 20:49:01.900514 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 66/116] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:01 2022] DELETE /compute/v2.1/flavors/1264522197 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:01.908360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de6b1514-2a65-4b06-a1c1-e72e07dc409d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:01.967885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:01.974579 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de6b1514-2a65-4b06-a1c1-e72e07dc409d tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069575 Sep 03 20:49:01.982632 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8f06a5b-f64a-434d-b7e2-787db74a9e9a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.755535 Sep 03 20:49:01.994473 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 67/118] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:01.994653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 51/118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:01 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.018835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f1b382f-0872-40e5-b483-5c44ef97794e tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1430178949", "id": 827356164, "os-flavor-access:is_public": "False"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:02.063326 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f1b382f-0872-40e5-b483-5c44ef97794e tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.067263 Sep 03 20:49:02.064492 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 52/119] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:02.078005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e85ad46-c38d-44c7-9c05-dd89764b9bba tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.125436 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e85ad46-c38d-44c7-9c05-dd89764b9bba tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051723 Sep 03 20:49:02.144439 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 68/120] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.145737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d98c3349-5c5d-4834-9320-95c0072ef4da tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.164667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:02.173084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.173710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:02.187820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:02.188351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:02.188864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:02.203982 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d98c3349-5c5d-4834-9320-95c0072ef4da tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059838 Sep 03 20:49:02.205380 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 53/121] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.223904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29843815-d71a-426e-9c7a-1d6ed432ae93 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.229429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:02.229947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:02.230462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:02.274412 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29843815-d71a-426e-9c7a-1d6ed432ae93 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/827356164" status: 202 len: 0 microversion: 2.1 time: 0.054334 Sep 03 20:49:02.276316 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 54/122] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:49:02 2022] DELETE /compute/v2.1/flavors/827356164 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:02.303337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1184fc2d-ce78-46ef-9291-108ea5903375 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.355626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1184fc2d-ce78-46ef-9291-108ea5903375 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072788 Sep 03 20:49:02.375321 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 55/123] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.391208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-519f7431-6141-4ffc-9ca4-f58121ad70c2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2118649730", "id": 1112451466, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:02.430944 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-519f7431-6141-4ffc-9ca4-f58121ad70c2 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048158 Sep 03 20:49:02.441192 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 56/124] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:02.460934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2c3d6ef-a2a6-4cd8-8e8c-4382c428243f tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.508095 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2c3d6ef-a2a6-4cd8-8e8c-4382c428243f tempest-FlavorsAdminTestJSON-2130859989 tempest-FlavorsAdminTestJSON-2130859989-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.056313 Sep 03 20:49:02.525547 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 57/125] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.531084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95104186-fdda-404d-b5d1-b586e5047871 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.583102 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95104186-fdda-404d-b5d1-b586e5047871 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1112451466" status: 202 len: 0 microversion: 2.1 time: 0.054894 Sep 03 20:49:02.586163 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 58/126] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:02 2022] DELETE /compute/v2.1/flavors/1112451466 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:02.598368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.599289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:02.628698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:02.634164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:02.637625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:02.639289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:02.641559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:02.642573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:02.912201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:02.927160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91ae8ffa-422f-4eba-b08b-7e7d8baaac0e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.339706 Sep 03 20:49:02.928306 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 59/127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:02.933215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f708f704-a45d-4176-81b3-60f637a2a2e3 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:02.987551 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f708f704-a45d-4176-81b3-60f637a2a2e3 tempest-FlavorsAdminTestJSON-1526664669 tempest-FlavorsAdminTestJSON-1526664669-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057775 Sep 03 20:49:02.988242 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 60/128] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:03.016122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:03.016745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:03.025927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.026433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.026920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.041833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.049812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.050383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.115934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:03.151153 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e9fbe5d-90c2-45fa-b1db-fb4644f37431 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.985242 Sep 03 20:49:03.175123 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 69/129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:02 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:03.288688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef536920-06ca-48da-a1ef-7bc6bce736ad", "tag": "7c339d38-694c-43ef-a124-9f03a2f9a913"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:03.325632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.337179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.338187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.393092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:03.464147 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Creating event network-changed:7c339d38-694c-43ef-a124-9f03a2f9a913 for instance ef536920-06ca-48da-a1ef-7bc6bce736ad on nch2-master-1 Sep 03 20:49:03.464828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:49:03.465560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2553fe6c-f351-4601-ae53-cc189f9cbd84 req-855c72ff-f75e-4960-ba17-a73e4ba465e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:49:03.467467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.467941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.468390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.480487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.485202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.485699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.531880 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.rpcapi [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 20:49:03.532830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] Releasing lock "compute-rpcapi-router" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:49:03.602806 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29f58e12-3462-498a-9b60-3a33a94f9e00 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317669 Sep 03 20:49:03.604774 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 70/130] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:03.957896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:03.959128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:03.977346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.983773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.985840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:03.989616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:03.990270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:03.992418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:04.083188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:04.094020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d693b070-9353-4730-b54f-1d53e2154785 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 1.081931 Sep 03 20:49:04.095270 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 61/131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:03 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:04.176411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:04.177210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:04.200261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:04.201944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:04.203353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:04.207040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:04.208417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:04.210016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:04.294951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:04.656953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:04.691429 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b927a12f-fc23-4de3-84a2-492e09d9f31b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.519587 Sep 03 20:49:04.709909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:04.711547 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 62/132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:04 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:04.720326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5ebb3e3-ff47-4407-879b-472f3d5ebcab tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.766180 Sep 03 20:49:04.731115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 71/133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:03 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:05.127317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:05.137251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:05.148701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:05.156474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:05.157246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:05.159497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:05.160369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:05.161225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:05.729427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:05.730054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:05.745984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:05.751107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:05.753658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:05.758178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:05.762985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:05.765259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:06.233967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:06.251190 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8230f547-5243-42b2-b9e9-c67a18e24914 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.522490 Sep 03 20:49:06.255375 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 72/134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:05 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:06.266782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:06.274150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:06.289783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:06.290935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:06.292931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:06.293848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:06.295952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:06.297042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:06.402107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:06.414775 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06e6e206-c148-43c2-a966-ad8b01555954 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 1.300126 Sep 03 20:49:06.416383 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 63/135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:05 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:07.083500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-236f5ab9-eee6-4956-b33b-035128ce2664 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Calling method '.version_select at 0x7fae6799d160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.083741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.086572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-236f5ab9-eee6-4956-b33b-035128ce2664 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e5380ce0bd6d4157997494de588c5156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb94fbc17264a278102253f0f61a150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-236f5ab9-eee6-4956-b33b-035128ce2664 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Request method failure captured: Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73AYgGXAmbGyMDrjz8MOXJ4US3QDnTW9UsZINmDLbiy5Wb-gdRlXrJALqj4plaQ7xC2sX3DS4WVwd7sVy8MpPugC9vMX0XezqBvVoA9QLrLXaSkpmShPLO-iPtU7FSZxmJZA_kh4B8BaPR1pBbimAtfzg8McvJxHdCaTx75GKzyK34 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:07.088965 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cb94fbc17264a278102253f0f61a150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e5380ce0bd6d4157997494de588c5156 Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:49:07.090117 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:07.091101 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 03 20:49:07.092626 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.095986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-236f5ab9-eee6-4956-b33b-035128ce2664 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:07.096709 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a605916-7342-4a39-be19-fb22af25f71a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.840041 Sep 03 20:49:07.097995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 73/136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:06 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:07.109437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-236f5ab9-eee6-4956-b33b-035128ce2664 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.437219 Sep 03 20:49:07.121624 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 64/137] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 3 20:49:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:07.128276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54afcdd7-fe00-4304-90d7-c1a2f6948720 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Calling method '.version_select at 0x7fae67bab430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.130468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54afcdd7-fe00-4304-90d7-c1a2f6948720 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e5380ce0bd6d4157997494de588c5156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb94fbc17264a278102253f0f61a150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54afcdd7-fe00-4304-90d7-c1a2f6948720 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Request method failure captured: Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73AYgGXAmbGyMDrjz8MOXJ4US3QDnTW9UsZINmDLbiy5Wb-gdRlXrJALqj4plaQ7xC2sX3DS4WVwd7sVy8MpPugC9vMX0XezqBvVoA9QLrLXaSkpmShPLO-iPtU7FSZxmJZA_kh4B8BaPR1pBbimAtfzg8McvJxHdCaTx75GKzyK34 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:07.135914 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cb94fbc17264a278102253f0f61a150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e5380ce0bd6d4157997494de588c5156 Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 20:49:07.137180 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:07.137838 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 03 20:49:07.138836 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.141330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54afcdd7-fe00-4304-90d7-c1a2f6948720 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:07.142217 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54afcdd7-fe00-4304-90d7-c1a2f6948720 tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019653 Sep 03 20:49:07.142787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 74/138] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:49:07.152331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-359a6234-27a2-4875-a7e8-9c92e32c9ced tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Calling method '.version_select at 0x7fae67a0d310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.155536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-359a6234-27a2-4875-a7e8-9c92e32c9ced tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e5380ce0bd6d4157997494de588c5156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb94fbc17264a278102253f0f61a150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-359a6234-27a2-4875-a7e8-9c92e32c9ced tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Request method failure captured: Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73AYgGXAmbGyMDrjz8MOXJ4US3QDnTW9UsZINmDLbiy5Wb-gdRlXrJALqj4plaQ7xC2sX3DS4WVwd7sVy8MpPugC9vMX0XezqBvVoA9QLrLXaSkpmShPLO-iPtU7FSZxmJZA_kh4B8BaPR1pBbimAtfzg8McvJxHdCaTx75GKzyK34 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:07.158379 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cb94fbc17264a278102253f0f61a150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e5380ce0bd6d4157997494de588c5156 Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:49:07.159597 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:07.160486 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 03 20:49:07.162475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.166495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-359a6234-27a2-4875-a7e8-9c92e32c9ced tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:07.169240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-359a6234-27a2-4875-a7e8-9c92e32c9ced tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021119 Sep 03 20:49:07.177080 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 65/139] 10.222.0.16 () {58 vars in 1179 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:07.280743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.281867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:07.298834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.300663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.303397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.305705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.307827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.308497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.511625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Calling method '.version_select at 0x7fae67ab74c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.514116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.514625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.515064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.560267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.567258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.568022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.597137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.597731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.598200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.619222 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d02e9119-e536-4695-acdc-e6c55801ac69 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.442081 Sep 03 20:49:07.633545 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 75/140] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:07.639719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.640344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:07.658546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.659315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.659924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.666171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.666908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.669248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.800842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.828284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f311307b-cc8e-48d9-b3ad-3e4cada1dd54 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.553838 Sep 03 20:49:07.831514 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 66/141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:07.836998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-611fae75-7ea9-4cb5-9aeb-b3e43f8f343a tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Calling method '.version_select at 0x7fae6799d700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.839573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-611fae75-7ea9-4cb5-9aeb-b3e43f8f343a tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e5380ce0bd6d4157997494de588c5156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb94fbc17264a278102253f0f61a150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-611fae75-7ea9-4cb5-9aeb-b3e43f8f343a tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Request method failure captured: Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73AYgGXAmbGyMDrjz8MOXJ4US3QDnTW9UsZINmDLbiy5Wb-gdRlXrJALqj4plaQ7xC2sX3DS4WVwd7sVy8MpPugC9vMX0XezqBvVoA9QLrLXaSkpmShPLO-iPtU7FSZxmJZA_kh4B8BaPR1pBbimAtfzg8McvJxHdCaTx75GKzyK34 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:07.843165 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cb94fbc17264a278102253f0f61a150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e5380ce0bd6d4157997494de588c5156 Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1'} Sep 03 20:49:07.844590 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:07.845430 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 03 20:49:07.846661 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.853409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-611fae75-7ea9-4cb5-9aeb-b3e43f8f343a tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:07.856223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-611fae75-7ea9-4cb5-9aeb-b3e43f8f343a tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021707 Sep 03 20:49:07.859587 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 67/142] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:07.869221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b344c8db-6f14-4b9f-ad56-a19b067e2032 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Calling method '.version_select at 0x7fae67a0df70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.875000 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b344c8db-6f14-4b9f-ad56-a19b067e2032 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] HTTP exception thrown: Hypervisor with ID '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' could not be found. Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b344c8db-6f14-4b9f-ad56-a19b067e2032 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Request method failure captured: Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122/uptime HTTP/1.1 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73C6oBnjhJXT94ZOv-_e6avzizvsXi9zjRL9Vvefz2N6n5CFFyWv-9AcpmzgSqMLx6MjgxENVoA4V4mNDaLVqvWlc7AQ8b0cvN73aR_WfKB5UrwtK9g_0chTq_cTF2fvuHq_e13yhEE0-XrQZbgt8FKzgtBWo98GaZk3gwBi5yW71U Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 739e0a081fd141eda9ac0290ac96d585 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:07.894140 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 739e0a081fd141eda9ac0290ac96d585 Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 81ddde2d139447c584f28323f40f1fc5 Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: exception: Hypervisor with ID '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' could not be found. Sep 03 20:49:07.896027 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122'} Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 03 20:49:07.897196 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' could not be found. Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:07.898775 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' could not be found. Sep 03 20:49:07.902603 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:07.904756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b344c8db-6f14-4b9f-ad56-a19b067e2032 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Returning 404 to user: Hypervisor with ID '9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122' could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:07.906298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b344c8db-6f14-4b9f-ad56-a19b067e2032 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043442 Sep 03 20:49:07.911549 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 68/143] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors/9f5ca61f-1cb3-4fb0-ac96-46f3ab0ed122/uptime => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:49:07.929003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Calling method '.version_select at 0x7fae67a6d550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:07.931611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.932427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.933141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.966278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:07.967665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:07.968250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:07.999273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:08.000218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:08.000980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:08.010266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49692a61-8cae-44e4-abd4-285973a94c58 tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096125 Sep 03 20:49:08.011533 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 69/144] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:08.029913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81dd1389-ed07-4714-bd51-0d7cb38b012b tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Calling method '.version_select at 0x7fae6799ddc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:08.041941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81dd1389-ed07-4714-bd51-0d7cb38b012b tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e5380ce0bd6d4157997494de588c5156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb94fbc17264a278102253f0f61a150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81dd1389-ed07-4714-bd51-0d7cb38b012b tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Request method failure captured: Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73AYgGXAmbGyMDrjz8MOXJ4US3QDnTW9UsZINmDLbiy5Wb-gdRlXrJALqj4plaQ7xC2sX3DS4WVwd7sVy8MpPugC9vMX0XezqBvVoA9QLrLXaSkpmShPLO-iPtU7FSZxmJZA_kh4B8BaPR1pBbimAtfzg8McvJxHdCaTx75GKzyK34 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:08.049460 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cb94fbc17264a278102253f0f61a150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cb94fbc17264a278102253f0f61a150"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0cb94fbc17264a278102253f0f61a150 Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518 Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e5380ce0bd6d4157997494de588c5156 Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1738519518-project Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1'} Sep 03 20:49:08.050609 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:08.051264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 03 20:49:08.052964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.060834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81dd1389-ed07-4714-bd51-0d7cb38b012b tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:08.062111 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81dd1389-ed07-4714-bd51-0d7cb38b012b tempest-HypervisorAdminNegativeTestJSON-1738519518 tempest-HypervisorAdminNegativeTestJSON-1738519518-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.040947 Sep 03 20:49:08.063276 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 70/145] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:08.073889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-652fa63a-e1af-4588-8d99-4588d0099aad tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Calling method '.version_select at 0x7fae678b8af0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:08.076740 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-652fa63a-e1af-4588-8d99-4588d0099aad tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] HTTP exception thrown: Hypervisor with ID '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' could not be found. Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-652fa63a-e1af-4588-8d99-4588d0099aad tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Request method failure captured: Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/42f7dcb8-b5c0-44a3-b37f-09bb8e12024f HTTP/1.1 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73C6oBnjhJXT94ZOv-_e6avzizvsXi9zjRL9Vvefz2N6n5CFFyWv-9AcpmzgSqMLx6MjgxENVoA4V4mNDaLVqvWlc7AQ8b0cvN73aR_WfKB5UrwtK9g_0chTq_cTF2fvuHq_e13yhEE0-XrQZbgt8FKzgtBWo98GaZk3gwBi5yW71U Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 739e0a081fd141eda9ac0290ac96d585 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:08.079016 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/739e0a081fd141eda9ac0290ac96d585"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 739e0a081fd141eda9ac0290ac96d585 Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315 Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 81ddde2d139447c584f28323f40f1fc5 Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: exception: Hypervisor with ID '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' could not be found. Sep 03 20:49:08.081954 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f'} Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 03 20:49:08.082556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:49:08.083594 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' could not be found. Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' could not be found. Sep 03 20:49:08.085407 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:08.087661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-652fa63a-e1af-4588-8d99-4588d0099aad tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] Returning 404 to user: Hypervisor with ID '42f7dcb8-b5c0-44a3-b37f-09bb8e12024f' could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:08.088824 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-652fa63a-e1af-4588-8d99-4588d0099aad tempest-HypervisorAdminNegativeTestJSON-1002368315 tempest-HypervisorAdminNegativeTestJSON-1002368315-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/42f7dcb8-b5c0-44a3-b37f-09bb8e12024f" status: 404 len: 123 microversion: 2.1 time: 0.018933 Sep 03 20:49:08.089948 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 3 20:49:08 2022] GET /compute/v2.1/os-hypervisors/42f7dcb8-b5c0-44a3-b37f-09bb8e12024f => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:08.127248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:08.128641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:08.135325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:08.136149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:08.136804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:08.142145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:08.143084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:08.148688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:08.347423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:08.367948 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60180725-f1b6-424f-b1aa-45800ff1d2ee tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.732678 Sep 03 20:49:08.382848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 76/147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:07 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:08.422058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:08.439459 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-776d78d4-6406-44b1-85c2-65a2757d941a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.320467 Sep 03 20:49:08.440380 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 72/148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:08 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:08.861980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:08.862460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:08.878489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:08.882794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:08.885692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:08.887931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:08.889782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:08.891958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:09.397275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:09.398569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:09.408979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:09.414464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:09.415230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:09.416192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:09.418729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:09.421790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:09.588814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:09.600426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-640c7b58-71d5-4ef9-ac2c-590de20e86c2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.745986 Sep 03 20:49:09.604093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 77/149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:08 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:09.615373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:09.617542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:09.631400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:09.635991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:09.636585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:09.639700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:09.640280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:09.645332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:09.821660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:09.837164 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-edd4dce1-d446-4e28-bc6f-92ef41657e96 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.437849 Sep 03 20:49:09.858039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 73/150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:09 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:10.059918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:10.069477 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1707528f-99e5-4529-b225-caac8522ca6f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.463931 Sep 03 20:49:10.073136 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 78/151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:09 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:10.631777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:10.633141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:10.635722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:10.640413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:10.641011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:10.641382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:10.642266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:10.642722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:10.643144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:10.855383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:10.865257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:10.865880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:10.867705 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d8a1824-d1cd-4257-832c-69293285d21c tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.240211 Sep 03 20:49:10.874555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:10.875305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:10.875902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:10.877963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:10.879700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:10.881551 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 74/152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:10 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:10.882293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:11.098857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:11.099801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:11.116571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:11.118816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:11.119487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:11.121677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:11.122931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:11.125459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:11.260964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:11.295494 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0676b510-43f1-45f2-9252-d36d4f7a0825 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.433913 Sep 03 20:49:11.297350 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 79/153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:10 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:11.570358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:11.579794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36558b05-6ea2-495b-a4c2-8c50a9f14ab7 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.485721 Sep 03 20:49:11.580381 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 75/154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:11 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:11.891892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:11.892646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:11.903314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:11.904394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:11.906951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:11.908467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:11.910210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:11.912017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:12.125650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:12.142814 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-619ec400-e1f6-4132-a517-3f4ef08651b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.255363 Sep 03 20:49:12.143408 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 80/155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:11 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:12.320984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:12.322089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:12.333758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:12.335929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:12.339369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:12.342654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:12.344305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:12.345498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:12.591968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:12.612433 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91f5a004-cdca-43f0-8cec-4599614994f2 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.295894 Sep 03 20:49:12.625023 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 76/156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:12 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:12.645871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:12.646655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:12.648538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76fdf832-4167-45fb-af9d-776aa941fadd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-594417316", "id": 1899852303, "os-flavor-access:is_public": "False"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:12.654708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:12.655425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:12.656033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:12.657070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:12.657665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:12.658253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:12.696700 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76fdf832-4167-45fb-af9d-776aa941fadd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.292895 Sep 03 20:49:12.700862 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 81/157] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:12.714310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d05df015-067d-4ed8-9cf0-38eb38b74d12 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:12.888364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:12.901157 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75b4b83b-71ba-4b05-8cec-8166fa18b899 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.258844 Sep 03 20:49:12.902693 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:12 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:13.004436 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d05df015-067d-4ed8-9cf0-38eb38b74d12 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1899852303/action" status: 200 len: 97 microversion: 2.1 time: 0.294158 Sep 03 20:49:13.006397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 82/159] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:12 2022] POST /compute/v2.1/flavors/1899852303/action => generated 97 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:49:13.017382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-656bcec0-082a-4ad4-be01-058515b78874 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:13.166618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:13.167736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:13.182581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.184011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.184456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.186334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.186881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.188645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.428888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-656bcec0-082a-4ad4-be01-058515b78874 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] HTTP exception thrown: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-656bcec0-082a-4ad4-be01-058515b78874 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Request method failure captured: Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/flavors/1899852303/action HTTP/1.1 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 67 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73HrEho2fUGyu_YM1C_jAr6X4go-LKsv33EYzEJSqrVzCUnm3oN8cLgFvTWSMILEPOJwKidyqLDSFkv0wfGesvDaj-5r3xihHYrXDIdb__4c3EMTHU3Oj7nbtoESEm3ujnVaeycqpWXtqTY0tkVauS2vIMuT8xOxTX4rdlPiwucGIM Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:13.434979 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 5993923715d94398a246e19ecbf59106 Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} Sep 03 20:49:13.436185 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1899852303', 'body': {'addTenantAccess': {'tenant': '2a28735e9d204354a30066460fd3d271'}}} Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:49:13.436823 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '28-2a28735e9d204354a30066460fd3d271' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi session.flush() Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 20:49:13.437786 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 20:49:13.438738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:49:13.439651 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '28-2a28735e9d204354a30066460fd3d271' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 3, 20, 49, 13, 421988), 'updated_at': None, 'flavor_id': 28, 'project_id': '2a28735e9d204354a30066460fd3d271'}] Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:13.440538 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:13.441417 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:13.444960 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:13.447463 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. Sep 03 20:49:13.447463 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.447463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-656bcec0-082a-4ad4-be01-058515b78874 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Returning 409 to user: Flavor access already exists for flavor 28 and project 2a28735e9d204354a30066460fd3d271 combination. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:13.447463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-656bcec0-082a-4ad4-be01-058515b78874 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1899852303/action" status: 409 len: 152 microversion: 2.1 time: 0.424521 Sep 03 20:49:13.447463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 78/160] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:13 2022] POST /compute/v2.1/flavors/1899852303/action => generated 152 bytes in 426 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:13.451593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a390d186-056d-49b8-a41b-be50a471d787 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:13.522695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:13.529631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:13.542159 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5bdfb8bb-2950-4ef3-ba5c-c32bd04e5fc5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.377405 Sep 03 20:49:13.543010 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 83/161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:13 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:13.649009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:13.650268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:13.659700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.661110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.663503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.664388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.666472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.667119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.721129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a390d186-056d-49b8-a41b-be50a471d787 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1899852303/action" status: 200 len: 21 microversion: 2.1 time: 0.277823 Sep 03 20:49:13.722313 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 79/162] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:13 2022] POST /compute/v2.1/flavors/1899852303/action => generated 21 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:13.900192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60197dbf-70ed-4534-888c-bc8013836f94 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:13.901730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-60197dbf-70ed-4534-888c-bc8013836f94 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 03 20:49:13.904622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:13.918561 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62b7edb3-af3b-467d-b33e-3362581374c3 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.273454 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60197dbf-70ed-4534-888c-bc8013836f94 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin] Request method failure captured: Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73JjJ7cS5Xomtzr2G8E-WYk-OidrABOrIcLCm9IUb5GdpkKYtVi42vVfn3H1C40uWV4YEr75HzCv4gnTPPCB7gva4FFIDGWbOK2hX1UAV-KEn57zEALyaaKUhwxAu9HQlTtWHZpgBNWZ1pwYhHV-NMLTvJpzetkN20rHO8_CGdt12g Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 2989465b737c4318aaab7f0effc2162d Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:13.919214 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2989465b737c4318aaab7f0effc2162d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2989465b737c4318aaab7f0effc2162d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2989465b737c4318aaab7f0effc2162d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2989465b737c4318aaab7f0effc2162d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 2989465b737c4318aaab7f0effc2162d Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 42220281055e46809b88a7511275f0a2 Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:13.920405 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid timestamp for date invalid_time Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'invalid_time'} Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:13.921128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60197dbf-70ed-4534-888c-bc8013836f94 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:13.922165 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-60197dbf-70ed-4534-888c-bc8013836f94 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017 tempest-InstanceUsageAuditLogNegativeTestJSON-1302218017-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.196653 Sep 03 20:49:13.924957 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 84/163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:13 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:13.927371 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 80/164] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 3 20:49:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:49:13.931457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2ecd069-08e9-4a7d-82d7-8fb2397c16f6 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:13.933731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:13.935921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:13.945688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.946194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.946638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.947881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:13.948347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:13.948790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:13.956325 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2ecd069-08e9-4a7d-82d7-8fb2397c16f6 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1899852303" status: 202 len: 0 microversion: 2.1 time: 0.029792 Sep 03 20:49:13.958003 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 85/165] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:13 2022] DELETE /compute/v2.1/flavors/1899852303 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:14.111527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22519349-5476-47ff-8dad-807aa31bae8b tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.113502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22519349-5476-47ff-8dad-807aa31bae8b tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ef9328825c7c4f26baeb1e0e05f9451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1a033dec094ceb9050178fd2a086ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22519349-5476-47ff-8dad-807aa31bae8b tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Request method failure captured: Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73I-EPr47wVX7x5U7tvt9-yHnfNxCy90_VVWx0QYn5nt40mcZ5eWI0b5jj-HY4-_OOr1H0YxKybBpOSQjqqeVHIC1EAZSlTlTOuI8FOWENTm0Teq6klcwZlJMaCv2bjhrKBvW_2A5z8LaVS7VeivloXH8qYkjr19vYoodGp6Smi16Q Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 3f1a033dec094ceb9050178fd2a086ba Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:14.115443 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 3f1a033dec094ceb9050178fd2a086ba Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ef9328825c7c4f26baeb1e0e05f9451d Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project Sep 03 20:49:14.116874 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:14.117563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 03 20:49:14.118886 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.119961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22519349-5476-47ff-8dad-807aa31bae8b tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:14.119961 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22519349-5476-47ff-8dad-807aa31bae8b tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.157707 Sep 03 20:49:14.119961 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 86/166] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:49:13 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:14.122280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4bf0a7de-f554-461f-a602-b3ea4c85e721 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.157134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4bf0a7de-f554-461f-a602-b3ea4c85e721 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038358 Sep 03 20:49:14.158465 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:14.166965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f0d5c98-8ad3-45fc-a5e5-ce5a54f12554 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.169139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1f0d5c98-8ad3-45fc-a5e5-ce5a54f12554 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ef9328825c7c4f26baeb1e0e05f9451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1a033dec094ceb9050178fd2a086ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f0d5c98-8ad3-45fc-a5e5-ce5a54f12554 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Request method failure captured: Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-03%2020:49:14 HTTP/1.1 Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73I-EPr47wVX7x5U7tvt9-yHnfNxCy90_VVWx0QYn5nt40mcZ5eWI0b5jj-HY4-_OOr1H0YxKybBpOSQjqqeVHIC1EAZSlTlTOuI8FOWENTm0Teq6klcwZlJMaCv2bjhrKBvW_2A5z8LaVS7VeivloXH8qYkjr19vYoodGp6Smi16Q Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 3f1a033dec094ceb9050178fd2a086ba Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:14.173036 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f1a033dec094ceb9050178fd2a086ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 3f1a033dec094ceb9050178fd2a086ba Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ef9328825c7c4f26baeb1e0e05f9451d Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project Sep 03 20:49:14.174480 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2022-09-03 20:49:14'} Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:14.175150 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 03 20:49:14.176407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.179897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f0d5c98-8ad3-45fc-a5e5-ce5a54f12554 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:14.181459 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1f0d5c98-8ad3-45fc-a5e5-ce5a54f12554 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740 tempest-InstanceUsageAuditLogNegativeTestJSON-214264740-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-03 20:49:14" status: 403 len: 128 microversion: 2.1 time: 0.021262 Sep 03 20:49:14.182578 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 88/168] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-03%2020%3A49%3A14 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:14.190254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8b38add-15bf-49be-841d-b15135a5ee94 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-665840280", "id": 2119673596, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:14.196290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:14.206040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-160f7aba-0872-4cff-ab1a-1f48c7df1f93 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.277251 Sep 03 20:49:14.207093 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 81/169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:13 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:14.231473 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8b38add-15bf-49be-841d-b15135a5ee94 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.047503 Sep 03 20:49:14.233354 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 89/170] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:14 2022] POST /compute/v2.1/flavors => generated 437 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:14.246363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66d94211-9ac4-476d-8e7f-43cc42d4d985 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.266388 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-66d94211-9ac4-476d-8e7f-43cc42d4d985 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66d94211-9ac4-476d-8e7f-43cc42d4d985 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Request method failure captured: Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/flavors/2119673596/os-flavor-access HTTP/1.1 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73HrEho2fUGyu_YM1C_jAr6X4go-LKsv33EYzEJSqrVzCUnm3oN8cLgFvTWSMILEPOJwKidyqLDSFkv0wfGesvDaj-5r3xihHYrXDIdb__4c3EMTHU3Oj7nbtoESEm3ujnVaeycqpWXtqTY0tkVauS2vIMuT8xOxTX4rdlPiwucGIM Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:14.269011 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 5993923715d94398a246e19ecbf59106 Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: exception: Access list not available for public flavors. Sep 03 20:49:14.270362 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'flavor_id': '2119673596'} Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 03 20:49:14.271133 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.274106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66d94211-9ac4-476d-8e7f-43cc42d4d985 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:14.275775 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66d94211-9ac4-476d-8e7f-43cc42d4d985 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/2119673596/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033989 Sep 03 20:49:14.276447 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 82/171] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/flavors/2119673596/os-flavor-access => generated 91 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:14.289730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17d070e9-4c85-4fe6-aca8-79e973a7e633 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.316745 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17d070e9-4c85-4fe6-aca8-79e973a7e633 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2119673596" status: 202 len: 0 microversion: 2.1 time: 0.035640 Sep 03 20:49:14.317790 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 90/172] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:14 2022] DELETE /compute/v2.1/flavors/2119673596 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:49:14.330227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e6cab92-2016-442c-9110-96e33f41c670 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.355081 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e6cab92-2016-442c-9110-96e33f41c670 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031475 Sep 03 20:49:14.366166 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 83/173] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:14.378783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22851525-0378-42dc-ac2a-c5280c374814 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1278401297", "id": 160283996, "os-flavor-access:is_public": "False"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:14.410323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=13,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:14.420967 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22851525-0378-42dc-ac2a-c5280c374814 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.044779 Sep 03 20:49:14.426740 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 91/174] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:14 2022] POST /compute/v2.1/flavors => generated 436 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:14.569340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.570271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:14.587568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:14.593159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:14.593802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:14.595935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:14.597358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:14.598882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:14.807999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f653dcc4-6d6b-4bda-990b-d734842d1538 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:14.812348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f653dcc4-6d6b-4bda-990b-d734842d1538 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fc148ca2d15445f7860e84a40d1cdde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28735e9d204354a30066460fd3d271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f653dcc4-6d6b-4bda-990b-d734842d1538 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Request method failure captured: Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/flavors/160283996/action HTTP/1.1 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 67 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73GS9WO4isCLCzdAGBxZLaJVG0dPSbSIkQ1GoU_goR2xILmE6G6LYZARp891hxaQiT7gd4w_Ebqirc2Os5fq3OeOwZ_C0d4sk_RoSvhe5-2f12BAkUZy7dSnnVhug6MYsSSYNU-pngG44V-pqGQTSneyLO42rVoWeQgB_LX3BNTmlI Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 2a28735e9d204354a30066460fd3d271 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:14.814058 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a28735e9d204354a30066460fd3d271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2a28735e9d204354a30066460fd3d271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a28735e9d204354a30066460fd3d271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2a28735e9d204354a30066460fd3d271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 2a28735e9d204354a30066460fd3d271 Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAccessNegativeTestJSON-293513340-project Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fc148ca2d15445f7860e84a40d1cdde7 Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-293513340-project Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} Sep 03 20:49:14.815497 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '160283996', 'body': {'addTenantAccess': {'tenant': '2a28735e9d204354a30066460fd3d271'}}} Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:14.816265 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 03 20:49:14.817382 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:14.820008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f653dcc4-6d6b-4bda-990b-d734842d1538 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:14.821204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f653dcc4-6d6b-4bda-990b-d734842d1538 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] 10.222.0.16 "POST /compute/v2.1/flavors/160283996/action" status: 403 len: 130 microversion: 2.1 time: 0.387441 Sep 03 20:49:14.822329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 84/175] 10.222.0.16 () {60 vars in 1197 bytes} [Sat Sep 3 20:49:14 2022] POST /compute/v2.1/flavors/160283996/action => generated 130 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:14.832135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb842f87-6004-46bd-954f-2ff51777b317 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.856287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cb842f87-6004-46bd-954f-2ff51777b317 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/160283996" status: 202 len: 0 microversion: 2.1 time: 0.029448 Sep 03 20:49:14.857388 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 85/176] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:49:14 2022] DELETE /compute/v2.1/flavors/160283996 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:49:14.869364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-18b38a98-febe-47fe-907b-306047e18c35 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.918478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-18b38a98-febe-47fe-907b-306047e18c35 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053966 Sep 03 20:49:14.920220 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:14.945107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d240dd35-f305-495e-9914-9e67e2873d48 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-776000678", "id": 1950385535, "os-flavor-access:is_public": "False"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:14.970078 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d240dd35-f305-495e-9914-9e67e2873d48 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.031839 Sep 03 20:49:14.971531 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 87/178] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:14 2022] POST /compute/v2.1/flavors => generated 438 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:14.996747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:14.998501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:14.999366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:15.006677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25bf2f32-2c4b-49e7-88ef-00491bc2679a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.443918 Sep 03 20:49:15.007263 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 92/179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:15.008858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:15.009579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:15.010348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:15.011257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:15.012214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:15.012682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:15.018201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e99acfff-3e0d-4a27-ad22-7e90c5f47129 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:15.238529 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e99acfff-3e0d-4a27-ad22-7e90c5f47129 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1950385535/action" status: 200 len: 97 microversion: 2.1 time: 0.224107 Sep 03 20:49:15.244865 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 93/180] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:15 2022] POST /compute/v2.1/flavors/1950385535/action => generated 97 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:15.250355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:15.251236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:15.263221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:15.263732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:15.264179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:15.264934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:15.265403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:15.266352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:15.271607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:15.287002 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7bd6d9d6-143b-4562-8005-4b554126a520 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.313629 Sep 03 20:49:15.287734 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 88/181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:14 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:15.299782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4c12d2c-1e71-441c-b40d-0de59247b110 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:15.309460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4c12d2c-1e71-441c-b40d-0de59247b110 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fc148ca2d15445f7860e84a40d1cdde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28735e9d204354a30066460fd3d271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4c12d2c-1e71-441c-b40d-0de59247b110 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Request method failure captured: Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/flavors/1950385535/action HTTP/1.1 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 70 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73GS9WO4isCLCzdAGBxZLaJVG0dPSbSIkQ1GoU_goR2xILmE6G6LYZARp891hxaQiT7gd4w_Ebqirc2Os5fq3OeOwZ_C0d4sk_RoSvhe5-2f12BAkUZy7dSnnVhug6MYsSSYNU-pngG44V-pqGQTSneyLO42rVoWeQgB_LX3BNTmlI Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 2a28735e9d204354a30066460fd3d271 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:15.313957 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a28735e9d204354a30066460fd3d271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2a28735e9d204354a30066460fd3d271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2a28735e9d204354a30066460fd3d271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2a28735e9d204354a30066460fd3d271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 2a28735e9d204354a30066460fd3d271 Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-293513340 Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAccessNegativeTestJSON-293513340-project Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fc148ca2d15445f7860e84a40d1cdde7 Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-293513340-project Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: {"removeTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} Sep 03 20:49:15.315140 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1950385535', 'body': {'removeTenantAccess': {'tenant': '2a28735e9d204354a30066460fd3d271'}}} Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can( Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:15.315791 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 03 20:49:15.317379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:15.318360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4c12d2c-1e71-441c-b40d-0de59247b110 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:15.318435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4c12d2c-1e71-441c-b40d-0de59247b110 tempest-FlavorsAccessNegativeTestJSON-293513340 tempest-FlavorsAccessNegativeTestJSON-293513340-project] 10.222.0.16 "POST /compute/v2.1/flavors/1950385535/action" status: 403 len: 133 microversion: 2.1 time: 0.023016 Sep 03 20:49:15.323831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 89/182] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:15 2022] POST /compute/v2.1/flavors/1950385535/action => generated 133 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:15.342905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-176a6e9c-69fc-4ec0-a9a2-1fd79cab15bb tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2a28735e9d204354a30066460fd3d271"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:15.555764 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-176a6e9c-69fc-4ec0-a9a2-1fd79cab15bb tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1950385535/action" status: 200 len: 21 microversion: 2.1 time: 0.224375 Sep 03 20:49:15.559679 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 90/183] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:15 2022] POST /compute/v2.1/flavors/1950385535/action => generated 21 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:15.570494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91626ee7-ed79-4685-9673-8dbadcf9edce tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:15.618826 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91626ee7-ed79-4685-9673-8dbadcf9edce tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1950385535" status: 202 len: 0 microversion: 2.1 time: 0.052681 Sep 03 20:49:15.623427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 91/184] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:15 2022] DELETE /compute/v2.1/flavors/1950385535 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:15.633005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-149c7732-f2ae-4dde-98b5-db48a9d4eaa5 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:15.666842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:15.673409 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-149c7732-f2ae-4dde-98b5-db48a9d4eaa5 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048569 Sep 03 20:49:15.679640 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 92/185] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:15.692944 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ada49d33-0d4d-4cda-916a-ac641b9be761 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.445078 Sep 03 20:49:15.692944 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:15 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:15.706568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbd0167f-f53b-4056-b00a-93bf4a045389 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-259643652", "id": 1421945365, "os-flavor-access:is_public": "False"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:15.741538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbd0167f-f53b-4056-b00a-93bf4a045389 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041728 Sep 03 20:49:15.743977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 95/187] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:15 2022] POST /compute/v2.1/flavors => generated 438 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:15.763240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64c9be18-3308-4336-b5ab-5b0d1a5ca6cd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b46258375af4678b58c037fb587d677"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:16.030791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:16.031501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:16.038785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.039276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.055668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.056450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.056997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.058728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.249007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:16.254209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-64c9be18-3308-4336-b5ab-5b0d1a5ca6cd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] HTTP exception thrown: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64c9be18-3308-4336-b5ab-5b0d1a5ca6cd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Request method failure captured: Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/flavors/1421945365/action HTTP/1.1 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 70 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73HrEho2fUGyu_YM1C_jAr6X4go-LKsv33EYzEJSqrVzCUnm3oN8cLgFvTWSMILEPOJwKidyqLDSFkv0wfGesvDaj-5r3xihHYrXDIdb__4c3EMTHU3Oj7nbtoESEm3ujnVaeycqpWXtqTY0tkVauS2vIMuT8xOxTX4rdlPiwucGIM Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:16.256688 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6db583b83bcd4030bf0f9a70f6943210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6db583b83bcd4030bf0f9a70f6943210 Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-746619449 Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 5993923715d94398a246e19ecbf59106 Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: {"removeTenantAccess": {"tenant": "4b46258375af4678b58c037fb587d677"}} Sep 03 20:49:16.258071 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1421945365', 'body': {'removeTenantAccess': {'tenant': '4b46258375af4678b58c037fb587d677'}}} Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 03 20:49:16.258691 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:16.259638 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. Sep 03 20:49:16.260735 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:16.262542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64c9be18-3308-4336-b5ab-5b0d1a5ca6cd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Returning 404 to user: Flavor access not found for 32 / 4b46258375af4678b58c037fb587d677 combination. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:16.263634 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-64c9be18-3308-4336-b5ab-5b0d1a5ca6cd tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1421945365/action" status: 404 len: 124 microversion: 2.1 time: 0.509054 Sep 03 20:49:16.265098 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 93/188] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:49:15 2022] POST /compute/v2.1/flavors/1421945365/action => generated 124 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:16.277081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81277aaa-fa29-4b05-bd6f-2c6e927a5142 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:16.305174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81277aaa-fa29-4b05-bd6f-2c6e927a5142 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1421945365" status: 202 len: 0 microversion: 2.1 time: 0.035861 Sep 03 20:49:16.311626 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 94/189] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:16 2022] DELETE /compute/v2.1/flavors/1421945365 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:16.320329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:16.321254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:16.334949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.335701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.336296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.337407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.339350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.341086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.463134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:16.475267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc0f0d4c-7ccf-43f3-99fd-234236ae03f6 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.448819 Sep 03 20:49:16.478391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 96/190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:16 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:16.485800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-438378de-9d6d-4305-a415-ad88cc3e1334 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:16.531904 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-438378de-9d6d-4305-a415-ad88cc3e1334 tempest-FlavorsAccessNegativeTestJSON-746619449 tempest-FlavorsAccessNegativeTestJSON-746619449-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052193 Sep 03 20:49:16.533142 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 97/191] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:16.732837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:16.737449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:16.757281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.759559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.762916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.764583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:16.765443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:16.766117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:16.992156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:16.999514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:17.008145 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54ac43de-82d8-4fef-af2e-617e629cd764 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.296962 Sep 03 20:49:17.014523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd89e5dd-a015-4c67-a333-75af72b607cb tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.701301 Sep 03 20:49:17.029108 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 95/192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:16 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:17.029218 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 98/193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:16 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:17.499880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:17.500527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:17.516756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:17.517305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:17.517763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:17.518495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:17.518959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:17.519391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:18.034886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:18.036152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:18.053114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:18.055816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:18.056494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:18.057468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:18.058928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:18.060294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:18.111203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:18.121855 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01561ebb-8be4-4b23-b904-c00a8e8a4841 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.626039 Sep 03 20:49:18.130829 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 96/194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:17 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:18.147053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:18.150896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:18.178464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:18.188013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:18.190078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:18.191220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:18.194561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:18.195208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:18.421009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:18.430474 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-926f66d3-8dd4-408c-b85a-f4283f87e735 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.400734 Sep 03 20:49:18.441978 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 99/195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:18 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:18.630646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:18.645192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dff64c55-066d-4ee3-9943-c78e648e55fa tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.513064 Sep 03 20:49:18.645786 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 97/196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:18 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:19.153378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:19.154988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:19.175138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:19.178813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:19.179336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:19.180147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:19.180620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:19.186522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:19.196599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:19.430039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:19.440473 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-561c8388-92cb-42c5-be02-61dc8f957e63 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.292624 Sep 03 20:49:19.441920 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 100/197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:19 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:19.457593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:19.458459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:19.484004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:19.484542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:19.487312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:19.488138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:19.489230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:19.489697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:19.983210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:19.991234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-978d08c4-a660-4cf4-92b7-9b6766c75095 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.538966 Sep 03 20:49:19.992398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 98/198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:19 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:20.009302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:20.009925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:20.023749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:20.024373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:20.024804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:20.025562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:20.026022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:20.026457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:20.083493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9278b412-b33d-4a78-b47b-d43f0d6532db tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] Calling method '.version_select at 0x7fae67ab75e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:20.113834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9278b412-b33d-4a78-b47b-d43f0d6532db tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.458281 Sep 03 20:49:20.115642 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 101/199] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:49:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:20.134419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-efc774cf-73e4-449a-b92c-f12d252ec908 tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] Action: 'update', calling method: .version_select at 0x7fae67baba60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:20.510500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:20.522515 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b440e26-9625-4fba-aabf-a13edb639580 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.528876 Sep 03 20:49:20.524270 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 99/200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:19 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:20.667252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef536920-06ca-48da-a1ef-7bc6bce736ad", "name": "network-vif-plugged", "status": "completed", "tag": "7c339d38-694c-43ef-a124-9f03a2f9a913"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:20.685447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:20.686201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:20.686645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:20.690957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:20.713454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] Creating event network-vif-plugged:7c339d38-694c-43ef-a124-9f03a2f9a913 for instance ef536920-06ca-48da-a1ef-7bc6bce736ad on nch2-master-1 Sep 03 20:49:20.720306 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1d87e2e7-6d01-43b0-ad12-9939a2f031d1 req-7583c4f7-45da-4384-8cde-1fd4768a9028 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193782 Sep 03 20:49:20.723495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 100/201] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:20.729312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:20.731250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:20.738183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:20.739303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:20.739945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:20.740961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:20.741628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:20.742363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:20.777643 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-efc774cf-73e4-449a-b92c-f12d252ec908 tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.647069 Sep 03 20:49:20.785358 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 102/202] 10.222.0.16 () {60 vars in 1206 bytes} [Sat Sep 3 20:49:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:20.790422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b5b92f4-f4e6-4bdf-9898-0e9c5bd201d8 tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] Calling method '.version_select at 0x7fae67d2e790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:20.802493 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b5b92f4-f4e6-4bdf-9898-0e9c5bd201d8 tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.015394 Sep 03 20:49:20.811451 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 103/203] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:49:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:20.816428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e7f48d0-8aaf-4fb3-b83a-688977390cad tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] Action: 'update', calling method: .version_select at 0x7fae67b4cee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:20.870572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=14,nova_api:UPDATE=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:21.023906 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e7f48d0-8aaf-4fb3-b83a-688977390cad tempest-QuotaClassesAdminTestJSON-1076633885 tempest-QuotaClassesAdminTestJSON-1076633885-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.210639 Sep 03 20:49:21.025668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 104/204] 10.222.0.16 () {60 vars in 1206 bytes} [Sat Sep 3 20:49:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:21.037443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:21.038296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:21.048945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:21.050007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:21.052987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:21.055583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:21.056636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:21.057405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:21.086836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:21.099388 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d26496ed-a778-4c96-a232-42772e6fabc9 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.374387 Sep 03 20:49:21.099975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 101/205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:20 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:21.291343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:21.305044 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c06579cb-fd3b-404f-ac68-6e89e0120b79 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.277922 Sep 03 20:49:21.306540 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 105/206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:21 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:21.551513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:21.552649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:21.567800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:21.568422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:21.569419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:21.570369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:21.571915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:21.574444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:21.907138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:21.920715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8875c64-a2f4-4eaf-b032-f6bf1706df84 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.374546 Sep 03 20:49:21.921335 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 102/207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:21 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:22.125544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:22.126299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:22.138577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.139221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.139706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.140536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.141127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.142464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.328855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:22.330165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:22.337607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.348303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.351196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.353062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.354904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.356008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.409980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:22.421040 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bbe7ddfc-b912-425c-92bd-e3c547c070b3 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.299988 Sep 03 20:49:22.427627 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 106/208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:22 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:22.717459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:22.729516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53310d7b-2d56-4160-8eca-56bb5a0f1394 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.404997 Sep 03 20:49:22.731048 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 103/209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:22 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:22.764394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f9b4bc-e12f-4f12-841a-336d1dcda4fa", "name": "network-vif-plugged", "status": "completed", "tag": "0827f4fd-c782-4c0a-b491-023e9a459266"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:22.776001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.776752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.777358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.792923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] Creating event network-vif-plugged:0827f4fd-c782-4c0a-b491-023e9a459266 for instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa on nch1-master-1 Sep 03 20:49:22.800968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1f0e4ad3-846c-4235-a1e9-ce1ce521be4d req-bd5c860c-7cee-4a53-a9e8-e2f02eba4010 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Sep 03 20:49:22.801953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 107/210] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:22.943169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:22.943778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:22.955399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.956547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.957178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:22.959247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:22.960256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:22.960838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.260472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.274329 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c62c9c80-cbc7-4689-8128-872fa66db05a tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1338 microversion: 2.1 time: 0.335118 Sep 03 20:49:23.291523 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 104/211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:22 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1338 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:23.414729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Calling method '.version_select at 0x7fae67b4c9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.418464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.418963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.419467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.420989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.421723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.422310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.451759 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec1446c2-0cca-46cc-bab5-aa45eb1beaa6 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.240258 Sep 03 20:49:23.452721 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 108/212] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:23.457977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.458692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:23.469153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.469809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.471338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.472384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.476878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.478236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.707618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc67c655-249f-4caf-9783-13477e3a50ea tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Calling method '.version_select at 0x7fae67d2ee50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.711246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fc67c655-249f-4caf-9783-13477e3a50ea tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc67c655-249f-4caf-9783-13477e3a50ea tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:23.713572 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 20:49:23.715049 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:23.716183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 03 20:49:23.717407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.718675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc67c655-249f-4caf-9783-13477e3a50ea tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.718675 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc67c655-249f-4caf-9783-13477e3a50ea tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.252146 Sep 03 20:49:23.718675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 109/213] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:23.734785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7590ec44-cd32-4efd-a69b-8c577bd7d217 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Calling method '.version_select at 0x7fae67a5eaf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.744130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7590ec44-cd32-4efd-a69b-8c577bd7d217 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7590ec44-cd32-4efd-a69b-8c577bd7d217 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:23.749649 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ncdv-master-1'} Sep 03 20:49:23.751048 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:23.751849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 03 20:49:23.753030 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.755022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7590ec44-cd32-4efd-a69b-8c577bd7d217 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.758050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7590ec44-cd32-4efd-a69b-8c577bd7d217 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023925 Sep 03 20:49:23.759771 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 110/214] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:23.771103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.773587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:23.782407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.790390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.790900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.791352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.792074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:23.792535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:23.794008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:23.794789 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2c11c7e-4fe1-4621-b862-429a2087beb2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.341725 Sep 03 20:49:23.797432 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 105/215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:23.806057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14b91db9-0df1-4040-87a9-6ed0691203fa tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Calling method '.version_select at 0x7fae678b8160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.828685 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-14b91db9-0df1-4040-87a9-6ed0691203fa tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14b91db9-0df1-4040-87a9-6ed0691203fa tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:23.831151 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hostname'} Sep 03 20:49:23.832336 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:23.833098 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 03 20:49:23.834096 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14b91db9-0df1-4040-87a9-6ed0691203fa tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.835127 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14b91db9-0df1-4040-87a9-6ed0691203fa tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.034107 Sep 03 20:49:23.844735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 106/216] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:23.872850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d212fb8-9a41-4af8-a68e-998bd90ddcff tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Calling method '.version_select at 0x7fae678e3700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.886068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d212fb8-9a41-4af8-a68e-998bd90ddcff tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d212fb8-9a41-4af8-a68e-998bd90ddcff tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:23.889063 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1'} Sep 03 20:49:23.890271 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:23.890991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 03 20:49:23.892120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.898329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d212fb8-9a41-4af8-a68e-998bd90ddcff tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.899185 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d212fb8-9a41-4af8-a68e-998bd90ddcff tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.048982 Sep 03 20:49:23.899781 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 107/217] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:23.913232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afc4040c-3d1e-43d2-a178-4ae949494d18 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Calling method '.version_select at 0x7fae67a0d3a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.920767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-afc4040c-3d1e-43d2-a178-4ae949494d18 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afc4040c-3d1e-43d2-a178-4ae949494d18 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:23.922591 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hostname'} Sep 03 20:49:23.923901 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.924601 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:23.925618 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.928281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afc4040c-3d1e-43d2-a178-4ae949494d18 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.929482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afc4040c-3d1e-43d2-a178-4ae949494d18 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022941 Sep 03 20:49:23.930288 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 108/218] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:23.941611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-543d5b48-3869-41ce-b2ee-d3c6f3e1e02a tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Calling method '.version_select at 0x7fae678b8e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:23.944392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-543d5b48-3869-41ce-b2ee-d3c6f3e1e02a tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-543d5b48-3869-41ce-b2ee-d3c6f3e1e02a tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:23.947144 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1'} Sep 03 20:49:23.948545 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:23.949270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 03 20:49:23.950913 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:23.975360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-543d5b48-3869-41ce-b2ee-d3c6f3e1e02a tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:23.978639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-543d5b48-3869-41ce-b2ee-d3c6f3e1e02a tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.041177 Sep 03 20:49:23.981265 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 109/219] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:23.995529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-091d5dc5-7ba0-459c-a7a5-c234877c1a7d tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Calling method '.version_select at 0x7fae678e3b80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.030090 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-091d5dc5-7ba0-459c-a7a5-c234877c1a7d tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-091d5dc5-7ba0-459c-a7a5-c234877c1a7d tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.031838 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hostname'} Sep 03 20:49:24.033021 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:24.033789 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 03 20:49:24.034778 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-091d5dc5-7ba0-459c-a7a5-c234877c1a7d tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-091d5dc5-7ba0-459c-a7a5-c234877c1a7d tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.047544 Sep 03 20:49:24.035782 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 110/220] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:24.063088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d8d531d-e3ac-464c-a69d-c30daa40949e tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Calling method '.version_select at 0x7fae678b8e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.065384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d8d531d-e3ac-464c-a69d-c30daa40949e tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d8d531d-e3ac-464c-a69d-c30daa40949e tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:24.071018 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1'} Sep 03 20:49:24.072332 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:24.073044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 03 20:49:24.074035 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.079005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d8d531d-e3ac-464c-a69d-c30daa40949e tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.080296 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d8d531d-e3ac-464c-a69d-c30daa40949e tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.034256 Sep 03 20:49:24.089259 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 111/221] 10.222.0.16 () {58 vars in 1194 bytes} [Sat Sep 3 20:49:24 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:24.100039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0656040-1729-4c8f-bdc6-3729642ec576 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Calling method '.version_select at 0x7fae6799dee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.113160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c0656040-1729-4c8f-bdc6-3729642ec576 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0656040-1729-4c8f-bdc6-3729642ec576 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.115339 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hostname'} Sep 03 20:49:24.116523 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:24.117230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 03 20:49:24.118222 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.119230 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.127637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0656040-1729-4c8f-bdc6-3729642ec576 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.129077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c0656040-1729-4c8f-bdc6-3729642ec576 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033760 Sep 03 20:49:24.130205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 112/222] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Sep 3 20:49:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:24.150914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74f275c6-1f1a-43d2-9ebb-0aee7d65b7cb tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Action: 'update', calling method: .version_select at 0x7fae678b8ca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74f275c6-1f1a-43d2-9ebb-0aee7d65b7cb tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 51 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.155466 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: {"status": "enable", "maintenance_mode": "invalid"} Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.156936 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'disable', Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Enable', Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Disable', Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance: Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'invalid' Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.157654 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.159019 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74f275c6-1f1a-43d2-9ebb-0aee7d65b7cb tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.160015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74f275c6-1f1a-43d2-9ebb-0aee7d65b7cb tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.016611 Sep 03 20:49:24.160419 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 113/223] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:49:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:24.170992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70ef7a1c-1720-4cdb-be83-b7c2f54e4d45 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Action: 'update', calling method: .version_select at 0x7fae678e3310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70ef7a1c-1720-4cdb-be83-b7c2f54e4d45 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 51 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.187614 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: {"status": "invalid", "maintenance_mode": "enable"} Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.188889 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'disable', Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Enable', Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Disable', Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance: Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'invalid' Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.189623 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.190988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70ef7a1c-1720-4cdb-be83-b7c2f54e4d45 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70ef7a1c-1720-4cdb-be83-b7c2f54e4d45 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.024090 Sep 03 20:49:24.192005 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 114/224] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:49:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 20:49:24.202124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e284760-9089-4587-9bc8-e56230429114 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Action: 'update', calling method: .version_select at 0x7fae67a0d3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.206017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e284760-9089-4587-9bc8-e56230429114 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '1bcd7ba470ae456bbefd5ff0f8966fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2e65e42b6f424084b1908581c853f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e284760-9089-4587-9bc8-e56230429114 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Request method failure captured: Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 50 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73R5J50t1A9tdDyQAkB19boqAX94S84X-UaBJYXYK-ZLaAJGC8TaevhjzSzgGMdGxhmaoLB52ClsGlBHPJ0pWhpYjxerXVoBalYHHrJCl4QoilUnPzuVtIPcByo6IfrNq15el9HZPQQbNUcMedAk4QMEEmRqIJcYSb8lETXOwLjAvg Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:24.207846 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f2e65e42b6f424084b1908581c853f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 3f2e65e42b6f424084b1908581c853f2 Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-171905245 Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1bcd7ba470ae456bbefd5ff0f8966fb1 Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-171905245-project Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: {"status": "enable", "maintenance_mode": "enable"} Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 03 20:49:24.209237 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:24.210207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 03 20:49:24.211217 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.213154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e284760-9089-4587-9bc8-e56230429114 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.215274 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e284760-9089-4587-9bc8-e56230429114 tempest-HostsAdminNegativeTestJSON-171905245 tempest-HostsAdminNegativeTestJSON-171905245-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.017117 Sep 03 20:49:24.218670 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 115/225] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:49:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:24.237037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd1f0dc4-58e2-47c5-b880-739356e27cd2 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Action: 'update', calling method: .version_select at 0x7fae677ef940>, body: {"status": null, "maintenance_mode": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd1f0dc4-58e2-47c5-b880-739356e27cd2 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 42 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.246513 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: {"status": null, "maintenance_mode": null} Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 03 20:49:24.248301 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'disable', Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Enable', Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'Disable', Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance: Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi None Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.249043 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.256369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd1f0dc4-58e2-47c5-b880-739356e27cd2 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd1f0dc4-58e2-47c5-b880-739356e27cd2 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.021767 Sep 03 20:49:24.258403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 116/226] 10.222.0.16 () {60 vars in 1190 bytes} [Sat Sep 3 20:49:24 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:24.261906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Action: 'update', calling method: .version_select at 0x7fae678e3670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.268707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.hosts [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Enabling host nonexistent_hostname. Sep 03 20:49:24.299760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Request method failure captured: Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 50 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73TSf8-tAMDOxKDt9ObYDhI0KE8ZaFaDzr9YaJSIoF-hjT-ELXgb-a-7rrAlCT_SlZMB0YyNKBJwfA-sQ9pTH1LI0MK43Q2UullHd6OBd9APqmwievAZPpKNKct-IowzVDnr1P5dnBHdMOqbNd82cMohsoNVQW4qFMoOJOuOFCaW54 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:24.301621 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_01257be8071444c089e63b0614a07130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/01257be8071444c089e63b0614a07130"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/01257be8071444c089e63b0614a07130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 01257be8071444c089e63b0614a07130 Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1179391700 Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 36cff37f33cc458e97c47a9b047b7081 Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1179391700-project-admin Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: {"status": "enable", "maintenance_mode": "enable"} Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.302775 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:24.303508 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:24.304410 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:24.305610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:24.309773 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a786e297-09e8-4247-86d5-331edeaea084 tempest-HostsAdminNegativeTestJSON-1179391700 tempest-HostsAdminNegativeTestJSON-1179391700-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.047427 Sep 03 20:49:24.309773 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 117/227] 10.222.0.16 () {60 vars in 1211 bytes} [Sat Sep 3 20:49:24 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:24.312608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.313215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:24.336097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.336597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.340886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.346728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.347020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.348858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.371916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:24.386145 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a128ee7-a6af-47d9-bd91-43b7cfe0ac7b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.624686 Sep 03 20:49:24.389202 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 111/228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:23 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:24.636665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:24.650836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ca0d50d-d2c7-4430-b09c-5eda70690d5b tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1488 microversion: 2.1 time: 0.344185 Sep 03 20:49:24.651784 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 118/229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:24 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1488 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:24.676443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.677109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:24.692216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.693042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.693759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.694800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.695463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.696061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.819241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be2b2e-c86c-4cbe-b6c1-756c58c7698e", "name": "network-vif-plugged", "status": "completed", "tag": "24caafa8-d397-458f-87e1-4d7863d49497"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:24.829857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.830343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.830775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.848574 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] Creating event network-vif-plugged:24caafa8-d397-458f-87e1-4d7863d49497 for instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e on nch1-master-1 Sep 03 20:49:24.860242 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0bb59cdc-0c92-4340-970c-f77ae1baeae6 req-b658bda1-3ba9-491e-b7f9-1a8a96b53c45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040594 Sep 03 20:49:24.861222 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 119/230] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:24.866613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:24.867319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:24.877707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.878204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.878646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:24.879355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:24.879816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:24.880243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.168650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:25.204422 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13370599-326e-46b8-976f-c9261ab39c19 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.341889 Sep 03 20:49:25.206399 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 120/231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:24 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:25.390219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57fcc9c2-2497-48ec-80e1-36069a35722e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1639 microversion: 2.1 time: 0.717819 Sep 03 20:49:25.395713 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 112/232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:24 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1639 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:25.422271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:25.423324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:25.432641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.433944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.434828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.436441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.437165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.437753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.445207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:25.446499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:25.472800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.474360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.475596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.480868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.484179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.484772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.516720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:49:25.770688 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ad01b3e-b398-4a1d-a671-92231f3de624 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 204 len: 0 microversion: 2.1 time: 0.353269 Sep 03 20:49:25.771381 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 113/233] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:25 2022] DELETE /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:49:25.786361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:25.787278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:25.797209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.799677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.800512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.802856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:25.803939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:25.804544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:25.974878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:25.983962 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59200835-58f4-47f2-bca6-a14fc44d6a59 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1319 microversion: 2.1 time: 0.572289 Sep 03 20:49:25.987701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:25 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:26.127460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:26.149695 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ceda6e51-0da3-43c7-be21-347d2b6275ec tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1494 microversion: 2.1 time: 0.373286 Sep 03 20:49:26.150640 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 114/235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:25 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1494 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:26.231035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.232880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:26.246390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.249369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.249879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.252402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.253019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.253371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.557243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Action: 'update', calling method: .version_select at 0x7fae67bab5e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:26.560863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.561378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.561822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.569540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.570024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.570466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.578074 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] HTTP exception thrown: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Request method failure captured: Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 HTTP/1.1 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 56 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73WKuAdWaHtQzST_o4ZUiQVROzVra_X88WHXgUTnyFOTGmnx4cSva1e7T5pn92A3a5zazLC6vVdEsdHzljs-39OJMx_3_dv6sGaU3jFtI2CaYiTn3hGSpRcwRrmtnY-4-72pbOcFQNen2-cA9LDacCN0mwmvtIY4Qq2BXCsTew8EF0 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.53 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:26.580867 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4fcdc60b97c14a8f9c0bddac59d5fe95 Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:26.582112 ncdv-master-1 devstack@n-api.service[140519]: exception: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'fa3c21ca-9f4e-414a-a0ba-114390fefb66', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.582797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.584174 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:26.585266 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:26.585266 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.585266 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.587012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Returning 404 to user: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:26.587993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0313706c-9a82-4efd-9c18-f48da02b9d6a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66" status: 404 len: 110 microversion: 2.53 time: 0.208057 Sep 03 20:49:26.588668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 115/236] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Sep 3 20:49:26 2022] PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 => generated 110 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 03 20:49:26.602203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Action: 'update', calling method: .version_select at 0x7fae67a26700>, body: {"status": "disabled"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:26.606088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.607569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.608191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.614396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.615171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.615702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.630934 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] HTTP exception thrown: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Request method failure captured: Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 HTTP/1.1 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 22 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73WKuAdWaHtQzST_o4ZUiQVROzVra_X88WHXgUTnyFOTGmnx4cSva1e7T5pn92A3a5zazLC6vVdEsdHzljs-39OJMx_3_dv6sGaU3jFtI2CaYiTn3hGSpRcwRrmtnY-4-72pbOcFQNen2-cA9LDacCN0mwmvtIY4Qq2BXCsTew8EF0 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.53 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:26.634224 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4fcdc60b97c14a8f9c0bddac59d5fe95 Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: {"status": "disabled"} Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: exception: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.635579 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'fa3c21ca-9f4e-414a-a0ba-114390fefb66', 'body': {'status': 'disabled'}} Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.636293 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:26.638270 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:26.640766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.640766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.642376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Returning 404 to user: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:26.643628 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc4a43b9-c13e-44ad-a43b-ee286b97e296 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66" status: 404 len: 110 microversion: 2.53 time: 0.045930 Sep 03 20:49:26.645202 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 116/237] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Sep 3 20:49:26 2022] PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:26.654488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Action: 'update', calling method: .version_select at 0x7fae67941280>, body: {"status": "enabled"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:26.659714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.660406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.661127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.667690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.668495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.669779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.676353 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] HTTP exception thrown: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Request method failure captured: Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 HTTP/1.1 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 21 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73WKuAdWaHtQzST_o4ZUiQVROzVra_X88WHXgUTnyFOTGmnx4cSva1e7T5pn92A3a5zazLC6vVdEsdHzljs-39OJMx_3_dv6sGaU3jFtI2CaYiTn3hGSpRcwRrmtnY-4-72pbOcFQNen2-cA9LDacCN0mwmvtIY4Qq2BXCsTew8EF0 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.53 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:26.678258 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/177c55cd1fa34ac88cdd3e787ca97621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 177c55cd1fa34ac88cdd3e787ca97621 Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904 Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4fcdc60b97c14a8f9c0bddac59d5fe95 Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: {"status": "enabled"} Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: exception: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.679705 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'fa3c21ca-9f4e-414a-a0ba-114390fefb66', 'body': {'status': 'enabled'}} Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.681432 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:26.682990 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:26.688582 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. Sep 03 20:49:26.688582 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:26.688582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Returning 404 to user: Service fa3c21ca-9f4e-414a-a0ba-114390fefb66 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:26.688582 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4e24f9b-c56a-435a-800b-a8f6c5841252 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66" status: 404 len: 110 microversion: 2.53 time: 0.031786 Sep 03 20:49:26.688582 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 117/238] 10.222.0.16 () {62 vars in 1309 bytes} [Sat Sep 3 20:49:26 2022] PUT /compute/v2.1/os-services/fa3c21ca-9f4e-414a-a0ba-114390fefb66 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:26.704289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.711618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.712159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.712674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.713477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.714021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.714455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.748750 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fbd848dc-2306-4ecb-af6d-fa725cb1345a tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.050952 Sep 03 20:49:26.749391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 118/239] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:26.762179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.765613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.766114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.766550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.767507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.767964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.768396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.793916 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f5874b75-9a29-4d39-9544-8048243f6e87 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.035341 Sep 03 20:49:26.795212 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 119/240] 10.222.0.16 () {60 vars in 1211 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:49:26.797698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:26.813823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.817875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.818569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.818833 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dec64448-fa4d-4cb7-b4f3-f64388a78955 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1319 microversion: 2.1 time: 0.592448 Sep 03 20:49:26.819468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.819758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 122/241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1319 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:26.821055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.821749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.822381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.852383 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8817dbe2-45e5-4b3d-82e4-36f63b779da3 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.046339 Sep 03 20:49:26.853356 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 120/242] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:26.874732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.895804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.901497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.907450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.911179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.911950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.912664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.965700 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9d15a7a-87d5-40a5-85d6-9d7465aeac9d tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100976 Sep 03 20:49:26.976197 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 123/243] 10.222.0.16 () {60 vars in 1237 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:26.980890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:26.985595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.986103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.986551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:26.987451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:26.994735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:26.996210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.009969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:27.011196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:27.021450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.022466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.023059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.024090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.024696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.025344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.040536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-19bce6bf-9dec-4faa-8981-675a71304f29 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.064091 Sep 03 20:49:27.041282 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 121/244] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Sep 3 20:49:26 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:27.068593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:27.072593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.073798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.074404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.075857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.076487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.077110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.109143 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-10f74f5f-dfff-470e-bdda-27d7dfffac77 tempest-ServicesAdminNegativeV253TestJSON-799126904 tempest-ServicesAdminNegativeV253TestJSON-799126904-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.044625 Sep 03 20:49:27.109948 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 122/245] 10.222.0.16 () {60 vars in 1239 bytes} [Sat Sep 3 20:49:27 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:27.338825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28732243-0674-4629-8656-eec1abbce160 tempest-ServicesAdminNegativeV253TestJSON-1018856262 tempest-ServicesAdminNegativeV253TestJSON-1018856262-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:27.343244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-28732243-0674-4629-8656-eec1abbce160 tempest-ServicesAdminNegativeV253TestJSON-1018856262 tempest-ServicesAdminNegativeV253TestJSON-1018856262-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9387ac00c53d4d6687289d53f615f5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa79c05b5a7408c9748ec9d3dfc4283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28732243-0674-4629-8656-eec1abbce160 tempest-ServicesAdminNegativeV253TestJSON-1018856262 tempest-ServicesAdminNegativeV253TestJSON-1018856262-project] Request method failure captured: Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73VLC_OhtuORemvpCXSba9jZK9CzgUd5WTkQmfNtsahdV6bYxPajmmL5IZZD_z_LusYBhleWJDyFjooBNDreUyUzTErsRfjv6-6XSdHCbRFEbfXCuC3ZplT5PskIGfKfKMh1LyXoSoY1dAHZOzUelBOjSlaOYshWn2_o6AoDvSmpe8 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.53 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 4aa79c05b5a7408c9748ec9d3dfc4283 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1018856262 Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:27.345307 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4aa79c05b5a7408c9748ec9d3dfc4283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4aa79c05b5a7408c9748ec9d3dfc4283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4aa79c05b5a7408c9748ec9d3dfc4283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4aa79c05b5a7408c9748ec9d3dfc4283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1018856262 Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 4aa79c05b5a7408c9748ec9d3dfc4283 Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1018856262 Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1018856262-project Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9387ac00c53d4d6687289d53f615f5a2 Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1018856262-project Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:49:27.346551 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:27.347199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:49:27.348163 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:27.352444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28732243-0674-4629-8656-eec1abbce160 tempest-ServicesAdminNegativeV253TestJSON-1018856262 tempest-ServicesAdminNegativeV253TestJSON-1018856262-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:27.352444 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28732243-0674-4629-8656-eec1abbce160 tempest-ServicesAdminNegativeV253TestJSON-1018856262 tempest-ServicesAdminNegativeV253TestJSON-1018856262-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.209674 Sep 03 20:49:27.352444 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 123/246] 10.222.0.16 () {60 vars in 1178 bytes} [Sat Sep 3 20:49:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:27.352653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:27.353135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:27.363221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.363719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.364157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.365381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.365992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.366567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.489641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:27.498152 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3453a135-351a-46d1-9571-fd31e5c6496e tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1468 microversion: 2.1 time: 0.492996 Sep 03 20:49:27.517299 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:27 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:27.559014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:27.569097 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81f76f28-a5cf-4d21-ab3e-f9f2c1fd68c4 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1494 microversion: 2.1 time: 0.220693 Sep 03 20:49:27.570244 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 124/248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:27 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1494 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:27.834970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1225506982", "block_migration": true, "disk_over_commit": false}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:27.845868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:27.846229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:27.847845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:27.859086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.859585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.863616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.864436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.865228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.866571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.867231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.867837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.868227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:27.869533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:27.871556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:27.873244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.146984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:28.156543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f75deda4-6a6e-4827-ab48-aae43efe0e03 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1469 microversion: 2.1 time: 0.318028 Sep 03 20:49:28.157179 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:27 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:28.487965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lazy-loading 'flavor' on Instance uuid 40f9b4bc-e12f-4f12-841a-336d1dcda4fa {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:28.584356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Going to try to live migrate instance to tempest-host-1225506982 {{(pid=140520) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:49:28.592655 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] HTTP exception thrown: Compute host tempest-host-1225506982 could not be found. Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Request method failure captured: Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa/action HTTP/1.1 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 107 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72tsU6Qx7cR6AB-deRTrdk7vspvKOBK7I3kXG6V-woGjoTyFvFzxOpEKA8OYp1qvX2NDRXoe7HZAKS0o2_mRe2OdP0F0CsWRaSyGMdWMD5So2dBR-VuWWdtv3s9-NDJlGr1v6xGyMO1kRLQgPc63U7WODnSTWMAjnBZnOTASGOnf6o Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a293794868cd4c749b6eaa82e23e0500 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:28.599815 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a293794868cd4c749b6eaa82e23e0500 Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveMigrationNegativeTest-1442947885-project-admin Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 8b5729e885694c2caf13e018c54a95bf Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveMigrationNegativeTest-1442947885-project-admin Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: {"os-migrateLive": {"host": "tempest-host-1225506982", "block_migration": true, "disk_over_commit": false}} Sep 03 20:49:28.601098 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: exception: Compute host tempest-host-1225506982 could not be found. Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '40f9b4bc-e12f-4f12-841a-336d1dcda4fa', 'body': {'os-migrateLive': {'host': 'tempest-host-1225506982', 'block_migration': True, 'disk_over_commit': False}}} Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:28.601848 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1225506982 could not be found. Sep 03 20:49:28.602901 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1225506982 could not be found. Sep 03 20:49:28.603991 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1225506982 could not be found. Sep 03 20:49:28.605060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:28.607987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Returning 400 to user: Compute host tempest-host-1225506982 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:28.609241 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aea50cf2-96ff-41fc-930c-9e5276ee7ecb tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa/action" status: 400 len: 100 microversion: 2.1 time: 1.090780 Sep 03 20:49:28.610041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 125/250] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Sep 3 20:49:27 2022] POST /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa/action => generated 100 bytes in 1092 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:28.615923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef536920-06ca-48da-a1ef-7bc6bce736ad", "name": "network-vif-deleted", "tag": "7c339d38-694c-43ef-a124-9f03a2f9a913"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:28.630354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.631189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.631857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.646909 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] Creating event network-vif-deleted:7c339d38-694c-43ef-a124-9f03a2f9a913 for instance ef536920-06ca-48da-a1ef-7bc6bce736ad on nch2-master-1 Sep 03 20:49:28.653484 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4b79bd0e-c1be-4b9a-a617-4779f7535ff6 req-429fc3e0-cf21-4bf5-9efe-991a60ac3c91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041832 Sep 03 20:49:28.654362 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 126/251] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:28.657280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:28.657795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:28.660034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:28.660917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:28.664569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.665096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.667034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.667152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.667591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.668008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.668683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.669707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.670374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.672098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.673454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.674314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.714722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:49:28.720838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.721367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.721808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.722265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lazy-loading 'fault' on Instance uuid ef536920-06ca-48da-a1ef-7bc6bce736ad {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:28.790221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '403b2dcf1b3f4e1fbead88207efa9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dacf31e1f0b4a4f9b27fc1f49006170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:28.803003 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0091ffd3-38c8-4310-9620-754599504c31 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 200 len: 1328 microversion: 2.1 time: 0.146906 Sep 03 20:49:28.804366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 127/252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:28 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 1328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:28.822526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:28.823279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:28.832855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.833385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.834404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.835137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:28.835788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:28.836374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:28.871445 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ece4ba4-3f95-47c5-a0ef-9236e70756df tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 204 len: 0 microversion: 2.1 time: 0.694303 Sep 03 20:49:28.873158 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 126/253] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:28 2022] DELETE /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:29.123058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:29.139568 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-542094f7-1e26-42e3-8946-1e67fad7120b tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1468 microversion: 2.1 time: 0.333852 Sep 03 20:49:29.140478 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 128/254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:28 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:29.154386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:29.155271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:29.166263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.167553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.168032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.168883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.169710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.170330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.256952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63bcb6a8-77e5-426c-ae86-786ce5301272 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Calling method '.version_select at 0x7fae67a4bc10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:29.493159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:29.501310 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48a47398-e435-456a-9325-eaa86d28fb11 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1475 microversion: 2.1 time: 0.351416 Sep 03 20:49:29.504271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 129/255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:29 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:29.508973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1842729459", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:29.581989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:29.610136 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63bcb6a8-77e5-426c-ae86-786ce5301272 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 371 microversion: 2.1 time: 0.731360 Sep 03 20:49:29.610804 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 127/256] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 20:49:28 2022] GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 371 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:29.623610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae6799d940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:29.714045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.714534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.715003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.716701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.718344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.718851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.735250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:29.803241 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c66298a1-58ef-4e2e-961b-440e5ea9433e tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 328 microversion: 2.1 time: 0.183759 Sep 03 20:49:29.805825 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 128/257] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:29 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:29.832325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:29.835887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:29.843568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.844492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.845148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.846096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.846751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.847360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:29.867329 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] HTTP exception thrown: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Request method failure captured: Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad HTTP/1.1 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72reFsqokjGCxI9YedroOLjq-hkBLEFgj4z-sCM2o8S_Ju_bdvnJdXU-4aEhHnBvAjsnjmFpD3Dy0pIqvTD-fDW-ICGSlCcaN4cjjb9JJquzDGcY9BWklR3cDB6XqB-WI7obt8MDZA2gEhFCAKzf7rwMyC2NFwcgGSpBh3006jbaT8 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:29.871297 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 403b2dcf1b3f4e1fbead88207efa9ea0 Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:29.873614 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ef536920-06ca-48da-a1ef-7bc6bce736ad'} Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:29.874382 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:29.875465 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:29.878349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Returning 404 to user: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:29.880146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a26fce01-51f3-4ddd-96bb-58c9c8b9cd87 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 404 len: 111 microversion: 2.1 time: 0.053925 Sep 03 20:49:29.881483 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 129/258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:29 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:29.892423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20c0ef0f-be96-4741-9d18-2fd2edbb4382 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:29.913305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20c0ef0f-be96-4741-9d18-2fd2edbb4382 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:29.915708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20c0ef0f-be96-4741-9d18-2fd2edbb4382 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:29.916582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20c0ef0f-be96-4741-9d18-2fd2edbb4382 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:30.028461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:30.029413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:30.029892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:30.030312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:30.030732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:30.046389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:30.046882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:30.047616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:30.052973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:30.053646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:30.054356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:30.065917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=88,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:30.093078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Getting quotas for project 993b7f76855c47e58427d7542a0f41c2. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:30.097042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20c0ef0f-be96-4741-9d18-2fd2edbb4382 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 297 microversion: 2.1 time: 0.211147 Sep 03 20:49:30.098199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 130/259] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:49:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 297 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:30.103304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Getting quotas for user 4c3a73b54fd54a23808657c7ed9e62cb and project 993b7f76855c47e58427d7542a0f41c2. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:30.126737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:49:30.130659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:49:30.207621 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-41cd5807-7b2c-402f-84f4-15be62655d2f tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700875 Sep 03 20:49:30.210845 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 130/260] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:49:30.221522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ede7b62-fd56-48d7-9466-b9c92f126057 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:30.262791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ede7b62-fd56-48d7-9466-b9c92f126057 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.048843 Sep 03 20:49:30.268341 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 131/261] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:30 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:30.274637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12e7b3d2-a76a-4339-8740-faf6749fe743 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:30.275506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12e7b3d2-a76a-4339-8740-faf6749fe743 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:30.350124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12e7b3d2-a76a-4339-8740-faf6749fe743 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:30.367888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12e7b3d2-a76a-4339-8740-faf6749fe743 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1219 microversion: 2.1 time: 0.096129 Sep 03 20:49:30.383780 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 132/262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:30 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:30.383968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-686204191", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:30.384062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25add20c-af50-49bf-8564-ef2c9686dba6 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1121543897"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:30.384062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-25add20c-af50-49bf-8564-ef2c9686dba6 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid fb16438d-2544-47a3-b17b-4c484a9467c8 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:30.435990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25add20c-af50-49bf-8564-ef2c9686dba6 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066370 Sep 03 20:49:30.449884 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 133/263] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:30.470557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:30.498205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:30.514894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:30.515582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:30.516156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:30.525890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:30.575318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:30.763279 ncdv-master-1 devstack@n-api.service[140520]: WARNING nova.scheduler.client.report [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] [req-3c71d56f-9414-4d60-8542-56b1b4e7ea2d] Failed to update aggregates to [fb16438d-2544-47a3-b17b-4c484a9467c8] for resource provider with UUID 84888147-675f-4a26-b80e-126fb4156f38. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-3c71d56f-9414-4d60-8542-56b1b4e7ea2d"}]} Sep 03 20:49:30.949741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80033b17-1ff2-4673-9056-aebe24eb2708 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.498620 Sep 03 20:49:30.951155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 134/264] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:49:30 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:30.982011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:30.982437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:30.996083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:30.996587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:30.997128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:30.997865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:30.998333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:30.998758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.110575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:31.111113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:31.112651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:31.113308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:31.113797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:31.150110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.160048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.161630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.166212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.168681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.172245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.254432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:31.261004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for user 627bcee7d4d244cf8af381923a0d906b and project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:31.299695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.utils [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] cores quota exceeded for 4196dbc6c42746ffab45efab01240e1e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140519) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 03 20:49:31.300580 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Request method failure captured: Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 144 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73XrgdU2z51wa_EKTfEGvT7VmvoCvGxAPJtm04btFz3R7FFVSiFs7oYhNdHJDKJ2ENb8IHNdB4_eyz_r1fJYM5P7-HbSHVqD6SdU5nr2v3Mw967u8QEWOABPPlA3YjEddy0arfLRoW1uH3q1PPEFSyl5uvH5p0ySkIajVgrn3uT-i0 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:31.304054 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 627bcee7d4d244cf8af381923a0d906b Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-686204191", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} Sep 03 20:49:31.305935 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-686204191', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452'}}} Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 03 20:49:31.306776 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:31.311111 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.312199 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc9778f2-0ffc-41c4-a6a9-4da5ea3c6c2e tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.206257 Sep 03 20:49:31.313426 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 131/265] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:30 2022] POST /compute/v2.1/servers => generated 111 bytes in 1208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:31.313914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:31.320433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93fca8d8-0bdf-4c56-8c5f-574559170acb tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:31.328330 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-502b5c84-1ace-4899-a0e1-237c1ceb7fad tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1475 microversion: 2.1 time: 0.368751 Sep 03 20:49:31.328949 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 135/266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:30 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:31.333460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae676ecd30>, body: {"quota_set": {"cores": 20}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:31.337658 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93fca8d8-0bdf-4c56-8c5f-574559170acb tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.029826 Sep 03 20:49:31.349400 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 132/267] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:49:31 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:31.359945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-069c11d3-9d52-49a6-ba3c-17d27960c663 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:31.375687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-069c11d3-9d52-49a6-ba3c-17d27960c663 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.376226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-069c11d3-9d52-49a6-ba3c-17d27960c663 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.376613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-069c11d3-9d52-49a6-ba3c-17d27960c663 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.589038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-069c11d3-9d52-49a6-ba3c-17d27960c663 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.232856 Sep 03 20:49:31.589936 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 133/268] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:49:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:31.597194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:31.597850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:31.615143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.615646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.616094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.619859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.620586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.621309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.785705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:31.791804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.792869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.793504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.795255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.796223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.797451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.798372 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3f66056-a18b-4f13-bbfa-457213fc2a24 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1271 microversion: 2.1 time: 0.206787 Sep 03 20:49:31.813971 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 134/269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:31 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:31.826754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be2b2e-c86c-4cbe-b6c1-756c58c7698e", "name": "network-vif-deleted", "tag": "24caafa8-d397-458f-87e1-4d7863d49497"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:31.847928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:31.848774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:31.849771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:31.890131 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] Creating event network-vif-deleted:24caafa8-d397-458f-87e1-4d7863d49497 for instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e on nch1-master-1 Sep 03 20:49:31.903079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4e93a1cb-f4b5-4378-97f9-d19c59ea5e25 req-4cb54316-9eae-43cd-b18d-aa3605752b7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085185 Sep 03 20:49:31.904023 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 135/270] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:31.910671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0761eeb4-8e2d-4047-92ac-3f06aafdb384 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:31.944080 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f8fa59e-1490-4410-824e-168fcf05867a tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 329 microversion: 2.1 time: 0.613732 Sep 03 20:49:31.955707 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 136/271] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:31 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 329 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:31.975190 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0761eeb4-8e2d-4047-92ac-3f06aafdb384 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.057873 Sep 03 20:49:31.976035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 136/272] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:31 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:31.992256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11a1a32d-ba69-422c-b03c-fe10a4be1707 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Calling method '.version_select at 0x7fae676d1160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:31.997782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0068ec41-2684-4e72-baef-836900e0c14a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1240230320"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.003003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-0068ec41-2684-4e72-baef-836900e0c14a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid e0cdc4e4-aa86-4e79-8a09-4f4a1354456c for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:32.072340 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0068ec41-2684-4e72-baef-836900e0c14a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081848 Sep 03 20:49:32.073286 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 137/273] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:32.096608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-872e58da-56c6-424b-9bd8-096cfcc764a9 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.127854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-872e58da-56c6-424b-9bd8-096cfcc764a9 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.135186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-872e58da-56c6-424b-9bd8-096cfcc764a9 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.135843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-872e58da-56c6-424b-9bd8-096cfcc764a9 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.142802 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11a1a32d-ba69-422c-b03c-fe10a4be1707 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 371 microversion: 2.1 time: 0.185778 Sep 03 20:49:32.150806 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 20:49:31 2022] GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.156677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae676c85e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.261954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.264087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.266830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.267901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.268532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.271013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.295901 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-872e58da-56c6-424b-9bd8-096cfcc764a9 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.212185 Sep 03 20:49:32.296993 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 138/275] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:49:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.307875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1eab1892-f479-4280-adb8-c023db7f177f tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:32.321027 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1eab1892-f479-4280-adb8-c023db7f177f tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.016958 Sep 03 20:49:32.322004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 139/276] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:49:32 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.334292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2054683-8a81-4a36-9839-504b820c4f97 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.348235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2054683-8a81-4a36-9839-504b820c4f97 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.349107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2054683-8a81-4a36-9839-504b820c4f97 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.349694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2054683-8a81-4a36-9839-504b820c4f97 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.390959 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-710a9e16-2f32-456e-8edd-ccb262d0bc10 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 328 microversion: 2.1 time: 0.238571 Sep 03 20:49:32.392767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 138/277] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:32 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 328 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.399113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:32.400027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:32.410788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.411749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.412416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.413291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.413859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.414435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.461763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.462803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.463820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.464495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 74be2b2e-c86c-4cbe-b6c1-756c58c7698e {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:32.526325 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2054683-8a81-4a36-9839-504b820c4f97 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.195804 Sep 03 20:49:32.527179 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 140/278] 10.222.0.16 () {60 vars in 1191 bytes} [Sat Sep 3 20:49:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:32.539895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc7b4663-1683-47a2-9b91-d801154eca7a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:32.573676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:32.586787 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc7b4663-1683-47a2-9b91-d801154eca7a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.051030 Sep 03 20:49:32.587616 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 141/279] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:32 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:32.589656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-490bcdec-77b0-402f-b992-58171f96057d tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 200 len: 1309 microversion: 2.1 time: 0.194729 Sep 03 20:49:32.597085 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 139/280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:32 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:32.603856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af18f789-9e92-42e7-8da9-c6774ac8752b tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-12146431"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.607535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-af18f789-9e92-42e7-8da9-c6774ac8752b tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 1101f1d5-9d51-4db9-b8b9-e5988d828928 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:32.612591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-543276359", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.652980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af18f789-9e92-42e7-8da9-c6774ac8752b tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054374 Sep 03 20:49:32.654082 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 140/281] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.671199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26f24704-0a5d-43b2-a49d-031247ebe7db tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:32.687758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:32.691291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26f24704-0a5d-43b2-a49d-031247ebe7db tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.691881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26f24704-0a5d-43b2-a49d-031247ebe7db tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.692533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26f24704-0a5d-43b2-a49d-031247ebe7db tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.840350 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26f24704-0a5d-43b2-a49d-031247ebe7db tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 241 microversion: 2.1 time: 0.176227 Sep 03 20:49:32.849055 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 141/282] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:32 2022] POST /compute/v2.1/os-aggregates/10/action => generated 241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:32.855053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:32.856536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:32.863352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.864058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.864653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.865547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:32.866180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:32.866911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:32.996230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:33.009133 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78f733ae-d8ad-4f6b-b050-2e4104fe5838 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1277 microversion: 2.1 time: 0.158612 Sep 03 20:49:33.013026 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 142/283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:32 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:33.017284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56bd0307-f60e-4f1c-8748-5b37ad0e6d88 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.038978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56bd0307-f60e-4f1c-8748-5b37ad0e6d88 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.039809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56bd0307-f60e-4f1c-8748-5b37ad0e6d88 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.040875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56bd0307-f60e-4f1c-8748-5b37ad0e6d88 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.133554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:33.134063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:33.134443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:33.134860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:33.135280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:33.154318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.155514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.156702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.158741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.161768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.165305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.214383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:33.239405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for user 627bcee7d4d244cf8af381923a0d906b and project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:33.279697 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56bd0307-f60e-4f1c-8748-5b37ad0e6d88 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 226 microversion: 2.1 time: 0.266547 Sep 03 20:49:33.289110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 143/284] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 226 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:33.289484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.utils [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] instances quota exceeded for 4196dbc6c42746ffab45efab01240e1e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140519) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 03 20:49:33.290923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Request method failure captured: Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 144 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73XrgdU2z51wa_EKTfEGvT7VmvoCvGxAPJtm04btFz3R7FFVSiFs7oYhNdHJDKJ2ENb8IHNdB4_eyz_r1fJYM5P7-HbSHVqD6SdU5nr2v3Mw967u8QEWOABPPlA3YjEddy0arfLRoW1uH3q1PPEFSyl5uvH5p0ySkIajVgrn3uT-i0 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:33.295426 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 627bcee7d4d244cf8af381923a0d906b Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-543276359", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} Sep 03 20:49:33.296855 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-543276359', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452'}}} Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 03 20:49:33.297816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.299002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.300273 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 03 20:49:33.301569 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.303237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:33.303364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-979a1787-9f46-4df7-98a9-def9872a5620 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.307632 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dab50511-fc91-4db3-82d1-6b5588260809 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.718957 Sep 03 20:49:33.308520 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 142/285] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:32 2022] POST /compute/v2.1/servers => generated 119 bytes in 720 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:33.327323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae677fb430>, body: {"quota_set": {"instances": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.368335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-979a1787-9f46-4df7-98a9-def9872a5620 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.072981 Sep 03 20:49:33.376606 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 144/286] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:33 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:33.400399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-daad75e5-0276-4318-8f7f-7083fb704cd2 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-25624115"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.409760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-daad75e5-0276-4318-8f7f-7083fb704cd2 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 31c56f31-15e2-4b47-ae11-2d722000e40f for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:33.454179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-daad75e5-0276-4318-8f7f-7083fb704cd2 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067512 Sep 03 20:49:33.456108 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 145/287] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:33.467885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-de89fa88-b266-4b95-a10e-a49c1f4b4205 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-724143915"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.480595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-de89fa88-b266-4b95-a10e-a49c1f4b4205 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Generated uuid 828495d0-2faf-41f8-af85-db24f8d8dc0c for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:33.491803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.492291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.492729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.500747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.501353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.501810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.535374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-de89fa88-b266-4b95-a10e-a49c1f4b4205 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.077555 Sep 03 20:49:33.537508 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 146/288] 10.222.0.16 () {62 vars in 1205 bytes} [Sat Sep 3 20:49:33 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:33.543303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e6fae5db-8195-4939-866b-d4944f62fd64 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.572740 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e6fae5db-8195-4939-866b-d4944f62fd64 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.033005 Sep 03 20:49:33.573825 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 147/289] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:33 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:33.588254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2fa58b5d-23f2-4440-8f1a-5c5694bb9251 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-993305608"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.673546 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37e4d0fc-260c-4e26-9e1b-656b56b9f953 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 329 microversion: 2.1 time: 0.358614 Sep 03 20:49:33.683865 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 143/290] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:33 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 329 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:33.690645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0c196ff-cbe8-4ef3-8b3a-ef482bb49383 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.703318 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d0c196ff-cbe8-4ef3-8b3a-ef482bb49383 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0c196ff-cbe8-4ef3-8b3a-ef482bb49383 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Request method failure captured: Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72tLR3fVtJ5YGN2SIxSZB3uSiAdJXQ-m3QUxPs-eJQyncl9zincVUxj0PJI4EQbm-nZaWT2E2AEYDcnjIPtxmbjQ2k0tcClUXtluEu-q7DRnbmpKzZ2n01H4QgjvwZ8FLa7rbPu3JPOdlLuCz1MV64fi9ZTJeXbo5ng4ZkL57jvNLQ Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:33.705681 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 57bb8fae155a469a972a4feddbfffbb6 Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: exception: Aggregate 11 could not be found. Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '11'} Sep 03 20:49:33.706878 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.707584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 03 20:49:33.708598 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.714131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0c196ff-cbe8-4ef3-8b3a-ef482bb49383 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:33.717888 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0c196ff-cbe8-4ef3-8b3a-ef482bb49383 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.031029 Sep 03 20:49:33.719262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:33 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:33.725625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.726525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:33.736157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.737021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.737512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.738703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:33.739283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:33.739718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:33.787090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e HTTP/1.1 Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:33.788667 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:49:33.790113 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '74be2b2e-c86c-4cbe-b6c1-756c58c7698e'} Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:33.790900 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:49:33.792164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.793420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:33.793420 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5dfd90a-c5e1-4933-96db-6ab7fa0b5b0e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 404 len: 111 microversion: 2.1 time: 0.071477 Sep 03 20:49:33.794170 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 145/292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:33 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:33.801309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-085cb1d9-e76f-4229-958e-200258b6713d tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Calling method '.version_select at 0x7fae67a4b8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.839797 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2fa58b5d-23f2-4440-8f1a-5c5694bb9251 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.264741 Sep 03 20:49:33.840403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 148/293] 10.222.0.16 () {62 vars in 1213 bytes} [Sat Sep 3 20:49:33 2022] PUT /compute/v2.1/os-aggregates/12 => generated 299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:33.865128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4229bb55-a405-4f00-97c6-dbe8b293ad94 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.905224 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4229bb55-a405-4f00-97c6-dbe8b293ad94 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4229bb55-a405-4f00-97c6-dbe8b293ad94 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Request method failure captured: Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72tLR3fVtJ5YGN2SIxSZB3uSiAdJXQ-m3QUxPs-eJQyncl9zincVUxj0PJI4EQbm-nZaWT2E2AEYDcnjIPtxmbjQ2k0tcClUXtluEu-q7DRnbmpKzZ2n01H4QgjvwZ8FLa7rbPu3JPOdlLuCz1MV64fi9ZTJeXbo5ng4ZkL57jvNLQ Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:33.909917 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 57bb8fae155a469a972a4feddbfffbb6 Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: exception: Aggregate 11 could not be found. Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '11'} Sep 03 20:49:33.911132 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:33.912023 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:33.913232 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4229bb55-a405-4f00-97c6-dbe8b293ad94 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4229bb55-a405-4f00-97c6-dbe8b293ad94 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.065222 Sep 03 20:49:33.915856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 149/294] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:33 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:33.925092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-061a8a93-e17e-469f-9ed3-cddf321283fd tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:33.939510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-061a8a93-e17e-469f-9ed3-cddf321283fd tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.023825 Sep 03 20:49:33.940653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 150/295] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:49:33 2022] GET /compute/v2.1/os-aggregates/12 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:33.945359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e4dc1b7-3a56-4858-81c7-25688b01f95a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1067623869", "name": "tempest-test_aggregate-1931232587"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:33.949883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-0e4dc1b7-3a56-4858-81c7-25688b01f95a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 487a9e59-9557-4472-b381-06c340cd65ed for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:33.961621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:33.968049 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-085cb1d9-e76f-4229-958e-200258b6713d tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 371 microversion: 2.1 time: 0.172729 Sep 03 20:49:33.969051 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 146/296] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 20:49:33 2022] GET /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:33.978906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc07363d-a0fd-4ee6-983b-faabea46afc3 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:34.004760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc07363d-a0fd-4ee6-983b-faabea46afc3 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.005305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc07363d-a0fd-4ee6-983b-faabea46afc3 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.005758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc07363d-a0fd-4ee6-983b-faabea46afc3 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:34.011282 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e4dc1b7-3a56-4858-81c7-25688b01f95a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.069236 Sep 03 20:49:34.013792 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 151/297] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Sep 3 20:49:33 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:34.020054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae67a6d550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:34.046245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:34.146132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.146720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.147275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:34.148880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.149858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.150412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:34.221961 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-881d9801-e37a-49a8-af26-2b67932097c5 tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 325 microversion: 2.1 time: 0.205566 Sep 03 20:49:34.248677 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 152/298] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:34 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 325 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:34.249868 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc07363d-a0fd-4ee6-983b-faabea46afc3 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 314 microversion: 2.41 time: 0.279990 Sep 03 20:49:34.250446 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 147/299] 10.222.0.16 () {62 vars in 1235 bytes} [Sat Sep 3 20:49:33 2022] POST /compute/v2.1/os-aggregates/12/action => generated 314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:34.262301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:34.263479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:34.279078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7884b736-cb83-4e5c-bc70-477b552188a7 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:34.280533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.281073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.281514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:34.282352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.283073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.283570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:34.327813 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7884b736-cb83-4e5c-bc70-477b552188a7 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.066863 Sep 03 20:49:34.331277 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 153/300] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:34 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:34.336541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1286426542", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:34.424670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:34.787011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:34.809548 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2bdb459d-5a7e-4f48-84cd-8bbce25cae80 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 0.549549 Sep 03 20:49:34.810246 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 148/301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:34 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:34.815752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a873b178-5f98-43b4-bd17-246d4e329206 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:34.856301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a873b178-5f98-43b4-bd17-246d4e329206 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:34.860416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a873b178-5f98-43b4-bd17-246d4e329206 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:34.861313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a873b178-5f98-43b4-bd17-246d4e329206 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.031259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a873b178-5f98-43b4-bd17-246d4e329206 tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 299 microversion: 2.41 time: 0.219188 Sep 03 20:49:35.032106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 149/302] 10.222.0.16 () {62 vars in 1235 bytes} [Sat Sep 3 20:49:34 2022] POST /compute/v2.1/os-aggregates/12/action => generated 299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:35.037083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343874299", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:35.100429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:35.167180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:35.169470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:35.171186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:35.172959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:35.175034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:35.196251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.198559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.200670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.202689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.203565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.204347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.237846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Getting quotas for project 123134ed03c540b79122e8ecaa021d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:35.244627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Getting quotas for user c34f1d07f48c4b4dadf97fd38709fd33 and project 123134ed03c540b79122e8ecaa021d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:35.283036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:49:35.289196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:49:35.423125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-54302782-1748-4115-af94-13c44be830d5 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082837 Sep 03 20:49:35.424225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 154/303] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:49:35.436263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a6c1b8f-2405-4c25-867c-6d0276b7635a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:35.451649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-0a6c1b8f-2405-4c25-867c-6d0276b7635a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 03 20:49:35.461699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:35.462195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:35.462959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:35.463627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:35.464273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a6c1b8f-2405-4c25-867c-6d0276b7635a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Request method failure captured: Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72tLR3fVtJ5YGN2SIxSZB3uSiAdJXQ-m3QUxPs-eJQyncl9zincVUxj0PJI4EQbm-nZaWT2E2AEYDcnjIPtxmbjQ2k0tcClUXtluEu-q7DRnbmpKzZ2n01H4QgjvwZ8FLa7rbPu3JPOdlLuCz1MV64fi9ZTJeXbo5ng4ZkL57jvNLQ Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:35.469981 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 57bb8fae155a469a972a4feddbfffbb6 Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: exception: Aggregate 13 could not be found. Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '13'} Sep 03 20:49:35.471355 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.472138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 03 20:49:35.473896 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.474924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a6c1b8f-2405-4c25-867c-6d0276b7635a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:35.474924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a6c1b8f-2405-4c25-867c-6d0276b7635a tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.046701 Sep 03 20:49:35.479724 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 155/304] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:35 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:35.486775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.487453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.488720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.489189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ead03435-2175-4d50-af3e-e9561f46c3ba tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:35.490119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.490582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.491013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.527603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:35.536163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ead03435-2175-4d50-af3e-e9561f46c3ba tempest-AggregatesAdminTestV241-539716765 tempest-AggregatesAdminTestV241-539716765-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.055113 Sep 03 20:49:35.542759 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 156/305] 10.222.0.16 () {60 vars in 1196 bytes} [Sat Sep 3 20:49:35 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:35.547569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835e6659-8e59-453f-8da0-68800d445466", "tag": "d4d8999e-5504-4122-a8d3-8f14502c1c0c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:35.561963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Getting quotas for user 627bcee7d4d244cf8af381923a0d906b and project 4196dbc6c42746ffab45efab01240e1e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:35.574639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.575735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.577082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.597500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.utils [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] ram quota exceeded for 4196dbc6c42746ffab45efab01240e1e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140519) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 03 20:49:35.598052 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Request method failure captured: Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 144 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73XrgdU2z51wa_EKTfEGvT7VmvoCvGxAPJtm04btFz3R7FFVSiFs7oYhNdHJDKJ2ENb8IHNdB4_eyz_r1fJYM5P7-HbSHVqD6SdU5nr2v3Mw967u8QEWOABPPlA3YjEddy0arfLRoW1uH3q1PPEFSyl5uvH5p0ySkIajVgrn3uT-i0 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:35.600642 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 627bcee7d4d244cf8af381923a0d906b Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343874299", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} Sep 03 20:49:35.601932 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-343874299', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452'}}} Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 03 20:49:35.602689 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.603650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.607874 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22fe925c-1e6e-4744-a212-ea5e40029cca tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.569113 Sep 03 20:49:35.610622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 150/306] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:35 2022] POST /compute/v2.1/servers => generated 110 bytes in 571 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:35.616645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-05ed1f9a-082f-4db6-8afb-cacf0324b366 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:35.617305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-05ed1f9a-082f-4db6-8afb-cacf0324b366 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:35.624838 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] Creating event network-changed:d4d8999e-5504-4122-a8d3-8f14502c1c0c for instance 835e6659-8e59-453f-8da0-68800d445466 on nch2-master-1 Sep 03 20:49:35.633319 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-02c61883-5b71-437c-afdf-16393c7ff080 req-57c55a28-6a8e-4d7b-af9c-eb4075a0b102 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089001 Sep 03 20:49:35.634126 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 157/307] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:35.639840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eff94dc6-2848-4fbe-8168-311f58d25ef3 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:35.651870 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-eff94dc6-2848-4fbe-8168-311f58d25ef3 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eff94dc6-2848-4fbe-8168-311f58d25ef3 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Request method failure captured: Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72tLR3fVtJ5YGN2SIxSZB3uSiAdJXQ-m3QUxPs-eJQyncl9zincVUxj0PJI4EQbm-nZaWT2E2AEYDcnjIPtxmbjQ2k0tcClUXtluEu-q7DRnbmpKzZ2n01H4QgjvwZ8FLa7rbPu3JPOdlLuCz1MV64fi9ZTJeXbo5ng4ZkL57jvNLQ Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:35.654259 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/76995bf5b0394ecf93109e9dc87b8219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 76995bf5b0394ecf93109e9dc87b8219 Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1257631735 Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 57bb8fae155a469a972a4feddbfffbb6 Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminTestJSON-1257631735-project-admin Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: exception: Aggregate 13 could not be found. Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '13'} Sep 03 20:49:35.655614 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:35.656401 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:35.657446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:35.658512 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:35.658512 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:35.658512 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:35.658512 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 03 20:49:35.658512 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:35.660968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eff94dc6-2848-4fbe-8168-311f58d25ef3 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:35.662454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eff94dc6-2848-4fbe-8168-311f58d25ef3 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.027175 Sep 03 20:49:35.663470 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 158/308] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:35 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:35.669419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Action: 'update', calling method: .version_select at 0x7fae676ec0d0>, body: {"quota_set": {"ram": 51200}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:35.765946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-05ed1f9a-082f-4db6-8afb-cacf0324b366 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:35.781472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-05ed1f9a-082f-4db6-8afb-cacf0324b366 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1220 microversion: 2.1 time: 0.176064 Sep 03 20:49:35.796474 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 151/309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:35 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:35.796474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-024d79ee-04de-4b10-b856-8ef7708d29ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1238461108"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:35.805305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-024d79ee-04de-4b10-b856-8ef7708d29ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid d37064b2-1656-4566-8446-b67dc8df710d for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:35.857035 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-024d79ee-04de-4b10-b856-8ef7708d29ab tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071099 Sep 03 20:49:35.859225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 152/310] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:35.865573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d06e825-d347-4e8c-8deb-29b1a7e09dee tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-584789880"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:35.869920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-8d06e825-d347-4e8c-8deb-29b1a7e09dee tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 67b70942-40e3-48b0-aaa6-57cc062460d9 for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:35.895973 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d06e825-d347-4e8c-8deb-29b1a7e09dee tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035128 Sep 03 20:49:35.896571 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 153/311] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:35.902267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:35.904760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:35.912385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.913122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.913748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:35.914652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:35.915268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:35.915856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.334894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:36.349232 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04248ee5-5171-4ae9-bc84-b8e4564bf224 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 0.451142 Sep 03 20:49:36.350094 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 154/312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:35 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:36.364197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a65d7008-8845-48ca-b096-6a3b288e8911 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:36.388269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a65d7008-8845-48ca-b096-6a3b288e8911 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.389069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a65d7008-8845-48ca-b096-6a3b288e8911 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.390335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a65d7008-8845-48ca-b096-6a3b288e8911 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.473958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.474510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.474879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.476137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.476810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.479185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.584869 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a65d7008-8845-48ca-b096-6a3b288e8911 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 243 microversion: 2.1 time: 0.232775 Sep 03 20:49:36.593243 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 155/313] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:36 2022] POST /compute/v2.1/os-aggregates/14/action => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:36.593243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c5031c4-bcff-459c-8089-5226cbbe52ac tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:36.603976 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c5031c4-bcff-459c-8089-5226cbbe52ac tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.017082 Sep 03 20:49:36.604776 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 156/314] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:36 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:36.614775 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce8e05a0-6339-4b24-bf8c-8e6e26b6424b tempest-QuotasAdminNegativeTest-2135470950 tempest-QuotasAdminNegativeTest-2135470950-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 200 len: 329 microversion: 2.1 time: 0.950016 Sep 03 20:49:36.615514 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 159/315] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:35 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 329 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:36.619094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea391769-bebd-43dd-a668-84612915573d tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:36.624602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea391769-bebd-43dd-a668-84612915573d tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '4aa6221685824a758e0b8df8ed0d7dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b3649ee46d439d9dccdb7ef0e27291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:36.631876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82320a7b-706c-408f-b614-d92489580ac8 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea391769-bebd-43dd-a668-84612915573d tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Request method failure captured: Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 42 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72psZrJKyrc78_Q6_MRoPvfr2hgZFShgBnpu71OW00dzw6qVBFWg25fBCQ3H38Icqpop_zbnxhGPY0pAspBDaxkWCg81ubmD_60GS67W0HRY1tJeTP7oNe11i53-rRdCmWRKt4-uWNUUnPfSmli6z6zK2QTXXMTDHREn9bulX7ASt4 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:36.633034 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90b3649ee46d439d9dccdb7ef0e27291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90b3649ee46d439d9dccdb7ef0e27291 Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-909182933 Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4aa6221685824a758e0b8df8ed0d7dca Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-909182933-project Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: {"remove_host": {"host": "nch2-master-1"}} Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:36.634231 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:36.634956 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 03 20:49:36.635950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.649743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea391769-bebd-43dd-a668-84612915573d tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:36.649743 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea391769-bebd-43dd-a668-84612915573d tempest-AggregatesAdminNegativeTestJSON-909182933 tempest-AggregatesAdminNegativeTestJSON-909182933-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/14/action" status: 403 len: 121 microversion: 2.1 time: 0.038429 Sep 03 20:49:36.656639 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 157/316] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:36 2022] POST /compute/v2.1/os-aggregates/14/action => generated 121 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:36.670750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4f33757-82cd-4b46-8865-3062737a34e6 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Action: 'update', calling method: .version_select at 0x7fae677f44c0>, body: {"quota_set": {"ram": 0}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:36.679376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4f33757-82cd-4b46-8865-3062737a34e6 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '627bcee7d4d244cf8af381923a0d906b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4196dbc6c42746ffab45efab01240e1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4f33757-82cd-4b46-8865-3062737a34e6 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Request method failure captured: Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e HTTP/1.1 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 25 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73XrgdU2z51wa_EKTfEGvT7VmvoCvGxAPJtm04btFz3R7FFVSiFs7oYhNdHJDKJ2ENb8IHNdB4_eyz_r1fJYM5P7-HbSHVqD6SdU5nr2v3Mw967u8QEWOABPPlA3YjEddy0arfLRoW1uH3q1PPEFSyl5uvH5p0ySkIajVgrn3uT-i0 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:36.681609 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4196dbc6c42746ffab45efab01240e1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 4196dbc6c42746ffab45efab01240e1e Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-898988382 Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 627bcee7d4d244cf8af381923a0d906b Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-QuotasAdminNegativeTest-898988382-project Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: {"quota_set": {"ram": 0}} Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 03 20:49:36.682784 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4196dbc6c42746ffab45efab01240e1e', 'body': {'quota_set': {'ram': 0}}} Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:36.683541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.684651 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4f33757-82cd-4b46-8865-3062737a34e6 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4f33757-82cd-4b46-8865-3062737a34e6 tempest-QuotasAdminNegativeTest-898988382 tempest-QuotasAdminNegativeTest-898988382-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e" status: 403 len: 116 microversion: 2.1 time: 0.025388 Sep 03 20:49:36.687402 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 158/317] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:36 2022] PUT /compute/v2.1/os-quota-sets/4196dbc6c42746ffab45efab01240e1e => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:36.692328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27b750b3-807b-4b1f-a594-95e85eabe0ac tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:36.695287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82320a7b-706c-408f-b614-d92489580ac8 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.078467 Sep 03 20:49:36.696732 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 160/318] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:36 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:36.720879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27b750b3-807b-4b1f-a594-95e85eabe0ac tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.721423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27b750b3-807b-4b1f-a594-95e85eabe0ac tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.721868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27b750b3-807b-4b1f-a594-95e85eabe0ac tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.727618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2fb6ccd2-fb3b-48c4-953b-004b5b7e6a7e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:36.753434 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2fb6ccd2-fb3b-48c4-953b-004b5b7e6a7e tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.046922 Sep 03 20:49:36.755393 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 161/319] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:49:36 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:36.768991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0813a46b-d622-4b29-be00-f2c3695389c2 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:36.888467 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0813a46b-d622-4b29-be00-f2c3695389c2 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.117519 Sep 03 20:49:36.897451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 162/320] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:36 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:36.911530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:36.912594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:36.936639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.937215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.938419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:36.939461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:36.939943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:36.940382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.004933 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27b750b3-807b-4b1f-a594-95e85eabe0ac tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 228 microversion: 2.1 time: 0.312250 Sep 03 20:49:37.013725 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 159/321] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:36 2022] POST /compute/v2.1/os-aggregates/14/action => generated 228 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.013725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56eb314b-64bf-4b4a-928a-b4c2f726fc43 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1291303212", "availability_zone": "tempest-test_az-1132105182"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:37.055358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-56eb314b-64bf-4b4a-928a-b4c2f726fc43 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid 19c1ecf7-af37-43ce-ac4d-561326a04df1 for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:37.104584 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56eb314b-64bf-4b4a-928a-b4c2f726fc43 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.095303 Sep 03 20:49:37.105314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 160/322] 10.222.0.16 () {60 vars in 1165 bytes} [Sat Sep 3 20:49:37 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.111046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3136961-97bb-49a0-acaa-626ab118e54f tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.176377 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3136961-97bb-49a0-acaa-626ab118e54f tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.060088 Sep 03 20:49:37.182130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:37 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:37.201918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-acc28efa-cef3-4465-b7b5-0edce7c1d877 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1291303212_new", "availability_zone": "tempest-test_az-1132105182_new"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:37.247984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:37.259112 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b03f33d-b419-4c1d-b5d5-0a5a88cb82a0 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1272 microversion: 2.1 time: 0.358608 Sep 03 20:49:37.269728 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:36 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:37.281673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d18eae4-24dc-4705-9c4c-6fb5904615aa tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373827594"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:37.291482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-9d18eae4-24dc-4705-9c4c-6fb5904615aa tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Generated uuid 2369598f-2ba1-44ad-b7fd-92204f619219 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:37.342756 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d18eae4-24dc-4705-9c4c-6fb5904615aa tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070268 Sep 03 20:49:37.343354 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 164/325] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.366659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:37.390199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.391518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.392251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.408068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.409135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.409881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.434076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acc28efa-cef3-4465-b7b5-0edce7c1d877 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.434473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acc28efa-cef3-4465-b7b5-0edce7c1d877 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.438198 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.compute.aggregates [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 03 20:49:37.439645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acc28efa-cef3-4465-b7b5-0edce7c1d877 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.447828 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Request method failure captured: Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 42 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72rpajwjB_OR1HAcWhydRutCKjo6o2-SFCfxme34T-yyhfr-aM9LPKQC8O77dvqMINY_mEBphTGNP45qvmFTzsRJW2QwabHw5R6PoD_8IbVXr2C_pNzqj9fh9B2jwNx5P-7rRdKL3YJE4is8g0wiqx_5Gb_-coNspzsuidoJJ-vSVE Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:49:37.453202 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0ecb6d714e9f4670ab6a27cac2269f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0ecb6d714e9f4670ab6a27cac2269f96 Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464 Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 622edda288714384a6a7aefae0c5be77 Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: {"remove_host": {"host": "nonexist_host"}} Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:37.454510 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot remove host nonexist_host in aggregate 17 Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 03 20:49:37.455389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 03 20:49:37.456560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.457812 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Sep 03 20:49:37.458985 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.467143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:37.469189 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd2eefad-85dc-42a0-b4b3-63b31dea34ed tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.118091 Sep 03 20:49:37.474003 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 165/326] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 20:49:37 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 20:49:37.483462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.484638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:37.491661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.492432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.493168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.494391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.495626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.496882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.513527 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-acc28efa-cef3-4465-b7b5-0edce7c1d877 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.329608 Sep 03 20:49:37.515301 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 162/327] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 20:49:37 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.528170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76929e8b-02db-4055-9184-5eb4f4828865 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.571620 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76929e8b-02db-4055-9184-5eb4f4828865 tempest-AggregatesAdminNegativeTestJSON-1217810464 tempest-AggregatesAdminNegativeTestJSON-1217810464-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055193 Sep 03 20:49:37.572396 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 163/328] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:37 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:37.588362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc7b7e90-4892-4a72-812e-212ce31a99d0 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.613489 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc7b7e90-4892-4a72-812e-212ce31a99d0 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.035180 Sep 03 20:49:37.615790 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 164/329] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:49:37 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.631564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bad80cb4-6866-4f33-a78c-0d5b9131ab6d tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.695600 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bad80cb4-6866-4f33-a78c-0d5b9131ab6d tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.071121 Sep 03 20:49:37.698925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 165/330] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:37 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:37.711341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3df710a6-d3b9-4af6-a8b0-c02d2ee80a82 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-718044651"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:37.724261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.aggregate [None req-3df710a6-d3b9-4af6-a8b0-c02d2ee80a82 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Generated uuid e6cc291c-0a2c-450a-8bb7-af78155b695f for aggregate {{(pid=140519) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 20:49:37.782878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3df710a6-d3b9-4af6-a8b0-c02d2ee80a82 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078230 Sep 03 20:49:37.786603 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 166/331] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 20:49:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:37.798511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b9a7ac8-a358-4786-b0c0-bad82f13c157 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.817450 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b9a7ac8-a358-4786-b0c0-bad82f13c157 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.023027 Sep 03 20:49:37.821110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 167/332] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:49:37 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:37.829695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7638b2d-14ae-4e18-a5d1-39dfbd350400 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.864398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=83,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:37.885292 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7638b2d-14ae-4e18-a5d1-39dfbd350400 tempest-AggregatesAdminTestJSON-1257631735 tempest-AggregatesAdminTestJSON-1257631735-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.059177 Sep 03 20:49:37.886564 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 168/333] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:49:37 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:37.896520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:37.901643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:37.918465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.924984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.927148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.928125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:37.929747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:37.930815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:37.978488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] HTTP exception thrown: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Request method failure captured: Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad HTTP/1.1 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72reFsqokjGCxI9YedroOLjq-hkBLEFgj4z-sCM2o8S_Ju_bdvnJdXU-4aEhHnBvAjsnjmFpD3Dy0pIqvTD-fDW-ICGSlCcaN4cjjb9JJquzDGcY9BWklR3cDB6XqB-WI7obt8MDZA2gEhFCAKzf7rwMyC2NFwcgGSpBh3006jbaT8 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:37.995842 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 403b2dcf1b3f4e1fbead88207efa9ea0 Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:37.997392 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ef536920-06ca-48da-a1ef-7bc6bce736ad'} Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:37.998047 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:37.999118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.000186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Returning 404 to user: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:38.001395 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c3aef4a-9612-4cf3-8ae1-abfa7d067452 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 404 len: 111 microversion: 2.1 time: 0.108869 Sep 03 20:49:38.004397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:37 2022] DELETE /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:38.024703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:38.026290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] [instance: ef536920-06ca-48da-a1ef-7bc6bce736ad] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:38.044809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:38.047028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:38.048555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:38.051143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:38.052291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:38.053499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:38.099916 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] HTTP exception thrown: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Request method failure captured: Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad HTTP/1.1 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72reFsqokjGCxI9YedroOLjq-hkBLEFgj4z-sCM2o8S_Ju_bdvnJdXU-4aEhHnBvAjsnjmFpD3Dy0pIqvTD-fDW-ICGSlCcaN4cjjb9JJquzDGcY9BWklR3cDB6XqB-WI7obt8MDZA2gEhFCAKzf7rwMyC2NFwcgGSpBh3006jbaT8 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:38.106271 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dacf31e1f0b4a4f9b27fc1f49006170"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 1dacf31e1f0b4a4f9b27fc1f49006170 Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-225937968 Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 403b2dcf1b3f4e1fbead88207efa9ea0 Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AggregatesAdminTestJSON-225937968-project Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:38.108011 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ef536920-06ca-48da-a1ef-7bc6bce736ad'} Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:38.108641 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. Sep 03 20:49:38.109741 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:38.110680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] Returning 404 to user: Instance ef536920-06ca-48da-a1ef-7bc6bce736ad could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:38.111455 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b8233bf-55fc-4555-8a5d-7ed4503d5269 tempest-AggregatesAdminTestJSON-225937968 tempest-AggregatesAdminTestJSON-225937968-project] 10.222.0.16 "GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad" status: 404 len: 111 microversion: 2.1 time: 0.104422 Sep 03 20:49:38.112449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 170/335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:38 2022] GET /compute/v2.1/servers/ef536920-06ca-48da-a1ef-7bc6bce736ad => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:49:38.212258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:38.223464 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d64622f9-43c0-4978-9676-d29ab0e54200 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 0.746723 Sep 03 20:49:38.226579 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 166/336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:37 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:38.284696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:38.285652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:38.295082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:38.295973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:38.297144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:38.298232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:38.299064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:38.300955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:38.452205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:38.465403 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73a0fbcf-c3d9-44e4-84ea-2fa29e36ed9e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1278 microversion: 2.1 time: 0.183079 Sep 03 20:49:38.467893 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 171/337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:38 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:39.248395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:39.249699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:39.259368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:39.265673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:39.266146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:39.266912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:39.267363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:39.267793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:39.490413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:39.491736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:39.503418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:39.504881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:39.506866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:39.510565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:39.511177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:39.511702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:39.689559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:39.695952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:39.700555 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2fecf784-2253-43e7-bbb0-acf4f10c1707 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1278 microversion: 2.1 time: 0.213759 Sep 03 20:49:39.705226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-092e62b5-0c7c-4d0b-ad37-7fcaced2aaad tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 0.461388 Sep 03 20:49:39.709975 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:39 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:39.711071 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 167/339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:39 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:40.729013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:40.729768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:40.739124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:40.739739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:40.740914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:40.742320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:40.743493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:40.743753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:40.744226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:40.744659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:40.757409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:40.758872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:40.761645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:40.763108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:40.763807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:40.767009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:41.022190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:41.036420 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e7655b4d-246f-4111-bf23-5a7396aaefdb tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.311308 Sep 03 20:49:41.039932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 173/340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:40 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:41.823353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:41.832717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835e6659-8e59-453f-8da0-68800d445466", "name": "network-vif-plugged", "status": "completed", "tag": "d4d8999e-5504-4122-a8d3-8f14502c1c0c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:41.848772 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95d7bb5f-92aa-495a-92df-626782349dca tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 1.114226 Sep 03 20:49:41.849400 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 168/341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:40 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:41.868000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:41.868731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:41.869346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:41.888245 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] Creating event network-vif-plugged:d4d8999e-5504-4122-a8d3-8f14502c1c0c for instance 835e6659-8e59-453f-8da0-68800d445466 on nch2-master-1 Sep 03 20:49:41.903907 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ebf3c1c3-6fcf-4da5-87b1-5d5ee78b9047 req-fd880714-fe93-4561-af4b-5edb0d8805ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074708 Sep 03 20:49:41.907336 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 174/342] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:42.064319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:42.064970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:42.077929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:42.080983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:42.081723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:42.082874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:42.083743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:42.084535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:42.662988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:42.678720 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cc4c670-2b04-4232-8f88-e51c489cef74 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.617747 Sep 03 20:49:42.680084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 169/343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:42 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:42.872757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:42.875231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:42.886683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:42.888158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:42.888788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:42.889790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:42.890319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:42.890939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:43.151847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62c0815f-bdd1-4b0f-a47e-0f5662bed712", "tag": "92973460-a650-47a7-9822-98ba91309d88"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:43.196719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:43.198112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:43.198556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:43.238232 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] Creating event network-changed:92973460-a650-47a7-9822-98ba91309d88 for instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 on nch1-master-1 Sep 03 20:49:43.257568 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4dc4cf84-67b6-4f03-af53-83032de2b421 req-5925844c-4c56-4d1b-be02-40490af90998 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108899 Sep 03 20:49:43.265824 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 170/344] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:43.703696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:43.704653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:43.735091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:43.735621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:43.738824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:43.739703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:43.742886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:43.743368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:44.383983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:44.396531 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-383cbcae-ec0d-4e24-beca-2192519f018e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.698566 Sep 03 20:49:44.411515 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 171/345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:43 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:44.445978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:44.455267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c97eb566-53d1-4593-a887-ab9de65b5a65 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1319 microversion: 2.1 time: 1.586962 Sep 03 20:49:44.455856 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 175/346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:42 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1319 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:45.507452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=28 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:45.528612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-163d39c0-9a04-41e0-be8b-c4eddfb6b1e6 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1949737564", "id": 1332708992, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:45.540971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:45.566075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-163d39c0-9a04-41e0-be8b-c4eddfb6b1e6 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.521906 Sep 03 20:49:45.569203 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 172/347] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:49:45 2022] POST /compute/v2.1/flavors => generated 471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:45.587447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:45.593268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:45.602471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:45.602975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:45.603422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:45.604144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:45.604621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:45.605078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:45.770937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=84,nova_cell0:UPDATE=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:45.815024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1382487105", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:45.867650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:45.875888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7af2f71b-058c-4f2d-ba67-382a8c8247df tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.305372 Sep 03 20:49:45.876462 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 173/348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:45 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:45.894311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:45.901703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:45.915635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:45.916290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:45.916883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:45.918276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:45.919650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:45.922712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:45.955297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:45.955734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:45.956337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:45.957404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:45.957835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:46.006052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:46.007205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:46.009547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:46.010938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:46.011416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:46.011890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:46.055963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Getting quotas for project a72b0776bdcd4644afed4d9cbc966e4e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:46.073490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Getting quotas for user cb51295631fd43fd8323ea06097a632e and project a72b0776bdcd4644afed4d9cbc966e4e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:46.118005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:49:46.123348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:49:46.259722 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-081ec2a7-687a-4521-9ac7-c1e3a55059d8 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.065939 Sep 03 20:49:46.263849 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 176/349] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:49:46.274411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27b1a55e-a338-46fd-82fc-78a98426318c tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:46.312687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:46.323036 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aa85457e-f2ba-41a9-b966-40cbc742b9a9 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1469 microversion: 2.1 time: 0.435112 Sep 03 20:49:46.339229 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 174/350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:45 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:46.601467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=48 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:46.818667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27b1a55e-a338-46fd-82fc-78a98426318c tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1332708992/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.553482 Sep 03 20:49:46.826365 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 177/351] 10.222.0.16 () {62 vars in 1265 bytes} [Sat Sep 3 20:49:46 2022] POST /compute/v2.1/flavors/1332708992/os-extra_specs => generated 62 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:46.839016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:46.842891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:46.907975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1637039347", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "593dee90-5ba2-4d54-bda9-d42f054baff1"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:46.996313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] validate_networks() for [('593dee90-5ba2-4d54-bda9-d42f054baff1', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:49:47.013606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:47.031245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:47.032879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:47.049017 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-415f9a3a-928e-409d-941f-94b4e523df9f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1454 microversion: 2.91 time: 0.218753 Sep 03 20:49:47.051554 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 178/352] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:46 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:47.064412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:47.064999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:47.081526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.083819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.084486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.086736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.088316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.089500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.100271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:47.175629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lazy-loading 'flavor' on Instance uuid 835e6659-8e59-453f-8da0-68800d445466 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:47.333692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1d619c1-af77-4034-be34-9968693dc6f4 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466/action" status: 202 len: 0 microversion: 2.1 time: 0.278031 Sep 03 20:49:47.337668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 179/353] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:49:47 2022] POST /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:47.408314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:47.627485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:47.629372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.630067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.630700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.631935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.632678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.633310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.660391 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae35c027-6381-4c17-b5ec-a6ea9e744500 tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.323773 Sep 03 20:49:47.660910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 180/354] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Sep 3 20:49:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:47.665921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc60b182-f626-454f-88a9-563dbf2d43e9 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:47.696796 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc60b182-f626-454f-88a9-563dbf2d43e9 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1332708992" status: 202 len: 0 microversion: 2.86 time: 0.034517 Sep 03 20:49:47.697792 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 181/355] 10.222.0.16 () {60 vars in 1202 bytes} [Sat Sep 3 20:49:47 2022] DELETE /compute/v2.1/flavors/1332708992 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:47.704132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:47.705241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:47.712638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.713439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.714092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.715078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:47.716147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:47.716830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:47.923882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:47.933943 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-72437ed7-c5ab-48ba-bfe9-4e43cb1dc552 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.233956 Sep 03 20:49:47.949480 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 182/356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:47 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:48.110357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-748a9f03-ab30-4602-87b6-421257bb4a0c tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1966680992", "ram": 512, "vcpus": 1, "disk": 10, "id": 1338740674, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:48.188366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-748a9f03-ab30-4602-87b6-421257bb4a0c tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.243344 Sep 03 20:49:48.188366 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 183/357] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:47 2022] POST /compute/v2.1/flavors => generated 416 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:48.197174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:48.199109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:48.213681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.222846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.223398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.224239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.224883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.225487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.414764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:48.429182 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3ddbf65-83cb-4c21-8f35-c288917c474a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1460 microversion: 2.1 time: 0.239801 Sep 03 20:49:48.430012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 184/358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:48 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:48.435587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:48.438272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.439038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.439799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.440756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.441843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.442478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.482749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64d437dc-8103-4fc7-b4e8-ceac6d59311a tempest-AZAdminV2TestJSON-1063323751 tempest-AZAdminV2TestJSON-1063323751-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.050711 Sep 03 20:49:48.484092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 185/359] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 20:49:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:48.492697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-29ca2917-6612-438f-91fe-abeb64e9bea8 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:48.537126 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29ca2917-6612-438f-91fe-abeb64e9bea8 tempest-FlavorMetadataValidation-812779263 tempest-FlavorMetadataValidation-812779263-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.86 time: 0.048821 Sep 03 20:49:48.539242 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 186/360] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:49:48 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:48.553583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:48.556488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:48.579109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.579659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.580113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.582762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:48.583245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:48.585430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:48.922418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:48.941758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:48.945734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:49.008725 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18c20fc9-bc32-4891-898f-a93129c867cc tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1512 microversion: 2.91 time: 0.466650 Sep 03 20:49:49.012195 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 187/361] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:48 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1512 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:49.024613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d133f59-6408-45a2-a938-b77b3ec2a527 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:49.135700 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d133f59-6408-45a2-a938-b77b3ec2a527 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.121589 Sep 03 20:49:49.147676 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 188/362] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Sep 3 20:49:49 2022] POST /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:49.175287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:49.183105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:49:49.184302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:49:49.185459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:49:49.186030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:49:49.186686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:49:49.187003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:49.215133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.218753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.220504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.221228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.221860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:49.223249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.225327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.225930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:49.226847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:49.227636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.228118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.228555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:49.287040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Getting quotas for project 8d0ccd04fad8493fbef0a8afc12e0a38. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:49:49.308684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Getting quotas for user 78b60bdc00024f6f9cac34b07b8940ac and project 8d0ccd04fad8493fbef0a8afc12e0a38. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:49:49.377306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:49:49.388795 ncdv-master-1 devstack@n-api.service[140520]: WARNING nova.utils [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1637039347 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-163703934 Sep 03 20:49:49.394405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:49:49.513848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe915c41-aa49-4205-8b9a-f368395c28b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.172608 Sep 03 20:49:49.521024 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 175/363] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:49:49.528535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:49.529448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:49.537846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.538741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.539343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:49.540226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:49.541370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:49.541991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:50.096776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:50.100348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:50.110246 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b19ad2f4-22dd-4afa-8878-87f189139426 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.587803 Sep 03 20:49:50.120612 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 176/364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:49 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:50.417469 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7b07a6d4-c513-4b66-910b-9849ec8da707 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1611 microversion: 2.1 time: 1.268379 Sep 03 20:49:50.418064 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 189/365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:49 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1611 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:50.443356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81cb89b3-e56c-4dd5-ac46-c336421e2c24 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:50.446432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81cb89b3-e56c-4dd5-ac46-c336421e2c24 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:50.709001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98c33eeb-1713-4709-ac6a-4927414c4655 tempest-FlavorsExtraSpecsTestJSON-1513563224 tempest-FlavorsExtraSpecsTestJSON-1513563224-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:50.715354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81cb89b3-e56c-4dd5-ac46-c336421e2c24 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:50.734710 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98c33eeb-1713-4709-ac6a-4927414c4655 tempest-FlavorsExtraSpecsTestJSON-1513563224 tempest-FlavorsExtraSpecsTestJSON-1513563224-project] 10.222.0.16 "GET /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.612311 Sep 03 20:49:50.745598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 177/366] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Sep 3 20:49:50 2022] GET /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:50.748834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81cb89b3-e56c-4dd5-ac46-c336421e2c24 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1232 microversion: 2.1 time: 0.328371 Sep 03 20:49:50.749469 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 190/367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:50 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1232 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:50.766994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:50.766994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:50.783933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:50.787558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:50.788051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:50.802031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:50.802973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:50.804204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:50.804554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:50.805337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:50.808223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:50.808371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:50.811255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:50.812189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:50.817947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:50.846794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=79,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:50.906538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a8dc364-bd42-49c5-bc71-ed2b5a9076e8 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134502 Sep 03 20:49:50.907731 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 191/368] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:49:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:50.913724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47713ee0-8c35-45c3-be6b-e1d937a55c84 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:50.980325 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47713ee0-8c35-45c3-be6b-e1d937a55c84 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071175 Sep 03 20:49:50.981852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 192/369] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Sep 3 20:49:50 2022] POST /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:50.987223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:50.991538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:50.999564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.000130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.001634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.002997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.004722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.005323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.162372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:51.173654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:51.175105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:51.182860 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40abedde-5d98-408e-a9f8-ad5ea17749b1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1533 microversion: 2.91 time: 0.435594 Sep 03 20:49:51.201606 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 178/370] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:50 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1533 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:51.216521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0c6b350-6567-4feb-a410-7cdefca94c82 tempest-FlavorsExtraSpecsTestJSON-1513563224 tempest-FlavorsExtraSpecsTestJSON-1513563224-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:51.234265 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0c6b350-6567-4feb-a410-7cdefca94c82 tempest-FlavorsExtraSpecsTestJSON-1513563224 tempest-FlavorsExtraSpecsTestJSON-1513563224-project] 10.222.0.16 "GET /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023293 Sep 03 20:49:51.235443 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 179/371] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 20:49:51 2022] GET /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes => generated 22 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:51.240113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:51.241067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:51.252059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.252774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.253448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.254841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.255517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.256634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.504978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Lazy-loading 'flavor' on Instance uuid 835e6659-8e59-453f-8da0-68800d445466 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:51.522378 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 835e6659-8e59-453f-8da0-68800d445466 while it is in vm_state suspended Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Request method failure captured: Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466/action HTTP/1.1 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 97 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72tsU6Qx7cR6AB-deRTrdk7vspvKOBK7I3kXG6V-woGjoTyFvFzxOpEKA8OYp1qvX2NDRXoe7HZAKS0o2_mRe2OdP0F0CsWRaSyGMdWMD5So2dBR-VuWWdtv3s9-NDJlGr1v6xGyMO1kRLQgPc63U7WODnSTWMAjnBZnOTASGOnf6o Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a293794868cd4c749b6eaa82e23e0500 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:51.525366 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a293794868cd4c749b6eaa82e23e0500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a293794868cd4c749b6eaa82e23e0500 Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1442947885 Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveMigrationNegativeTest-1442947885-project-admin Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 8b5729e885694c2caf13e018c54a95bf Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveMigrationNegativeTest-1442947885-project-admin Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Sep 03 20:49:51.526589 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'os-migrateLive' instance 835e6659-8e59-453f-8da0-68800d445466 while it is in vm_state suspended Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '835e6659-8e59-453f-8da0-68800d445466', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 03 20:49:51.527341 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 835e6659-8e59-453f-8da0-68800d445466 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:51.528484 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 835e6659-8e59-453f-8da0-68800d445466 while it is in vm_state suspended Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 835e6659-8e59-453f-8da0-68800d445466 while it is in vm_state suspended Sep 03 20:49:51.529625 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:51.534216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 835e6659-8e59-453f-8da0-68800d445466 while it is in vm_state suspended {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:51.535463 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c0a24fe-93b3-42a7-abfb-661456c504a1 tempest-LiveMigrationNegativeTest-1442947885 tempest-LiveMigrationNegativeTest-1442947885-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466/action" status: 409 len: 155 microversion: 2.1 time: 0.552452 Sep 03 20:49:51.539074 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 193/372] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:49:50 2022] POST /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466/action => generated 155 bytes in 556 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:49:51.774590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:51.804286 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6318eef3-fe8b-4522-ac00-b7da33ebde4b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.561776 Sep 03 20:49:51.808149 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 180/373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:51 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:51.824188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73332b37-0c47-4873-89a6-8d604bd8d6a6 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:51.866140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73332b37-0c47-4873-89a6-8d604bd8d6a6 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056090 Sep 03 20:49:51.868027 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 181/374] 10.222.0.16 () {60 vars in 1224 bytes} [Sat Sep 3 20:49:51 2022] POST /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:51.876932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:51.877585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:51.891417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.892262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.893024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.894521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:51.895338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:51.895988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:51.955070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:49:52.110185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:52.111559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:52.129128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.130201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.130990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.132029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.132690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.133377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.309769 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9fbde239-3229-4e27-9500-7cc5e6dddf6c tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 204 len: 0 microversion: 2.1 time: 0.438895 Sep 03 20:49:52.320267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 182/375] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:51 2022] DELETE /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:52.341675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:52.344421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:52.360754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.361364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.361898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.362737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.363290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.363825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.440392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lazy-loading 'services' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:52.571490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:52.590469 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5004d5c0-1c6c-428a-9208-0f472f5e7d93 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1290 microversion: 2.1 time: 0.266834 Sep 03 20:49:52.592941 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 183/376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:52 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1290 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:52.628825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b731ec70-80ce-4c31-b9f8-ddb7233542f5 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:52.631581 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90a12eb9-0754-4346-abbf-3e2ba2e61d80 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1938 microversion: 2.91 time: 1.087739 Sep 03 20:49:52.641414 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 194/377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:51 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1938 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:52.657132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:52.657759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:52.664188 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b731ec70-80ce-4c31-b9f8-ddb7233542f5 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.057984 Sep 03 20:49:52.665108 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 184/378] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Sep 3 20:49:52 2022] GET /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:52.674964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:52.675745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:52.688088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.690740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.691134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.691637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.692228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.693126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.693245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.693837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.694421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.695082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:52.696775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:52.701642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:52.963743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lazy-loading 'services' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:53.035931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:53.044560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ffe5e0e-efa8-4096-b3be-6b1d52b9f4e8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1466 microversion: 2.1 time: 0.401177 Sep 03 20:49:53.053399 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 195/379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:52 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1466 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:53.063740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f2b0a53-5eab-4189-aad2-9fa1a3f8f253 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:53.143628 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5373284d-1c25-44cb-8cc3-6ee412f0a5bb tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1938 microversion: 2.91 time: 0.477346 Sep 03 20:49:53.145987 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f2b0a53-5eab-4189-aad2-9fa1a3f8f253 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.091474 Sep 03 20:49:53.151697 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 185/381] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:52 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1938 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:53.152796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 196/381] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Sep 3 20:49:53 2022] PUT /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes => generated 22 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:53.161653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-535534ed-0956-4ddb-a754-f7cb5d00dfe5 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.162544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.163345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:53.173873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.178865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.179613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.180100 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-535534ed-0956-4ddb-a754-f7cb5d00dfe5 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023967 Sep 03 20:49:53.181025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.181954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 197/382] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Sep 3 20:49:53 2022] GET /compute/v2.1/flavors/1338740674/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:53.182648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.185032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.191715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.207186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.208615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.209314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.210533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.211466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.212110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.259394 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a1ef067c-fbac-4813-9237-989684b2554f tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.075465 Sep 03 20:49:53.260644 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 198/383] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Sep 3 20:49:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:49:53.266144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98bd0674-99e5-4a95-8239-f0dec70756ed tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.300209 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98bd0674-99e5-4a95-8239-f0dec70756ed tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.038152 Sep 03 20:49:53.303741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 199/384] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 20:49:53 2022] DELETE /compute/v2.1/flavors/1338740674/os-extra_specs/hw:numa_nodes => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:53.315439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:53.318170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:53.329389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.333026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.333026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.333026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.333026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.333393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.388374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lazy-loading 'flavor' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:53.650123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:53.661509 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f183cb2f-c233-4b20-b199-d46104125c98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.508446 Sep 03 20:49:53.693277 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 186/385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:53 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:53.701186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b42e09a-f469-448a-be10-9cddb2818f57 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.742190 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b42e09a-f469-448a-be10-9cddb2818f57 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1338740674/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.043565 Sep 03 20:49:53.744564 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 187/386] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 20:49:53 2022] DELETE /compute/v2.1/flavors/1338740674/os-extra_specs/hw:cpu_policy => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 20:49:53.749380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.749994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:53.765138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.765639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.766085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.766814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:53.769322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:53.769766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:53.909268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c295d229-d6ec-4390-ad8b-a8f3097122e5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action" status: 202 len: 0 microversion: 2.91 time: 0.600227 Sep 03 20:49:53.911661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 200/387] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:49:53 2022] POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:53.936692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8fa29f51-d7d9-4152-9038-a80d3af6317f tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:53.984192 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8fa29f51-d7d9-4152-9038-a80d3af6317f tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1338740674/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.068999 Sep 03 20:49:53.988890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 201/388] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Sep 3 20:49:53 2022] GET /compute/v2.1/flavors/1338740674/os-extra_specs => generated 19 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:54.004079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c0815f-bdd1-4b0f-a47e-0f5662bed712", "name": "network-vif-plugged", "status": "completed", "tag": "92973460-a650-47a7-9822-98ba91309d88"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:54.031576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.032587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.033896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.059709 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] Creating event network-vif-plugged:92973460-a650-47a7-9822-98ba91309d88 for instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 on nch1-master-1 Sep 03 20:49:54.066758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e89968d8-4ebb-4c70-9784-7a335d640033 req-fe266838-c602-48fd-8e70-0f514381ed5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076159 Sep 03 20:49:54.067281 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 202/389] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:54.079457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:54.080095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:54.099589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.102015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.102479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.103225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.103695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.104131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.311985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:54.333513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:54.339687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:54.357288 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d83d4213-657b-4256-809a-252c64817481 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.288324 Sep 03 20:49:54.358472 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 203/390] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:54 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:54.364378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67bb7964-cef0-4eb0-ba92-616ac381e23e tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:54.387989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:54.392509 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67bb7964-cef0-4eb0-ba92-616ac381e23e tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1338740674" status: 202 len: 0 microversion: 2.1 time: 0.032307 Sep 03 20:49:54.397510 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 204/391] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:49:54 2022] DELETE /compute/v2.1/flavors/1338740674 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:54.401554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4561c111-5e0d-4aac-8654-e716cb613fa4 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.655614 Sep 03 20:49:54.408169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:54.409066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:54.417118 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 188/392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:53 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:54.432885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.433410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.433846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.434590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.435045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.435469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.448938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c62e05d-7cdb-4d4d-b023-38f985901164 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:54.558446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c62e05d-7cdb-4d4d-b023-38f985901164 tempest-FlavorsExtraSpecsTestJSON-2054504080 tempest-FlavorsExtraSpecsTestJSON-2054504080-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.135203 Sep 03 20:49:54.559074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 189/393] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:54.689820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:54.690451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:54.697844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.698335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.698770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.713536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:54.717613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:54.719603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:54.979296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:54.993904 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-863ed0b8-d244-4d95-8c64-dd9a8c6c1604 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1466 microversion: 2.1 time: 0.594793 Sep 03 20:49:54.994488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 205/394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:54 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1466 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:55.043072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835e6659-8e59-453f-8da0-68800d445466", "name": "network-vif-deleted", "tag": "d4d8999e-5504-4122-a8d3-8f14502c1c0c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:55.080656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:55.094331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:55.097009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:55.113237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:55.164884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] Creating event network-vif-deleted:d4d8999e-5504-4122-a8d3-8f14502c1c0c for instance 835e6659-8e59-453f-8da0-68800d445466 on nch2-master-1 Sep 03 20:49:55.186797 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b6e2d0c5-7f1d-4930-8ab3-fc6c6a84f173 req-b827a030-394e-485a-b530-db690fff237d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144816 Sep 03 20:49:55.187594 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 206/395] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:55.304050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:55.314332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48b183f4-78da-4446-b47b-51b6c92e2434 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1320 microversion: 2.1 time: 0.628772 Sep 03 20:49:55.314918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 190/396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:54 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1320 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:55.390921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:55.391858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:55.411340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:55.413855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:55.418022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:55.420670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:55.422949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:55.425747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:55.435979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:55.437355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:55.444609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:55.455580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:55.458803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:55.461185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:55.464834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:55.469577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:55.668876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:55.687386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:55.694713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:55.710115 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48a53fca-4200-4ebd-892f-6cf3096b22e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.326048 Sep 03 20:49:55.713350 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 207/397] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:55 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:56.021827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:56.022558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:56.032596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.034472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.035172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.036181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.037406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.038626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.083989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.084889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.085701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.086930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lazy-loading 'fault' on Instance uuid 835e6659-8e59-453f-8da0-68800d445466 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:56.193179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:56.203816 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2a2badc-2cb1-41f9-a4f2-625d906c5024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 200 len: 1309 microversion: 2.1 time: 0.186501 Sep 03 20:49:56.220922 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 208/398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:56 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:56.290055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:56.303882 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d6663e5-74fa-4699-935d-41605a8e94ce tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.872011 Sep 03 20:49:56.304720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 191/399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:55 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:49:56.340032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:56.341510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:56.349223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.356711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.359313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.363591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.366384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.367870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.537332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dbaba9d8-6322-4bb7-830c-6cf2120d32c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-520355025", "ram": 512, "vcpus": 1, "disk": 10, "id": 819108941, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:56.571701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dbaba9d8-6322-4bb7-830c-6cf2120d32c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.188875 Sep 03 20:49:56.573078 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 192/400] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:49:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:49:56.789859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2cd10db4-d890-41b4-908c-a141073eb5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:56.791746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:56.810283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-09aae338-9ba2-4612-8bc0-b4af06470027 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1470 microversion: 2.1 time: 0.466579 Sep 03 20:49:56.810283 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 209/401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:56 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:56.815242 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2cd10db4-d890-41b4-908c-a141073eb5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] HTTP exception thrown: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:56.820381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:56.824288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2cd10db4-d890-41b4-908c-a141073eb5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Request method failure captured: Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73y3DI0LoVlOHgcOwoGNy-5Zx0OpVGhyGSZVNRsNJ_K86poalaDm9atX4jcRGmDO049W9-19u9EhOl6ov7nc5DjSRvlWcYIfqAj3_1QsNK4jcq6hnAqAAtzKSSMoeaEJNJTfOrtmehiyHLUGPRXfIWfGk10I-o_Mex_G_ZAHgKPqh8 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:56.828068 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 8756e3fd985440d1a29cb5f5b94a6ac1 Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:56.829537 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'flavor_id': '819108941', 'id': 'hw:cpu_thread_policy'} Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:56.830264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:56.831560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:56.834284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2cd10db4-d890-41b4-908c-a141073eb5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Returning 404 to user: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:56.838802 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2cd10db4-d890-41b4-908c-a141073eb5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] 10.222.0.16 "GET /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.255414 Sep 03 20:49:56.838996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.841066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.842873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 193/402] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:49:56 2022] GET /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:49:56.845468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.846626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.847289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.847933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.859276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:56.868407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:56.884477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.885024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.885479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:56.890774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:56.891384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:56.891836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.064519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.086707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.093291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.116260 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc6a03c3-f3c5-4703-a3ee-6727cd714ee2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.306552 Sep 03 20:49:57.118648 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 210/403] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:56 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:57.128236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f12ba4a4-e0d3-45b6-ad57-b56a2f7d14ff tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:57.138146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f12ba4a4-e0d3-45b6-ad57-b56a2f7d14ff tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8756e3fd985440d1a29cb5f5b94a6ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f86e3171bdc40d6b4b303e6bf5e4a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f12ba4a4-e0d3-45b6-ad57-b56a2f7d14ff tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Request method failure captured: Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/flavors/819108941/os-extra_specs HTTP/1.1 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 66 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73y3DI0LoVlOHgcOwoGNy-5Zx0OpVGhyGSZVNRsNJ_K86poalaDm9atX4jcRGmDO049W9-19u9EhOl6ov7nc5DjSRvlWcYIfqAj3_1QsNK4jcq6hnAqAAtzKSSMoeaEJNJTfOrtmehiyHLUGPRXfIWfGk10I-o_Mex_G_ZAHgKPqh8 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:57.148087 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 8756e3fd985440d1a29cb5f5b94a6ac1 Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 03 20:49:57.149510 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'flavor_id': '819108941', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:57.150290 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 03 20:49:57.151400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.152507 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a16651c0-bde5-437b-88d6-519dfcb83e13 tempest-DeleteServersAdminTestJSON-175739094 tempest-DeleteServersAdminTestJSON-175739094-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712/action" status: 202 len: 0 microversion: 2.1 time: 0.305463 Sep 03 20:49:57.152507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 194/404] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:49:56 2022] POST /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:57.156165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f12ba4a4-e0d3-45b6-ad57-b56a2f7d14ff tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:57.157282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f12ba4a4-e0d3-45b6-ad57-b56a2f7d14ff tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] 10.222.0.16 "POST /compute/v2.1/flavors/819108941/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.037414 Sep 03 20:49:57.159994 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 211/405] 10.222.0.16 () {60 vars in 1221 bytes} [Sat Sep 3 20:49:57 2022] POST /compute/v2.1/flavors/819108941/os-extra_specs => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:57.160606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.163394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.171446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.172185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.172700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-952f85c1-cab8-4352-9291-121828f19709 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:57.173226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.174535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.175186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.176327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.222340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.225118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.225753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.226253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 62c0815f-bdd1-4b0f-a47e-0f5662bed712 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:57.299310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-952f85c1-cab8-4352-9291-121828f19709 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/819108941/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.134955 Sep 03 20:49:57.299911 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 212/406] 10.222.0.16 () {60 vars in 1221 bytes} [Sat Sep 3 20:49:57 2022] POST /compute/v2.1/flavors/819108941/os-extra_specs => generated 66 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:57.312262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.313564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 835e6659-8e59-453f-8da0-68800d445466] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.321626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.322099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.322607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.323637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.324102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.324537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.345970 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] HTTP exception thrown: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Request method failure captured: Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 HTTP/1.1 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72ra4UbE4dWm6q63MVMUQ4N0m3XrdIfszjG5oidhGV5OBxFPGbQSdPhqfLK4vI8283uoSot19-i64GlNdyZft9qkXeZGDkTOCPSpbJrCL2tshFM2w8pr7IJk6Cn1AWN6CBn-xxUJ8xsA40bu7XNqeIOtusVU_X4cy0qJtm41sojK-M Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 993b7f76855c47e58427d7542a0f41c2 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:57.346838 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 993b7f76855c47e58427d7542a0f41c2 Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveMigrationNegativeTest-1690173683-project Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4c3a73b54fd54a23808657c7ed9e62cb Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveMigrationNegativeTest-1690173683-project Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. Sep 03 20:49:57.348100 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '835e6659-8e59-453f-8da0-68800d445466'} Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:57.348853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. Sep 03 20:49:57.350131 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.351277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Returning 404 to user: Instance 835e6659-8e59-453f-8da0-68800d445466 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:57.351277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ab922c3-9723-4fe7-9d8f-88f035f99a9a tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466" status: 404 len: 111 microversion: 2.1 time: 0.043080 Sep 03 20:49:57.352573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 213/407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:57 2022] GET /compute/v2.1/servers/835e6659-8e59-453f-8da0-68800d445466 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:57.360519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6481af08-50ad-4bef-b6c4-adf8294fc985", "tag": "4c02269a-ed30-4041-8fee-981b93f1e881"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:57.371045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.371533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.373476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.388963 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] Creating event network-changed:4c02269a-ed30-4041-8fee-981b93f1e881 for instance 6481af08-50ad-4bef-b6c4-adf8294fc985 on nch1-master-1 Sep 03 20:49:57.394790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f6d5de44-dc3d-479d-a750-3a6d411eb8d1 req-0201fc02-2fa0-49fe-a271-2b7b7cd70bce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040794 Sep 03 20:49:57.395960 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 214/408] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:49:57.403172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95bf053c-1614-40fc-9baa-ad06a035e810 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.404937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95bf053c-1614-40fc-9baa-ad06a035e810 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8756e3fd985440d1a29cb5f5b94a6ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f86e3171bdc40d6b4b303e6bf5e4a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95bf053c-1614-40fc-9baa-ad06a035e810 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Request method failure captured: Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73y3DI0LoVlOHgcOwoGNy-5Zx0OpVGhyGSZVNRsNJ_K86poalaDm9atX4jcRGmDO049W9-19u9EhOl6ov7nc5DjSRvlWcYIfqAj3_1QsNK4jcq6hnAqAAtzKSSMoeaEJNJTfOrtmehiyHLUGPRXfIWfGk10I-o_Mex_G_ZAHgKPqh8 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:49:57.406913 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 8756e3fd985440d1a29cb5f5b94a6ac1 Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:57.408315 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'flavor_id': '819108941', 'id': 'hw:numa_nodes'} Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:57.409066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:57.410306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95bf053c-1614-40fc-9baa-ad06a035e810 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:57.411384 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95bf053c-1614-40fc-9baa-ad06a035e810 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011289 Sep 03 20:49:57.411384 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 215/409] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 20:49:57 2022] DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:57.417509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.419566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.423996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:57.435260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.435778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.437147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.438002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.438476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.439719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.551049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.564162 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-addfeffd-10c7-413b-a762-cf7ec2c63cf7 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1453 microversion: 2.1 time: 0.404594 Sep 03 20:49:57.565364 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 195/410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:57 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1453 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:57.570215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.577350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.585969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.589150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.589712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.594094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.594996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.595787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.631802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:49:57.684803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:57.798262 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6fb789a4-a6fa-4e91-a786-78ecd03e8461 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 204 len: 0 microversion: 2.1 time: 0.231150 Sep 03 20:49:57.799270 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 196/411] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:57 2022] DELETE /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:57.810729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82e93113-015e-4f6a-89f6-d8b7e23ca45f tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:57.866395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:57.883707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82e93113-015e-4f6a-89f6-d8b7e23ca45f tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/819108941/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082247 Sep 03 20:49:57.891867 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 197/412] 10.222.0.16 () {60 vars in 1221 bytes} [Sat Sep 3 20:49:57 2022] POST /compute/v2.1/flavors/819108941/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:49:57.903377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.904305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.912400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.913258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:57.913681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.914361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.915357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.916054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.916668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.934765 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bbc3294d-8638-45b9-95fb-dc115d2dd46c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.522203 Sep 03 20:49:57.935379 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 216/413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:57 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:57.958018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:49:57.963305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:57.969140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:57.986613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.989894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.990475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:57.991414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:57.992412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:57.996642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.149949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f31f3241-319a-41da-968a-b6e873b5148e tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 204 len: 0 microversion: 2.1 time: 0.255132 Sep 03 20:49:58.150871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 198/414] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:49:57 2022] DELETE /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:49:58.163076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd4fa7c8-d277-4bd6-a70b-d5bf461e2301 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:58.167992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd4fa7c8-d277-4bd6-a70b-d5bf461e2301 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8756e3fd985440d1a29cb5f5b94a6ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f86e3171bdc40d6b4b303e6bf5e4a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd4fa7c8-d277-4bd6-a70b-d5bf461e2301 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Request method failure captured: Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 22 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73y3DI0LoVlOHgcOwoGNy-5Zx0OpVGhyGSZVNRsNJ_K86poalaDm9atX4jcRGmDO049W9-19u9EhOl6ov7nc5DjSRvlWcYIfqAj3_1QsNK4jcq6hnAqAAtzKSSMoeaEJNJTfOrtmehiyHLUGPRXfIWfGk10I-o_Mex_G_ZAHgKPqh8 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:49:58.170718 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f86e3171bdc40d6b4b303e6bf5e4a2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0f86e3171bdc40d6b4b303e6bf5e4a2c Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 8756e3fd985440d1a29cb5f5b94a6ac1 Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: {"hw:numa_nodes": "1"} Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:49:58.172130 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'flavor_id': '819108941', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:49:58.172993 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 03 20:49:58.174292 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.175593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd4fa7c8-d277-4bd6-a70b-d5bf461e2301 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:58.175593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd4fa7c8-d277-4bd6-a70b-d5bf461e2301 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951 tempest-FlavorsExtraSpecsNegativeTestJSON-462307951-project] 10.222.0.16 "PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015273 Sep 03 20:49:58.177879 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 199/415] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:58 2022] PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:58.184498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.185458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:58.228666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.228666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.228666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.228666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.229412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.230237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.380483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.397462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.399295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.414277 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4884b718-2b2a-46b3-83b5-0fad4761328b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.230709 Sep 03 20:49:58.427981 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 200/416] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:58 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:58.443425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.444090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:58.457262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.457601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.458049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.458788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.459308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.459744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.530299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.530897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.532266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.532676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 62c0815f-bdd1-4b0f-a47e-0f5662bed712 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:49:58.582864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.595861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4394e90-f961-46ce-80b9-1a88ba8617a8 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1474 microversion: 2.1 time: 0.659366 Sep 03 20:49:58.596726 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 217/417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:57 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1474 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:58.604458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b869e296-8904-488f-a879-bc4d82c3acd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.624252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b869e296-8904-488f-a879-bc4d82c3acd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] HTTP exception thrown: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b869e296-8904-488f-a879-bc4d82c3acd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Request method failure captured: Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE730QoM3ua_XQqLRX5BtFrtGlS4FLk_NOIDv6xozkQ-kNSpVRz7IU4KG7FdCsmje873b77yqFL6BSbQdBmQscmHA_MQb0Z_r3SoT-pWSkpA8Cmt4p0Eb5RCMLAQyRJWPzWrPo71rWOm3aJgXB-JF286NXqhRpFaBkNRJ6Oag9wDw27A Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:58.630520 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 20a2b116593b4601ac0b957f56e8ad7c Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:58.631938 ncdv-master-1 devstack@n-api.service[140519]: exception: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'flavor_id': '819108941', 'id': 'hw:cpu_thread_policy'} Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.632731 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. Sep 03 20:49:58.634180 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.635588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b869e296-8904-488f-a879-bc4d82c3acd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Returning 404 to user: Flavor 819108941 has no extra specs with key hw:cpu_thread_policy. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:58.636621 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b869e296-8904-488f-a879-bc4d82c3acd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.038268 Sep 03 20:49:58.641689 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 218/418] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:49:58 2022] DELETE /compute/v2.1/flavors/819108941/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:49:58.656610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f2c43da-7b44-4e87-855b-27a5656ce727 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:58.666680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-6f2c43da-7b44-4e87-855b-27a5656ce727 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f2c43da-7b44-4e87-855b-27a5656ce727 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Request method failure captured: Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 27 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE730QoM3ua_XQqLRX5BtFrtGlS4FLk_NOIDv6xozkQ-kNSpVRz7IU4KG7FdCsmje873b77yqFL6BSbQdBmQscmHA_MQb0Z_r3SoT-pWSkpA8Cmt4p0Eb5RCMLAQyRJWPzWrPo71rWOm3aJgXB-JF286NXqhRpFaBkNRJ6Oag9wDw27A Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:58.668387 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 20a2b116593b4601ac0b957f56e8ad7c Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: {"hw:cpu_policy": "shared"} Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:58.670383 ncdv-master-1 devstack@n-api.service[140519]: exception: Request body and URI mismatch Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'flavor_id': '819108941', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.671238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.672518 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:49:58.672518 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:49:58.672518 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 03 20:49:58.672518 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.674085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f2c43da-7b44-4e87-855b-27a5656ce727 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:58.675193 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f2c43da-7b44-4e87-855b-27a5656ce727 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028149 Sep 03 20:49:58.680528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 219/419] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:58 2022] PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:49:58.713678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49fa2069-fd83-4411-8bde-9fcfa3a52037 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:49:58.735092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49fa2069-fd83-4411-8bde-9fcfa3a52037 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Request method failure captured: Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 49 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE730QoM3ua_XQqLRX5BtFrtGlS4FLk_NOIDv6xozkQ-kNSpVRz7IU4KG7FdCsmje873b77yqFL6BSbQdBmQscmHA_MQb0Z_r3SoT-pWSkpA8Cmt4p0Eb5RCMLAQyRJWPzWrPo71rWOm3aJgXB-JF286NXqhRpFaBkNRJ6Oag9wDw27A Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 20:49:58.740884 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5de9aca20464f10b2ccdf65707c0443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: e5de9aca20464f10b2ccdf65707c0443 Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 20a2b116593b4601ac0b957f56e8ad7c Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 03 20:49:58.742437 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'flavor_id': '819108941', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance: Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 03 20:49:58.743383 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.744799 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 03 20:49:58.746446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:49:58.748157 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83b807d4-42ac-4e1f-9467-336829963185 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1459 microversion: 2.1 time: 0.317439 Sep 03 20:49:58.748767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 201/420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:58 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1459 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:58.749624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49fa2069-fd83-4411-8bde-9fcfa3a52037 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:49:58.751023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49fa2069-fd83-4411-8bde-9fcfa3a52037 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.062140 Sep 03 20:49:58.752557 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 220/421] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:49:58 2022] PUT /compute/v2.1/flavors/819108941/os-extra_specs/hw:numa_nodes => generated 117 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:49:58.768848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9317160-7840-4e79-81c5-3a467a276d49 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.825836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9317160-7840-4e79-81c5-3a467a276d49 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/819108941" status: 202 len: 0 microversion: 2.1 time: 0.061998 Sep 03 20:49:58.826436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 202/422] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:49:58 2022] DELETE /compute/v2.1/flavors/819108941 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:49:58.834201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48e44c0d-7eed-4afa-a7e2-8b0c186fca5c tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.906703 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48e44c0d-7eed-4afa-a7e2-8b0c186fca5c tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511 tempest-FlavorsExtraSpecsNegativeTestJSON-1030607511-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074782 Sep 03 20:49:58.923219 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 221/423] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:49:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:58.967625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:58.968433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:58.982799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.983316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.983777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:58.984511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:58.985007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:58.988058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.259704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:59.296653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:59.314443 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-234f9a1d-ee87-4813-8a27-59fb321d3fee tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.353801 Sep 03 20:49:59.315110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 203/424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:58 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:49:59.459947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:59.460853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:59.475802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.476319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.476766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.477527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.478001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.478439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.626947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:59.628609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:59.633160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:59.638530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.639540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.640198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.641287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.642239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.642888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.885295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:59.898656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:59.904406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:49:59.920954 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe007b35-9ca5-449b-b3c0-d66c575a2bb1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.461749 Sep 03 20:49:59.936552 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 222/425] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:49:59 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:49:59.949522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:49:59.952411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:49:59.964370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.966809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.970094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:49:59.971074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:49:59.971708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:49:59.973764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:00.055917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:00.056434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:00.056877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:00.057372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 62c0815f-bdd1-4b0f-a47e-0f5662bed712 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:00.110351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:00.140405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2f5eef2-b828-4bb8-9376-61a3a1bee4dc tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1474 microversion: 2.1 time: 0.517545 Sep 03 20:50:00.141335 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 204/426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:59 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:00.348723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:00.349388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:00.358159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:00.358924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:00.359522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:00.360706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:00.361376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:00.362022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:00.720637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:00.754773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:00.765366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ddef6700-7829-4895-85b4-1c3e3e5f6c2b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1459 microversion: 2.1 time: 0.821078 Sep 03 20:50:00.772010 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 223/427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:49:59 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1459 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:00.956637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:00.961366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:00.962306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:00.979717 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-592fef26-f688-4e3b-9d3f-ad63f2d8e28c tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.639024 Sep 03 20:50:00.980650 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 205/428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:00 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:00.991429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:00.992692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:00.993857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:00.999142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:00.999979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.001235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.170720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:01.171527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:01.194404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:01.197498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.198780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.200376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:01.201109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.201750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.361569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:01.382055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:01.384078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:01.400697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cceff927-a1cd-4b48-bcb2-c0ccb3397cac tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.453718 Sep 03 20:50:01.401314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 224/429] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:00 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:50:01.477089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:01.491522 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13bda6a2-43f5-4272-87c2-339151969908 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1474 microversion: 2.1 time: 0.325720 Sep 03 20:50:01.493783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 206/430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:01 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:01.801809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:01.801809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:01.815673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:01.817211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.818914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.819872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:01.821940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.822723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.896143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:01.897033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:01.899230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:01.900943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 62c0815f-bdd1-4b0f-a47e-0f5662bed712 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:02.024385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Calling method '.version_select at 0x7fae6756b940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:02.026799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.026799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.027232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.095628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.096246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.100444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.158489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.161412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.161880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.185061 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-049805ba-14c2-4aaa-bc07-25e01f0d0042 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.419944 Sep 03 20:50:02.189553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 225/431] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:50:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:02.205012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:02.206764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:02.223068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.223572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.224015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.224738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.229480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.229987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.246423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:02.265523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae844f53-266b-43ab-8571-4a31de15d14a tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1417 microversion: 2.1 time: 0.469049 Sep 03 20:50:02.269632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 207/432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:01 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1417 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:02.585332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-719552e7-091c-4a3c-9fa0-3caab790d465 tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Calling method '.version_select at 0x7fae675ab160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:02.587260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-719552e7-091c-4a3c-9fa0-3caab790d465 tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '7dd518c8e7c94a8dbc2d484d4fec1ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cc297574f444839169119af615179f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-719552e7-091c-4a3c-9fa0-3caab790d465 tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Request method failure captured: Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7349P3RjOzzb5kxdXuN2o4e4Ii87PBJlGjYhYsUeqiDARY17Kj6aGMsf22pxBREABk_Cw2OBWL6DGO0msLrSlAcCFvVvnpSMeWbt7DuEJo-UGDX6PFeZPYtK-DhiijrcmwJbV9twP2qMuMpZKqHHFahJj9CKtMLbDbUENiLapu5Wp8 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: b7cc297574f444839169119af615179f Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:02.589000 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7cc297574f444839169119af615179f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7cc297574f444839169119af615179f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7cc297574f444839169119af615179f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7cc297574f444839169119af615179f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: b7cc297574f444839169119af615179f Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 7dd518c8e7c94a8dbc2d484d4fec1ea9 Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 03 20:50:02.591237 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nch2-master-1'} Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:50:02.592316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 03 20:50:02.593532 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:02.594996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-719552e7-091c-4a3c-9fa0-3caab790d465 tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:02.595573 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-719552e7-091c-4a3c-9fa0-3caab790d465 tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.311213 Sep 03 20:50:02.600512 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 208/433] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 20:50:02 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 314 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:02.605123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62c0815f-bdd1-4b0f-a47e-0f5662bed712", "name": "network-vif-deleted", "tag": "92973460-a650-47a7-9822-98ba91309d88"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:02.631858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.632551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.633214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.664198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] Creating event network-vif-deleted:92973460-a650-47a7-9822-98ba91309d88 for instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 on nch1-master-1 Sep 03 20:50:02.676922 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d1e8e907-88ad-44ef-8b2f-3e813e08bc52 req-4d5aad04-368a-4430-99c8-6d3c3c63e871 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078970 Sep 03 20:50:02.678054 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 209/434] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:02.693477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:02.695270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:02.719055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.720927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.721566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.723458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.727723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.728331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.884040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:02.895960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:02.898534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:02.906163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29ec57cc-8852-4b81-9861-08364e2321da tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.225609 Sep 03 20:50:02.908745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 210/435] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:02 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:02.946563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:02.947631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:02.963738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.964456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.965186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:02.966645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:02.967340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:02.968163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.045738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:03.056260 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4071c5e-4b9f-4cf6-bd75-7e8c465adc73 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1432 microversion: 2.1 time: 0.145985 Sep 03 20:50:03.074027 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 211/436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:02 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1432 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:03.089636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Calling method '.version_select at 0x7fae6741f670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.092541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.093347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.093968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.112169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Request method failure captured: Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE735SeKaz8uo0SfEvmYmPv6KTjHy2ZPh9gSa_PWquLJRF4JEM46Andzfz6fWiLtFWYHF_ahHJjLxT948TuLSJOnxULtRjEBP5UmlnEltJfwJ5XR7QFmnaKtU8yTaqyKKqD8tym-yWZgqo3CJWE0aovvivF-vlf0spwfPPuyIe_6tKaw Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: ed95a87adbf74a5da729e65a31b04a5c Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:50:03.114406 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: ed95a87adbf74a5da729e65a31b04a5c Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f36c6355836349169e2f409b5e306f1a Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 03 20:50:03.115706 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.116476 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.117869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.117869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:03.117869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:03.117869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 03 20:50:03.117869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.119246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:03.120277 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1379fa12-58bb-47f5-8df0-291c6a10653a tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.044523 Sep 03 20:50:03.129092 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 212/437] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:03.136290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f9b4bc-e12f-4f12-841a-336d1dcda4fa", "name": "network-vif-deleted", "tag": "0827f4fd-c782-4c0a-b491-023e9a459266"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:03.136448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:03.148886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.150617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.151300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.173102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d9087daa-7848-44a4-b9cc-04c374b2084e tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.970974 Sep 03 20:50:03.175825 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 226/438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:02 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:03.177913 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] Creating event network-vif-deleted:0827f4fd-c782-4c0a-b491-023e9a459266 for instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa on nch1-master-1 Sep 03 20:50:03.189439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Calling method '.version_select at 0x7fae67470790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.192007 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-70ca5ee9-0dc1-4b4c-8e3a-29d4400073b4 req-fa60ce30-5587-4278-a6d6-230431bcfdcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061189 Sep 03 20:50:03.194437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.195990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.196699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.197266 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 213/439] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:03.236785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:03.240423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.243869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.245018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.269970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.270686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.271646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.279568 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a205eb81-a2c2-47db-bc28-1d1589230c40 tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102297 Sep 03 20:50:03.280739 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 227/440] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:03.292956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b0785f4-cd78-4022-a564-4dc148379ecf tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Calling method '.version_select at 0x7fae67654dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.295235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7b0785f4-cd78-4022-a564-4dc148379ecf tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '7dd518c8e7c94a8dbc2d484d4fec1ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cc297574f444839169119af615179f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b0785f4-cd78-4022-a564-4dc148379ecf tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Request method failure captured: Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7349P3RjOzzb5kxdXuN2o4e4Ii87PBJlGjYhYsUeqiDARY17Kj6aGMsf22pxBREABk_Cw2OBWL6DGO0msLrSlAcCFvVvnpSMeWbt7DuEJo-UGDX6PFeZPYtK-DhiijrcmwJbV9twP2qMuMpZKqHHFahJj9CKtMLbDbUENiLapu5Wp8 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: b7cc297574f444839169119af615179f Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:03.300639 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7cc297574f444839169119af615179f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b7cc297574f444839169119af615179f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b7cc297574f444839169119af615179f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b7cc297574f444839169119af615179f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: b7cc297574f444839169119af615179f Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437 Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 7dd518c8e7c94a8dbc2d484d4fec1ea9 Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 03 20:50:03.302286 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1'} Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:50:03.302957 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 03 20:50:03.304048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.305023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b0785f4-cd78-4022-a564-4dc148379ecf tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:03.305023 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b0785f4-cd78-4022-a564-4dc148379ecf tempest-HypervisorAdminNegativeUnderV252Test-1911704437 tempest-HypervisorAdminNegativeUnderV252Test-1911704437-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014493 Sep 03 20:50:03.311768 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 214/441] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:03.319425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Calling method '.version_select at 0x7fae6741f9d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.320150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.324227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:03.330938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.331453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.331902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.343661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.344168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.345684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.346416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.346883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.347319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.358249 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] HTTP exception thrown: No hypervisor matching 'fdfc4e33-387b-4af3-8491-94164ef70509' could be found. Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Request method failure captured: Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-hypervisors/fdfc4e33-387b-4af3-8491-94164ef70509/servers HTTP/1.1 Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE735SeKaz8uo0SfEvmYmPv6KTjHy2ZPh9gSa_PWquLJRF4JEM46Andzfz6fWiLtFWYHF_ahHJjLxT948TuLSJOnxULtRjEBP5UmlnEltJfwJ5XR7QFmnaKtU8yTaqyKKqD8tym-yWZgqo3CJWE0aovvivF-vlf0spwfPPuyIe_6tKaw Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: ed95a87adbf74a5da729e65a31b04a5c Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:50:03.367877 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ed95a87adbf74a5da729e65a31b04a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: ed95a87adbf74a5da729e65a31b04a5c Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853 Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f36c6355836349169e2f409b5e306f1a Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: exception: No hypervisor matching 'fdfc4e33-387b-4af3-8491-94164ef70509' could be found. Sep 03 20:50:03.369098 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'fdfc4e33-387b-4af3-8491-94164ef70509'} Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'fdfc4e33-387b-4af3-8491-94164ef70509' could be found. Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.369752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'fdfc4e33-387b-4af3-8491-94164ef70509' could be found. Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:03.370752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] Returning 404 to user: No hypervisor matching 'fdfc4e33-387b-4af3-8491-94164ef70509' could be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:03.375228 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-987bfc00-2ae8-4dbc-9e92-1a51efccfd2d tempest-HypervisorAdminNegativeUnderV252Test-474439853 tempest-HypervisorAdminNegativeUnderV252Test-474439853-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/fdfc4e33-387b-4af3-8491-94164ef70509/servers" status: 404 len: 123 microversion: 2.1 time: 0.062324 Sep 03 20:50:03.375989 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 215/442] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/os-hypervisors/fdfc4e33-387b-4af3-8491-94164ef70509/servers => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:03.479746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.480322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.486389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.489257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lazy-loading 'fault' on Instance uuid 62c0815f-bdd1-4b0f-a47e-0f5662bed712 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:03.652365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34f1d07f48c4b4dadf97fd38709fd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123134ed03c540b79122e8ecaa021d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:03.662196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-858f4987-5aac-46cf-8415-5e06b9f12d98 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 200 len: 1310 microversion: 2.1 time: 0.362905 Sep 03 20:50:03.665110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 228/443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 1310 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:03.940146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:03.940876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:03.951620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.952136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.953746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:03.954500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:03.954960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:03.955386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.085016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.085751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:04.107341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.107851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.108294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.122689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.123629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.127565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.194345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:04.229050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:04.234862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:04.241789 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bccf34a4-4471-40f4-b136-f246e42eb20b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.305364 Sep 03 20:50:04.242736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 216/444] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:03 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:04.252836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.254926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:04.269109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.270554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.271274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.274483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.277324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.282476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.283261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.283920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lazy-loading 'fault' on Instance uuid 40f9b4bc-e12f-4f12-841a-336d1dcda4fa {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:04.288817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.290107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.567094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c3a73b54fd54a23808657c7ed9e62cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993b7f76855c47e58427d7542a0f41c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:04.577680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bfbea698-e769-4ee0-ab02-11e16d5a7024 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 200 len: 1309 microversion: 2.1 time: 0.496363 Sep 03 20:50:04.597673 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 229/445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:04 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 1309 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:04.690435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.691565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:04.709948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.710718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.712246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.713799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.714595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.717488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.758387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 HTTP/1.1 Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:04.760487 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.761763 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '62c0815f-bdd1-4b0f-a47e-0f5662bed712'} Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:04.763011 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.766606 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.775120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:04.791368 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d33f636-5da7-4993-aedf-91b0cd994760 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 404 len: 111 microversion: 2.1 time: 0.091537 Sep 03 20:50:04.797508 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 230/446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:04 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:50:04.803238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.804045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:04.819325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.821705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.822389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.845442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.846276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.846905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.853320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:04.874897 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 HTTP/1.1 Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:04.877781 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.879264 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '62c0815f-bdd1-4b0f-a47e-0f5662bed712'} Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:04.880097 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.881464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.889610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:04.891063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54d53d54-2934-4474-b6a5-a02f81db62f2 tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 404 len: 111 microversion: 2.1 time: 0.092128 Sep 03 20:50:04.903646 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 231/447] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:50:04 2022] DELETE /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:04.909701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.923357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 62c0815f-bdd1-4b0f-a47e-0f5662bed712] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:04.936503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.937618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.938253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.939169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:04.939813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:04.940422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:04.961454 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 HTTP/1.1 Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:04.963312 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.964564 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '62c0815f-bdd1-4b0f-a47e-0f5662bed712'} Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:04.966173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. Sep 03 20:50:04.967404 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:04.971018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 62c0815f-bdd1-4b0f-a47e-0f5662bed712 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:04.972168 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4a31092-5e33-4a61-8e8c-af7c7409f1af tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712" status: 404 len: 111 microversion: 2.1 time: 0.066574 Sep 03 20:50:04.976175 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 232/448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:04 2022] GET /compute/v2.1/servers/62c0815f-bdd1-4b0f-a47e-0f5662bed712 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:04.982800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:04.983566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:05.002671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.003492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.004311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.005607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.007066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.009085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.035519 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e HTTP/1.1 Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:05.039414 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.040802 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '74be2b2e-c86c-4cbe-b6c1-756c58c7698e'} Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:05.042277 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.043403 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.049626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:05.050774 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-db0ac106-bba7-4ab2-bda5-7c43de9d367f tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 404 len: 111 microversion: 2.1 time: 0.073311 Sep 03 20:50:05.055570 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 233/449] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:50:04 2022] DELETE /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:05.069619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:05.071340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] [instance: 74be2b2e-c86c-4cbe-b6c1-756c58c7698e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:05.083453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.084314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.085695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.087169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.087908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.088560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.124442 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] HTTP exception thrown: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Request method failure captured: Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e HTTP/1.1 Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE72raApY8lRsYuAYTGuENEsGVOaOHxbKY4Oyu7137urthtlQrrodl_t9z07Zs0-HSbYF86-kc7s6Ggb89A48x4CvDYDbteaPlOhRaPIiYUp0LbtNLDadwgQyzv6o3sbwtnLAYIKmADWm0NOd-MfRg7KF4-vomTZmio8DdCvX3ZUEC2k Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:05.161448 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/123134ed03c540b79122e8ecaa021d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 123134ed03c540b79122e8ecaa021d3d Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-545138253 Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c34f1d07f48c4b4dadf97fd38709fd33 Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersAdminTestJSON-545138253-project Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.163853 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '74be2b2e-c86c-4cbe-b6c1-756c58c7698e'} Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:05.165440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. Sep 03 20:50:05.168650 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.172809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] Returning 404 to user: Instance 74be2b2e-c86c-4cbe-b6c1-756c58c7698e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:05.172809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f61237ca-3816-418f-b37e-8c149fbcf68b tempest-DeleteServersAdminTestJSON-545138253 tempest-DeleteServersAdminTestJSON-545138253-project] 10.222.0.16 "GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e" status: 404 len: 111 microversion: 2.1 time: 0.072329 Sep 03 20:50:05.172809 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 234/450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:05 2022] GET /compute/v2.1/servers/74be2b2e-c86c-4cbe-b6c1-756c58c7698e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:05.173815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:05.173815 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dbba2694-fc7d-423b-9858-6edddd315bc7 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.924715 Sep 03 20:50:05.173815 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 217/451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:04 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:05.274798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:05.275578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:05.292729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.294406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.296171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.299964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.300987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.301667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.435961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:05.443566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:05.450503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:05.456414 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57bac6e5-c3b9-4411-9ca4-91c05dc36f2a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.185952 Sep 03 20:50:05.457620 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 235/452] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:05 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:05.609615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:05.610238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] [instance: 40f9b4bc-e12f-4f12-841a-336d1dcda4fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:05.624967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.629401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.629943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.636335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:05.637795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:05.638319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:05.653815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:05.701943 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] HTTP exception thrown: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Request method failure captured: Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa HTTP/1.1 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE72ra4UbE4dWm6q63MVMUQ4N0m3XrdIfszjG5oidhGV5OBxFPGbQSdPhqfLK4vI8283uoSot19-i64GlNdyZft9qkXeZGDkTOCPSpbJrCL2tshFM2w8pr7IJk6Cn1AWN6CBn-xxUJ8xsA40bu7XNqeIOtusVU_X4cy0qJtm41sojK-M Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 993b7f76855c47e58427d7542a0f41c2 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:05.703996 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/993b7f76855c47e58427d7542a0f41c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 993b7f76855c47e58427d7542a0f41c2 Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1690173683 Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveMigrationNegativeTest-1690173683-project Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4c3a73b54fd54a23808657c7ed9e62cb Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveMigrationNegativeTest-1690173683-project Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. Sep 03 20:50:05.705569 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '40f9b4bc-e12f-4f12-841a-336d1dcda4fa'} Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:05.706450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. Sep 03 20:50:05.707859 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:05.709457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] Returning 404 to user: Instance 40f9b4bc-e12f-4f12-841a-336d1dcda4fa could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:05.717951 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e467756-53e1-4166-b6c8-a75eb1e5b555 tempest-LiveMigrationNegativeTest-1690173683 tempest-LiveMigrationNegativeTest-1690173683-project] 10.222.0.16 "GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa" status: 404 len: 111 microversion: 2.1 time: 0.101370 Sep 03 20:50:05.718707 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 218/453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:05 2022] GET /compute/v2.1/servers/40f9b4bc-e12f-4f12-841a-336d1dcda4fa => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:06.201824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.202565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:06.218982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.219707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.220526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.223258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.227526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.228674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.458691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae67a4b5e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.463370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.463866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.466096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.469309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.469850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.470219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.535939 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-72bedbd8-727e-46a4-ae04-6ceb99a98a52 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.767803 Sep 03 20:50:06.537313 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 236/454] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:50:05 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:06.548785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.552227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:06.567834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.568344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.568795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.569542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.570002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.570433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.681177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:06.690766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af2ee087-f7c6-46e0-97f8-5407c6ada04f tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.494878 Sep 03 20:50:06.691940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 219/455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:06.697594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae67375c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.701539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.705412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.706029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.706972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.707590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.708174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.748350 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5f54b49-b9be-416b-8e2c-14e1d28f3b63 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.054634 Sep 03 20:50:06.749728 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 220/456] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:06.761591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:06.766130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae67458ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.772400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.773638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.775217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.776107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:06.776549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.784937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:06.785734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.786511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.795297 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fdc46543-41ac-44ea-bc47-327fbeefdfe2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.256600 Sep 03 20:50:06.795883 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 237/457] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:06.829864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6096103a-ad8e-4c98-a57d-f0e12d95899a tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.070635 Sep 03 20:50:06.831703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 221/458] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:50:06.850116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae6756b4c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.856233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.856233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.856233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.856233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.856638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.856638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.906721 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae0a9e47-868d-4044-afb2-55e07a43a75e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.059767 Sep 03 20:50:06.908575 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 238/459] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:06.920161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae67375e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.923689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.924185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.924636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.925409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.925871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.926301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.958452 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-de6f7131-9aa6-4cfe-832c-b4527367468e tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.043340 Sep 03 20:50:06.960718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 222/460] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:06.975639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae678049d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:06.979491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.979991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.980444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:06.981250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:06.981944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:06.982594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.012847 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-911118fc-e193-4654-93a4-a7f5ecbf2616 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.040322 Sep 03 20:50:07.014262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 239/461] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:50:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:07.026754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae676a9af0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:07.037724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.039514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.040062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.063742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.064392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.065140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.117471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-16c55471-9e61-4afa-8b25-c606677e59d0 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.095422 Sep 03 20:50:07.118783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 223/462] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:50:07 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:07.129612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Calling method '.version_select at 0x7fae67a4b8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:07.150929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.151563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.152053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.183179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.183692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.185570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.249997 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-71b920b2-620c-4c66-bca6-911e19470a26 tempest-HostsAdminTestJSON-1676028516 tempest-HostsAdminTestJSON-1676028516-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.125713 Sep 03 20:50:07.250913 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 240/463] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:50:07 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:07.719001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:07.719754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:07.733621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.736347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.740961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.742508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.745720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.747658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.818475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6481af08-50ad-4bef-b6c4-adf8294fc985", "name": "network-vif-plugged", "status": "completed", "tag": "4c02269a-ed30-4041-8fee-981b93f1e881"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:07.836767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.837551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.838152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.867221 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] Creating event network-vif-plugged:4c02269a-ed30-4041-8fee-981b93f1e881 for instance 6481af08-50ad-4bef-b6c4-adf8294fc985 on nch1-master-1 Sep 03 20:50:07.873720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-91d3f6d0-4d87-4a97-9b12-2448fe1dc0f2 req-a6530381-3f47-4033-a764-827030543d4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058895 Sep 03 20:50:07.877567 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 241/464] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:50:07.888447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:07.892855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:07.900362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.908660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.909538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:07.910542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:07.911220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:07.911892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:08.135419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:08.147278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:08.151098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:08.171023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce6e87c8-4788-4358-a1a0-ac46eeccaf98 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.291680 Sep 03 20:50:08.177474 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 242/465] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:07 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:08.676985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:08.692259 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-364821cb-637b-42a9-9303-c4d058264084 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.980109 Sep 03 20:50:08.693333 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 224/466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:07 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:09.207116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:09.209786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:09.245141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:09.245653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:09.247158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:09.247414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:09.247877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:09.248311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:09.492289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:09.501970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:09.503544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:09.531991 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78f1aa0e-8acb-4d73-ad8f-42fee245d16e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.327666 Sep 03 20:50:09.537514 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 225/467] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:09 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:09.719644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:09.720483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:09.734530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:09.735422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:09.741515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:09.743044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:09.743698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:09.744553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:09.789245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-939302634", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "eca47d48-10bc-437f-b0d1-1cf63a3c4084"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:09.904303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] validate_networks() for [('eca47d48-10bc-437f-b0d1-1cf63a3c4084', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:50:10.195962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:10.208789 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfddfc02-7df7-4c38-9731-563207d46702 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1332 microversion: 2.1 time: 0.494689 Sep 03 20:50:10.210161 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 226/468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:09 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1332 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:10.567862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:10.568759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:10.596307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:10.596819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:10.597296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:10.598023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:10.598487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:10.598919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:10.817977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:10.829237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:10.830703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:10.848426 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-929ac867-6fb1-460a-b2e4-9ccd1c8d96ff tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.286041 Sep 03 20:50:10.849294 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 227/469] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:10 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:11.094791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:50:11.095847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:50:11.096538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:50:11.097526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:50:11.098165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:50:11.111818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.112433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.113166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.114115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.114761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.115379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.151304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:11.159581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for user 90d7e4c2e577467f949be3dc480cc7a2 and project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:11.179062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:50:11.189521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:50:11.237397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:11.238012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:11.254053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.254915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.255529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.256426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.257083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.258132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.263901 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ad51c51-5c09-4920-b45a-58bbc7740a9c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272863 Sep 03 20:50:11.270785 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 243/470] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:50:11.301344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f04bcd15-60bb-490c-a75c-9f6074dcb3e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:11.301978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f04bcd15-60bb-490c-a75c-9f6074dcb3e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:11.421289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f04bcd15-60bb-490c-a75c-9f6074dcb3e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:11.441513 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f04bcd15-60bb-490c-a75c-9f6074dcb3e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1210 microversion: 2.1 time: 0.157563 Sep 03 20:50:11.443105 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 244/471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:11 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:11.494237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:11.504036 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-beddcf1f-a6cd-46f1-a967-d0b0acb1399a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1537 microversion: 2.1 time: 0.270407 Sep 03 20:50:11.504696 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 228/472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:11 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:11.537948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd5c3b73-47ce-4ad2-a907-2ec32dc8684a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'create', calling method: .version_select at 0x7fae67573430>, body: {"pool": "13d98cc8-7559-432f-b125-dbde69775179"} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:11.879722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:11.881039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:11.887543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.888357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.889117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.890074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:11.890735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:11.891373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:11.985193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:12.008534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:12.015600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:12.028395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6853cb5-6e45-47b5-a4a6-b2ab9ea15164 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.151738 Sep 03 20:50:12.036385 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 229/473] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:11 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:12.468181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:12.468974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:12.480112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:12.482779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:12.483600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:12.484506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:12.487150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:12.487759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:12.660691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:12.671248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe5765b8-7e7c-49f8-a39d-57248fca974f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1206 microversion: 2.1 time: 0.209701 Sep 03 20:50:12.673174 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 230/474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:12 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1206 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:13.068313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:13.069206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:13.079959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:13.082100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:13.083112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:13.083859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:13.088153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:13.088625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:13.354054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:13.375099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:13.385665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:13.403594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:13.410060 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cc1ebed-132a-4472-9091-45adc8d494c1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.342894 Sep 03 20:50:13.413981 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 231/475] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:13 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:50:13.699695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:13.701794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:13.712326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:13.713603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:13.714731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:13.716588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:13.717377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:13.718206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:13.928617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:13.941958 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6356898f-168f-47de-a139-bdf3a2e47d3e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1268 microversion: 2.1 time: 0.248631 Sep 03 20:50:13.944293 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 232/476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:13 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:14.443459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:14.444071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:14.460216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:14.460949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:14.461554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:14.462463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:14.464453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:14.465674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:14.746986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:14.759009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:14.760654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:14.777166 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58553f0b-4683-4777-bcd2-6da8b53d7c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.336346 Sep 03 20:50:14.780315 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 233/477] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:14 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:50:14.812015 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd5c3b73-47ce-4ad2-a907-2ec32dc8684a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.287521 Sep 03 20:50:14.812780 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 245/478] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:50:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:14.825584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: .version_select at 0x7fae68b2e9d0>, body: {"addFloatingIp": {"address": "172.35.4.37"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:14.828747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:14.835700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:14.836518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:14.837232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:14.838474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:14.839145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:14.842560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:15.017425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:50:15.020237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquired lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:50:15.191208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4c5f6b0-944e-428f-b93b-f228ad9588b4 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Action: 'create', calling method: .version_select at 0x7fae675ab670>, body: {"keypair": {"name": "tempest-keypair-1638226066", "type": "ssh", "user_id": "1ee2df69ab474fc9aa85624983fd8fa6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq8miVtkr1tCtGgUMl02ESA6mGMZKV1Uwhelup/iELAWiXecWGsl/1DiyOjc/gIzWzEeEJtECoJbfof4gw5HJqD9BOdVwadeWPqb+WA7L7hO3XqoY9Y5isQP0bI9PNqIg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:15.242913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4c5f6b0-944e-428f-b93b-f228ad9588b4 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:15.267515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4c5f6b0-944e-428f-b93b-f228ad9588b4 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for user ac23076fca324df1885d72bbf28aeac8 and project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:15.351883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4c5f6b0-944e-428f-b93b-f228ad9588b4 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.543864 Sep 03 20:50:15.357435 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 234/479] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 20:50:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 574 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 20:50:15.901220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Calling method '.version_select at 0x7fae67375820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:15.904349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:15.905248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:15.906390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:15.938116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:15.941655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:15.942395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:15.968390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:15.969280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:15.969879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:15.989069 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90db84e5-4a9a-4eab-b2bb-972995d305ae tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.630293 Sep 03 20:50:15.990179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 235/480] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:50:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:16.003185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:16.003923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:16.016248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.016852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.018428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.019524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.019998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.020436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.491442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:16.505081 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83884b63-634d-476b-bc28-0f78af7f7401 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 0.510703 Sep 03 20:50:16.505881 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 236/481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:15 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:16.521306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13f42d1c-0fd6-4a6f-b08c-8d600b2aa556 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Action: 'create', calling method: .version_select at 0x7fae673a8670>, body: {"keypair": {"name": "tempest-keypair-1334445572", "type": "ssh", "user_id": "1ee2df69ab474fc9aa85624983fd8fa6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNoZpuQ5XqGlxtRMpYPvKAMJuw0WQ1FPNnK/13gjhSrfgmSG4KgzBiauradRZob/dQ/LXvrHfXYoHKlCZhk/0Eq19ZDB7xR1BiYAw/GVzVahoWEXdGv+/G4Cyd75XbqXQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:16.555243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-13f42d1c-0fd6-4a6f-b08c-8d600b2aa556 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:16.566230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-13f42d1c-0fd6-4a6f-b08c-8d600b2aa556 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for user ac23076fca324df1885d72bbf28aeac8 and project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:16.638272 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13f42d1c-0fd6-4a6f-b08c-8d600b2aa556 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.130110 Sep 03 20:50:16.642641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 237/482] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 20:50:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 20:50:16.653574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:16.657900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:16.679108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.679778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.680335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.681202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.684627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.685687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.838398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:16.847529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:16.849060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:16.859540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ef07969-75c4-4a7c-8e47-84ec0cdbeffd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.215704 Sep 03 20:50:16.873457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 238/483] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:16 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:16.899475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Calling method '.version_select at 0x7fae673a8430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:16.901897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.903243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.903931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.937874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:16.944270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:16.945310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:16.945988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:16.972370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:16.994648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:17.001652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:17.002516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:17.013303 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a18ba99-27f9-4bb9-81e2-0be4954b4cd2 tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.137902 Sep 03 20:50:17.013979 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 239/484] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Sep 3 20:50:16 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:17.338837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Action: 'update', calling method: .version_select at 0x7fae673a0dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:17.415829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:17.416564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:17.417258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:17.418007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:17.419504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:17.420110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:17.479735 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a4a46063-2b8f-4c81-8203-113c54b81930 tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e" status: 200 len: 240 microversion: 2.36 time: 0.464397 Sep 03 20:50:17.481742 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 240/485] 10.222.0.16 () {62 vars in 1303 bytes} [Sat Sep 3 20:50:17 2022] PUT /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e => generated 240 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:17.495972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8b35612-c6e4-4629-acae-e287ad1d45e7 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Calling method '.version_select at 0x7fae6741fd30>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:17.508778 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8b35612-c6e4-4629-acae-e287ad1d45e7 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1638226066?user_id=1ee2df69ab474fc9aa85624983fd8fa6" status: 200 len: 512 microversion: 2.10 time: 0.025772 Sep 03 20:50:17.509750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 241/486] 10.222.0.16 () {60 vars in 1340 bytes} [Sat Sep 3 20:50:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1638226066?user_id=1ee2df69ab474fc9aa85624983fd8fa6 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:17.578679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1025129913", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:17.646518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:50:17.916644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:50:17.917262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:50:17.917775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:50:17.918319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:50:17.918801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:50:17.930649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:17.931240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:17.931819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:17.932851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:17.933402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:17.934446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:17.962496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:17.971202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:17.992704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:50:18.000307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:50:18.073836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9b4f813-ff0d-4660-87cd-1e6ec7c65788 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562711 Sep 03 20:50:18.077558 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 242/487] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:50:18.086911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Calling method '.version_select at 0x7fae673a8f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:18.089016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.089781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.090494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.126657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.127301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.127837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.145995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.146905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.147535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.156983 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9db58674-52e2-4311-842e-5f7678ca1f4d tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078041 Sep 03 20:50:18.158010 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 243/488] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:50:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:18.162771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47403d55-33e7-4317-975b-70d426624b25", "tag": "27f9de8c-c701-4f5e-af87-e4db6a17edf5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:18.175597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.180391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.180965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.195190 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] Creating event network-changed:27f9de8c-c701-4f5e-af87-e4db6a17edf5 for instance 47403d55-33e7-4317-975b-70d426624b25 on nch2-master-1 Sep 03 20:50:18.200306 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-dba7ed05-46f1-4e6c-807a-886c2967d937 req-4d1ecc26-6236-422b-81fd-41294f8980ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040905 Sep 03 20:50:18.201024 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 244/489] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:18.211227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Calling method '.version_select at 0x7fae67458160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:18.319363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.320260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.321150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.323399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.324094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.324808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.352229 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7a8e431-8290-4fb9-ae0d-800d8b1501aa tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e/detail" status: 200 len: 672 microversion: 2.36 time: 0.149860 Sep 03 20:50:18.356955 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 245/490] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Sep 3 20:50:18 2022] GET /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e/detail => generated 672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:18.371861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-956cc6f8-ae82-46a2-bd03-19d2139f0b01 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Action: 'create', calling method: .version_select at 0x7fae673a0a60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1208970277", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXnJ4oiIllU3jVQa0mCVYry7buct5+tLJzSgY/ewM5SfYDGDLnm/+YwNTX+kWptEoU97Au7v0/KwA/w73WinjQoIbBH3c3MqMYwREMX7liT/P2bIau4if8KDyMjLyYNVw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:18.435368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-956cc6f8-ae82-46a2-bd03-19d2139f0b01 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:18.455923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-956cc6f8-ae82-46a2-bd03-19d2139f0b01 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Getting quotas for user ac23076fca324df1885d72bbf28aeac8 and project ad8850110d7c49ed92be6077d7204301. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:18.493248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:18.508941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-956cc6f8-ae82-46a2-bd03-19d2139f0b01 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.153847 Sep 03 20:50:18.517283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 246/491] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 20:50:18 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 20:50:18.529139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:18.529875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:18.538023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.538560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.540348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.541153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.541711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.542162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.688789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:50:18.916325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:18.924949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7837d56c-2870-42d3-9586-8f0031f83b8d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 0.405869 Sep 03 20:50:18.932927 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 247/492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:18 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:18.938165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:18.941601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:18.961585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.962192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.962732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:18.966898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:18.967549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:18.970960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.101645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:19.115392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:19.125958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:19.151411 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bc276095-6fc7-4833-a85d-8d42ecf1daba tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.217294 Sep 03 20:50:19.152002 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 248/493] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:18 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:19.169513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:19.171878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:19.181278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.182067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.182735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.183830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.184500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.185172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.300428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:19.311285 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-037805c5-4be4-46ea-9c2d-832b2c965ce6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1217 microversion: 2.1 time: 0.149105 Sep 03 20:50:19.325065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 249/494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:19 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:19.338139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Calling method '.version_select at 0x7fae6741f310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:19.340700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.341497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.341938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.364328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.364822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.365288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.371906 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cbf14a7b-dde3-428c-987b-b6ea775d677c tempest-HypervisorAdminUnderV252Test-350838812 tempest-HypervisorAdminUnderV252Test-350838812-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.052362 Sep 03 20:50:19.372819 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 250/495] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 20:50:19 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:19.377838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81bba3fb-e05f-4936-9aae-b22cf4f6e19c tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Calling method '.version_select at 0x7fae673a0940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:19.382422 ncdv-master-1 devstack@n-api.service[140520]: WARNING oslo_db.sqlalchemy.utils [None req-81bba3fb-e05f-4936-9aae-b22cf4f6e19c tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 20:50:19.389256 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81bba3fb-e05f-4936-9aae-b22cf4f6e19c tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=1ee2df69ab474fc9aa85624983fd8fa6" status: 200 len: 726 microversion: 2.10 time: 0.015334 Sep 03 20:50:19.390716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 251/496] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Sep 3 20:50:19 2022] GET /compute/v2.1/os-keypairs?user_id=1ee2df69ab474fc9aa85624983fd8fa6 => generated 726 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:19.395139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Action: 'update', calling method: .version_select at 0x7fae67364940>, body: {"quota_set": {"ram": "2048"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:19.541049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.545729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.553717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.556368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.557035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.558109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.689338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.690425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.692841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.694660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.696350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.698534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.836311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ccc6e39f-bb68-4cbd-a2b0-c6a277a9f81f tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e?user_id=f392a042281840d3ba35a06caf31005b" status: 200 len: 240 microversion: 2.36 time: 0.444795 Sep 03 20:50:19.837433 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 252/497] 10.222.0.16 () {62 vars in 1384 bytes} [Sat Sep 3 20:50:19 2022] PUT /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e?user_id=f392a042281840d3ba35a06caf31005b => generated 240 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:19.843851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6481af08-50ad-4bef-b6c4-adf8294fc985", "tag": "4c02269a-ed30-4041-8fee-981b93f1e881"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:19.860682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:19.861343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:19.862684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:19.881155 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] Creating event network-changed:4c02269a-ed30-4041-8fee-981b93f1e881 for instance 6481af08-50ad-4bef-b6c4-adf8294fc985 on nch1-master-1 Sep 03 20:50:19.890441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7404efae-d04f-4f94-8dd8-548c32434294 req-ae02758f-9f3b-4708-b645-380e7c9564ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050345 Sep 03 20:50:19.891658 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 253/498] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:19.899339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-960ad29a-3274-4c81-ad2b-0af6aa4080ea tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Calling method '.version_select at 0x7fae673a8ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:19.929098 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-960ad29a-3274-4c81-ad2b-0af6aa4080ea tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1208970277" status: 204 len: 0 microversion: 2.10 time: 0.035529 Sep 03 20:50:19.930968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 254/499] 10.222.0.16 () {60 vars in 1325 bytes} [Sat Sep 3 20:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1208970277 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:50:19.936715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-786c1046-b6e0-43c8-a2dd-14990b601a4b tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] Calling method '.version_select at 0x7fae673a0dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:20.365676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-786c1046-b6e0-43c8-a2dd-14990b601a4b tempest-QuotasAdminTestV236-1585191909 tempest-QuotasAdminTestV236-1585191909-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e?user_id=f392a042281840d3ba35a06caf31005b" status: 200 len: 282 microversion: 2.36 time: 0.433024 Sep 03 20:50:20.366263 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 255/500] 10.222.0.16 () {60 vars in 1364 bytes} [Sat Sep 3 20:50:19 2022] GET /compute/v2.1/os-quota-sets/f1b9304b7bd04cbc82441062c0b4af3e?user_id=f392a042281840d3ba35a06caf31005b => generated 282 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:20.383941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d3d7c5f-e974-495e-b398-b13844527b6f tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Calling method '.version_select at 0x7fae67311dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:20.419247 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d3d7c5f-e974-495e-b398-b13844527b6f tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334445572?user_id=1ee2df69ab474fc9aa85624983fd8fa6" status: 204 len: 0 microversion: 2.10 time: 0.051915 Sep 03 20:50:20.420037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 256/501] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 3 20:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334445572?user_id=1ee2df69ab474fc9aa85624983fd8fa6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:50:20.424371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:20.425140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:20.443675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:20.444182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:20.444632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:20.445372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:20.445837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:20.446266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:20.863963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:20.873136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d219f0b-7f0f-4b76-a7f6-64dd4d1d87a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 0.452206 Sep 03 20:50:20.873719 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 257/502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:20 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:20.888398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:20.889982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:20.914112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:20.914616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:20.915652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:20.917025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:20.917497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:20.917943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:21.050419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:21.060306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:21.067531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:21.178013 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dde3604f-d7cb-418b-aabe-698ac6f8d36a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1560 microversion: 2.91 time: 0.198081 Sep 03 20:50:21.178013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 258/503] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:20 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:21.178013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:21.178013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:21.178013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:21.178675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:21.178675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:21.178675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:21.178675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:21.178991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:21.179075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:21.240914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Updating instance_info_cache with network_info: [{"id": "4c02269a-ed30-4041-8fee-981b93f1e881", "address": "fa:16:3e:2a:01:ff", "network": {"id": "593dee90-5ba2-4d54-bda9-d42f054baff1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1041052241-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0ccd04fad8493fbef0a8afc12e0a38", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4c02269a-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:50:21.263595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Releasing lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:50:21.264729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d8c84df-07de-4d46-8920-db8c3f6905c6 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 202 len: 0 microversion: 2.1 time: 6.443132 Sep 03 20:50:21.265574 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 246/504] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:14 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 0 bytes in 6445 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:50:21.274186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-188b93b8-919c-489d-85bb-c31fb485f177 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] Calling method '.version_select at 0x7fae6756b430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:21.274633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:21.294176 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26b4d3ee-c8dd-4cf7-ac51-ba5ba9bc8728 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1271 microversion: 2.1 time: 0.211366 Sep 03 20:50:21.294766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 259/505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:21 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:21.300226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:21.300423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5fb0d16d-8c7f-4b66-b7f0-71537484cb26 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'create', calling method: .version_select at 0x7fae673a0550>, body: {"pool": "13d98cc8-7559-432f-b125-dbde69775179"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:21.329735 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-188b93b8-919c-489d-85bb-c31fb485f177 tempest-KeyPairsV210TestJSON-798409998 tempest-KeyPairsV210TestJSON-798409998-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638226066?user_id=1ee2df69ab474fc9aa85624983fd8fa6" status: 204 len: 0 microversion: 2.10 time: 0.062629 Sep 03 20:50:21.337610 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 247/506] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 3 20:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638226066?user_id=1ee2df69ab474fc9aa85624983fd8fa6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:50:21.911638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:21.913265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:21.917209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:21.925162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:21.926243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:21.927017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:21.928918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:21.929811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:21.930595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:22.671699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:22.686749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5ccbec2-ab0a-4936-b186-02ace58d1289 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 0.777829 Sep 03 20:50:22.705398 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 248/507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:21 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:22.720651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:22.723547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:22.741331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:22.743454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:22.746993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:22.749720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:22.750593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:22.752682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:22.923868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:22.970513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:22.972515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:22.982257 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab7510c9-071c-4b9d-929b-dfbf84ddd14c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.274728 Sep 03 20:50:22.983470 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 249/508] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:22 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:22.994364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:22.995206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:23.017052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:23.018983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:23.022946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:23.023914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:23.025969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:23.026684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:23.173172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:23.181446 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7d27e971-78de-471b-9d70-fd24f42e2bff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1271 microversion: 2.1 time: 0.195287 Sep 03 20:50:23.188473 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 250/509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:22 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:23.713952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:23.726080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:23.743125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:23.745719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:23.749650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:23.750777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:23.751462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:23.752104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.010230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:25.042093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3a772ab-ea75-4760-a3e9-8f931e3be84b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 1.334625 Sep 03 20:50:25.049176 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 251/510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:23 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:25.065356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:25.068663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:25.090442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.091470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.092317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.093432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.095573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.096299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.376237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:25.396041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:25.399581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:25.411293 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c9f2458-06e4-4edb-b626-0f946f4ed53c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.360481 Sep 03 20:50:25.425098 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 252/511] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:25 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:25.425098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:25.425098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:25.438141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.438705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.439256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.440758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.443057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.443693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.755556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5fb0d16d-8c7f-4b66-b7f0-71537484cb26 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.457459 Sep 03 20:50:25.768363 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 260/512] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:50:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:25.794045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47403d55-33e7-4317-975b-70d426624b25", "name": "network-vif-plugged", "status": "completed", "tag": "27f9de8c-c701-4f5e-af87-e4db6a17edf5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:25.852497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.857503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.869086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.923596 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] Creating event network-vif-plugged:27f9de8c-c701-4f5e-af87-e4db6a17edf5 for instance 47403d55-33e7-4317-975b-70d426624b25 on nch2-master-1 Sep 03 20:50:25.933554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e154ba36-d4b4-433b-8ccc-0658716bedef req-e3a060cc-1fee-437a-8d5e-859b2e396ed9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161692 Sep 03 20:50:25.935815 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 261/513] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:25.951825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: .version_select at 0x7fae68a70820>, body: {"addFloatingIp": {"address": "172.35.4.221"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:25.963676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:25.988768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.989350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.989812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:25.990556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:25.992119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:25.992569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:26.247583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:50:26.248267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquired lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:50:26.628952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:26.642235 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c602c06a-6cc4-49ae-ae48-f3235ec70f21 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 1.227336 Sep 03 20:50:26.662135 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 253/514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:25 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:26.673455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:26.678451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:26.699096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:26.699657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:26.700105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:26.704648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:26.705196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:26.705641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:27.073924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179.", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:50:27.075866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Releasing lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:50:27.076577 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.076577 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Request method failure captured: Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action HTTP/1.1 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 46 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73p8gbs76MPo7gQ5X4filFviohCrVdjC7N0VaB05e6xhQhd125Tv-Mgq6Zu4G4Alx4Jy01Venbavafv5sc0DiZwB2DtdaLFbZHj7rmq_ccWheEpHsRWDdkiQKQlJodPNQMud7p9GKS1KH-NRAAyvj7gdvL-Z4rsX-4JhEIIOiz1e4o Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:27.101057 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 78b60bdc00024f6f9cac34b07b8940ac Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: {"addFloatingIp": {"address": "172.35.4.221"}} Sep 03 20:50:27.102685 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6481af08-50ad-4bef-b6c4-adf8294fc985', 'body': {'addFloatingIp': {'address': '172.35.4.221'}}} Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.103471 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:50:27.104480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.105493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.106445 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] Sep 03 20:50:27.107542 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:27.115204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Returning 400 to user: Cannot associate floating IP 172.35.4.221 (05ccbb91-36a6-4016-b880-dbae12c98d4d) with port 4c02269a-ed30-4041-8fee-981b93f1e881 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 13d98cc8-7559-432f-b125-dbde69775179. Sep 03 20:50:27.115204 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-b41f2259-9ece-4b3f-8c76-51b563ffae98'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:27.116435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bb9ebeb-f499-4e3c-beb0-86354a6186ed tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 400 len: 382 microversion: 2.1 time: 1.179508 Sep 03 20:50:27.117264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 262/515] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:25 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 382 bytes in 1181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:50:27.123063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:27.125987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:27.149221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:27.149902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:27.150551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:27.151661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:27.153047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:27.154065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:27.242057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:27.253697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:27.255564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:27.263556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84bf8591-d8cf-4188-8f34-e8b7f9f169ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.145095 Sep 03 20:50:27.285123 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 263/516] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:27 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:27.292795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fcf03a9f-e94d-4f6a-bc66-63471fa10627 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '.version_select at 0x7fae6721f310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:27.479043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:27.508426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93fd5d64-9ba6-4334-9323-7eae5508a0a3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1310 microversion: 2.1 time: 0.842723 Sep 03 20:50:27.509905 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 254/517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:26 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1310 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:27.670577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:27.671332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:27.689753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:27.691614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:27.693123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:27.697681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:27.704773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:27.706575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:28.177688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:28.188175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-274da545-da40-4d58-b831-c8672f73a1a5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 0.522729 Sep 03 20:50:28.197840 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 255/518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:27 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:28.775756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Calling method '.version_select at 0x7fae673baf70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:28.777929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:28.778609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:28.779060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:28.812569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:28.849882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:28.850531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:28.850975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:28.854580 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fcf03a9f-e94d-4f6a-bc66-63471fa10627 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/05ccbb91-36a6-4016-b880-dbae12c98d4d" status: 202 len: 0 microversion: 2.1 time: 1.568311 Sep 03 20:50:28.859870 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 264/519] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:50:27 2022] DELETE /compute/v2.1/os-floating-ips/05ccbb91-36a6-4016-b880-dbae12c98d4d => generated 0 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:50:28.873229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:28.873728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:28.874163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:28.884092 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9fcc6fa-45e4-495d-9bbc-e9c07e793b72 tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.684369 Sep 03 20:50:28.885220 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 256/520] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 20:50:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:28.890603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:28.891394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:28.901391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:28.902045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:28.902989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:28.904049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:28.904652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:28.905477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.022470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:29.035376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:29.038864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:29.051627 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2157bfb-5505-4f51-9623-5fddb7bcffef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.165041 Sep 03 20:50:29.053014 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 257/521] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:28 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:29.063942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:29.064806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:29.086412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.086933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.087383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.088369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.088841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.089301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.299441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9aadb671-eedc-4fda-8cbf-4335a6a9fd81 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:29.314115 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9aadb671-eedc-4fda-8cbf-4335a6a9fd81 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.452635 Sep 03 20:50:29.322014 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 265/522] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:50:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:29.323945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:29.356406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.356920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.357354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.385933 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] Creating event network-changed:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch1-master-1 Sep 03 20:50:29.403440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cbbe5d7e-b785-488b-835d-fbedb3523679 req-0d7a11a0-0d21-46cb-99f3-38c438346896 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085454 Sep 03 20:50:29.406621 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 266/523] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:29.421460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: .version_select at 0x7fae68a70790>, body: {"removeFloatingIp": {"address": "172.35.4.37"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:29.451226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:29.464129 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f48f3556-7e52-4be1-beee-bee22c15ff26 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1491 microversion: 2.1 time: 0.409751 Sep 03 20:50:29.465076 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 258/524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:29 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1491 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:29.472862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Calling method '.version_select at 0x7fae673ba700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:29.475068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.475757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.478770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.544289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.545103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.545769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.560723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d3e745d-2ef4-43d5-b55d-9d3ba6fea14d tempest-HypervisorAdminV228Test-2024676664 tempest-HypervisorAdminV228Test-2024676664-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.091040 Sep 03 20:50:29.574049 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 259/525] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 20:50:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:50:29.580536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:29.581211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:29.608098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.608614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.609099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.609915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:29.610300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:29.610733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:29.727470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=11 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:29.909704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:29.923069 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77295f6e-0c13-481a-9f72-e92cc5264cca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 0.347109 Sep 03 20:50:29.923979 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 260/526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:29 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:30.194470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ab6831a-61ca-4eba-9361-dbd8f2559e18 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1376289588", "id": 1260316751, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:30.214369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:30.222697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:30.223512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:30.225404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:30.226598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:30.229945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:30.231978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:30.242521 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0ab6831a-61ca-4eba-9361-dbd8f2559e18 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.317374 Sep 03 20:50:30.249004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 261/527] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:29 2022] POST /compute/v2.1/flavors => generated 425 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:30.346668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=44 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:30.452698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:30.453404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:30.462957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:30.464018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:30.464848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:30.465858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:30.466824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:30.467445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:30.633650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:50:30.634067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquired lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:50:30.883108 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e6e06f8-8966-4ad6-a784-fb71096430dd tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1642 microversion: 2.1 time: 0.627578 Sep 03 20:50:30.884291 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 262/528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:30 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1642 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:31.216708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2071511064", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:31.782799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:50:32.109053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Building network info cache for instance {{(pid=140520) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:50:32.563652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:50:32.564674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:50:32.566144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:50:32.566834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:50:32.567419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:50:32.587797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:32.594026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:32.594654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:32.596291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:32.597046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:32.597687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:32.660440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Getting quotas for project 7ca286521ec549da9fde582fc148f45a. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:32.671230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Getting quotas for user d7956df7a8954bbc9571a8d7c29e3f34 and project 7ca286521ec549da9fde582fc148f45a. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:32.704480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:50:32.711243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:50:32.830516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14163ee7-8b13-4601-8a8b-a2c127034edf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944123 Sep 03 20:50:32.837708 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 263/529] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:50:32.843534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:32.844319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:32.851836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:32.852606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:32.853317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:32.854281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:32.854988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:32.855674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:33.400538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:33.415370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:33.420109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:33.437539 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f95a4d14-3144-42d0-b91c-6af52792a9c2 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.596846 Sep 03 20:50:33.442586 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 264/530] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:32 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:33.450432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7cef8210-c367-4e43-9b13-4978393aa824 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:33.474373 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7cef8210-c367-4e43-9b13-4978393aa824 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029646 Sep 03 20:50:33.478452 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 265/531] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Sep 3 20:50:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:50:33.493416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:33.494190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:33.528477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:33.530488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:33.531098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:33.535784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:33.538656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:33.540268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:33.812742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Updating instance_info_cache with network_info: [{"id": "4c02269a-ed30-4041-8fee-981b93f1e881", "address": "fa:16:3e:2a:01:ff", "network": {"id": "593dee90-5ba2-4d54-bda9-d42f054baff1", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1041052241-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d0ccd04fad8493fbef0a8afc12e0a38", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4c02269a-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140520) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:50:33.865445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Releasing lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:50:33.866896 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2e7edf13-92b4-418b-af58-56db3a1e2478 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 202 len: 0 microversion: 2.1 time: 4.459010 Sep 03 20:50:33.868407 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 267/532] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:29 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 0 bytes in 4461 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:50:33.895496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:33.897914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:33.914512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:33.917496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:33.918358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:33.919490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:33.920168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:33.920964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.276640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:34.301448 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cfe54df9-0f22-4a62-835c-cbfa50fdbda4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 0.428003 Sep 03 20:50:34.303116 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 268/533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:33 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:34.315050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6481af08-50ad-4bef-b6c4-adf8294fc985", "tag": "4c02269a-ed30-4041-8fee-981b93f1e881"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:34.329435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.330195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.330846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.347851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] Creating event network-changed:4c02269a-ed30-4041-8fee-981b93f1e881 for instance 6481af08-50ad-4bef-b6c4-adf8294fc985 on nch1-master-1 Sep 03 20:50:34.355483 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-78e7b7eb-4093-4cda-81b3-3e094571a8c4 req-96946812-1e0a-4639-8536-2be10ded85b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049719 Sep 03 20:50:34.356316 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 269/534] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:34.363296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:34.364415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:34.370407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-652d7b5f-33c3-4929-b0b7-d9f6bbf20bbe tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1642 microversion: 2.1 time: 0.877718 Sep 03 20:50:34.378680 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 266/535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:33 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1642 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:34.384569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ef1d9d0-a3ee-45f2-b575-cbca73de750a tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-539682061", "id": 2054595935, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:34.386197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.389068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.390243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.391196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.391903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.403795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.414114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:34.454699 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ef1d9d0-a3ee-45f2-b575-cbca73de750a tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.074813 Sep 03 20:50:34.465839 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 267/536] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:34 2022] POST /compute/v2.1/flavors => generated 424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:34.474195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c433813e-820c-4246-b46d-e59302cf1944 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '.version_select at 0x7fae678045e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:34.553589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:34.578847 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-44faf214-9099-4954-9cc6-e39409db633e tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1210 microversion: 2.1 time: 0.220181 Sep 03 20:50:34.582417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 270/537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:34 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1210 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:34.609724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:34.618528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.620015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.621920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.636060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.648405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.649061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.685786 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bde0b357-9ea9-41bb-93e7-a38bac856d61 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097944 Sep 03 20:50:34.686995 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 271/538] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:50:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:34.703465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a173e315-0056-4bf7-b85f-e71203cb5dd2 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:34.717722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a173e315-0056-4bf7-b85f-e71203cb5dd2 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028681 Sep 03 20:50:34.719115 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 272/539] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Sep 3 20:50:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:50:34.729723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:34.730543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:34.739749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.740483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.741798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.745032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.745549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.746037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.870164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:34.879186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:34.880644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:34.899004 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22b268ec-b80c-4713-af7f-cb89209c9f69 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.174358 Sep 03 20:50:34.899867 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 273/540] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:34 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:34.918204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:34.931073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:34.944553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.945343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.945976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.946949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:34.947561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:34.948144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:34.999962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lazy-loading 'flavor' on Instance uuid 47403d55-33e7-4317-975b-70d426624b25 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:35.033789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 47403d55-33e7-4317-975b-70d426624b25] Going to try to live migrate instance to nch1-master-1 {{(pid=140520) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:50:38.540096 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c433813e-820c-4246-b46d-e59302cf1944 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cd46988f-357e-4856-81b9-690996461c3e" status: 202 len: 0 microversion: 2.1 time: 4.071511 Sep 03 20:50:38.549881 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 268/541] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:50:34 2022] DELETE /compute/v2.1/os-floating-ips/cd46988f-357e-4856-81b9-690996461c3e => generated 0 bytes in 4083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:50:38.555320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a3425d2-2103-4f05-b1f4-dd2143aa186a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Action: 'create', calling method: .version_select at 0x7fae6742c940>, body: {"keypair": {"name": "tempest-keypair-425500010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvaoKMvnuzLDLphI+cbu5uGgMjZEJUqxYA61pq+iDF5qvsQO/7BQX8abg4PnClbComZdEZWZx0P2lYszY9p3fDA5QJGD0D81GAxtAD32jCue8ySabAQ38BEUjUA85Z7tQ=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:38.634746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8a3425d2-2103-4f05-b1f4-dd2143aa186a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for project 68cdc132e95244478bf01490de3e0941. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:38.648850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8a3425d2-2103-4f05-b1f4-dd2143aa186a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for user ee0fdf107484448d862ac3216df0d9dc and project 68cdc132e95244478bf01490de3e0941. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:38.807457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a3425d2-2103-4f05-b1f4-dd2143aa186a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256377 Sep 03 20:50:38.819982 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 269/542] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:50:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:38.826111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:38.827355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:38.847641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:38.851358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:38.855278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:38.857955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:38.861993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:38.869498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:39.380552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:39.406017 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3b0c4f0-7e3d-429a-8643-a91828bb1473 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 0.580670 Sep 03 20:50:39.406833 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 270/543] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:38 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:39.411623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:39.425574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:39.441366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:39.443229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:39.457102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:39.459116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:39.459858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:39.461016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:39.470201 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-668211df-b3ac-48ce-bdbd-b4a17610c21f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25/action" status: 202 len: 0 microversion: 2.1 time: 4.568783 Sep 03 20:50:39.471269 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 274/544] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:34 2022] POST /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25/action => generated 0 bytes in 4571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:50:39.479527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:39.480212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:39.516610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:39.520884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:39.523321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:39.524113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:39.524615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:39.525232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:39.723738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:39.739775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:39.744830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:39.757025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6550ffbe-a9f9-4285-9dc5-d197d0f39480 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.284588 Sep 03 20:50:39.757833 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 275/545] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:39 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:39.853527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bc75e8d-ae6a-4a3a-9f3f-5e1ecfed6fff tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] Calling method '.version_select at 0x7fae67180940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:40.234722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bc75e8d-ae6a-4a3a-9f3f-5e1ecfed6fff tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 6074 microversion: 2.1 time: 0.476036 Sep 03 20:50:40.235556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 276/546] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:50:39 2022] GET /compute/v2.1/os-networks => generated 6074 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:40.240777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "name": "network-vif-plugged", "status": "completed", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:40.272840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:DELETE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:40.280717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.281490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.282137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.309091 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] Creating event network-vif-plugged:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch1-master-1 Sep 03 20:50:40.323930 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-92419e75-bbc4-42c2-8859-72ced4fd5643 req-0c257430-f4c7-414c-8c49-d6e91b821820 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086386 Sep 03 20:50:40.327577 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 277/547] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:40.341050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e396603c-f485-4063-8d21-f1b655cc57b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e396603c-f485-4063-8d21-f1b655cc57b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Request method failure captured: Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action HTTP/1.1 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 34 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73p8gbs76MPo7gQ5X4filFviohCrVdjC7N0VaB05e6xhQhd125Tv-Mgq6Zu4G4Alx4Jy01Venbavafv5sc0DiZwB2DtdaLFbZHj7rmq_ccWheEpHsRWDdkiQKQlJodPNQMud7p9GKS1KH-NRAAyvj7gdvL-Z4rsX-4JhEIIOiz1e4o Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:40.348393 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 78b60bdc00024f6f9cac34b07b8940ac Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: {"addFloatingIp": {"address": ""}} Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:40.349846 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6481af08-50ad-4bef-b6c4-adf8294fc985', 'body': {'addFloatingIp': {'address': ''}}} Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '' Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:40.350642 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:50:40.351983 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:50:40.353170 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 03 20:50:40.353170 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:40.354517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e396603c-f485-4063-8d21-f1b655cc57b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:40.356197 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e396603c-f485-4063-8d21-f1b655cc57b5 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 400 len: 142 microversion: 2.1 time: 0.026475 Sep 03 20:50:40.357036 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 278/548] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:40 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:50:40.388121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6c3ae9-c010-4235-abf1-619067890146", "tag": "47b347d8-a51a-484a-93cd-c48f8dd558ae"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:40.421063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.421716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.422288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.445750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] Creating event network-changed:47b347d8-a51a-484a-93cd-c48f8dd558ae for instance 7f6c3ae9-c010-4235-abf1-619067890146 on nch2-master-1 Sep 03 20:50:40.458367 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ff05ce4a-d93f-454d-895e-46c4fd642720 req-83423ba0-746e-4b86-ae3b-d8c032494179 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100273 Sep 03 20:50:40.459375 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 279/549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:40.464475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:40.473857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:40.490927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:40.502788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f9c9c75a-e027-4a06-99d5-bc04a1d0505d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1314 microversion: 2.1 time: 1.091878 Sep 03 20:50:40.503711 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 271/550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:39 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1314 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:40.505219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.509785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f167d465-0363-4928-a9dd-5bdb808f54ef tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] Calling method '.version_select at 0x7fae674c9f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:40.510588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.511415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.512683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.513446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.514084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.798084 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f167d465-0363-4928-a9dd-5bdb808f54ef tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/13d98cc8-7559-432f-b125-dbde69775179" status: 200 len: 652 microversion: 2.1 time: 0.292957 Sep 03 20:50:40.798767 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 272/551] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 20:50:40 2022] GET /compute/v2.1/os-networks/13d98cc8-7559-432f-b125-dbde69775179 => generated 652 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:40.806758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:40.809730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:40.824679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.837693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.838539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.839585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.841451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.842108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.880618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:50:40.881338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquired lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:50:40.934292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:40.947336 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2fcc7d9-b55e-45ff-9f9f-32a35f45b4f2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.486611 Sep 03 20:50:40.947950 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 280/552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:40 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:40.965328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:40.965957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:40.980249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.980757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.981427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:40.982155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:40.982617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:40.983050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.023109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Releasing lock "refresh_cache-6481af08-50ad-4bef-b6c4-adf8294fc985" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:50:41.024530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] HTTP exception thrown: floating IP not found Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Request method failure captured: Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action HTTP/1.1 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 41 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73p8gbs76MPo7gQ5X4filFviohCrVdjC7N0VaB05e6xhQhd125Tv-Mgq6Zu4G4Alx4Jy01Venbavafv5sc0DiZwB2DtdaLFbZHj7rmq_ccWheEpHsRWDdkiQKQlJodPNQMud7p9GKS1KH-NRAAyvj7gdvL-Z4rsX-4JhEIIOiz1e4o Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:50:41.028300 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 78b60bdc00024f6f9cac34b07b8940ac Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:50:41.029638 ncdv-master-1 devstack@n-api.service[140519]: exception: floating IP not found Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6481af08-50ad-4bef-b6c4-adf8294fc985', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:41.030380 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 03 20:50:41.031488 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.034228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Returning 404 to user: floating IP not found {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:41.035337 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f765f2d6-4280-4e81-98b8-9a0bdbb7d400 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 404 len: 67 microversion: 2.1 time: 0.235404 Sep 03 20:50:41.042803 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 273/553] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:40 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 67 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:50:41.048211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:41.049166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:41.056562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.057337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.058014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.059503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.060174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.060821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.193090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:41.216761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:41.223134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:41.234778 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a7123e6-6807-4322-9cda-2180596d376e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.190347 Sep 03 20:50:41.238133 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 274/554] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:41 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:41.253942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ad1dff1-985b-4ca2-99dd-77af821c6234 tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] Calling method '.version_select at 0x7fae674c9280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:41.328853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:41.337135 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8bcb29a-6894-4f06-939f-919a033a024a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 0.388089 Sep 03 20:50:41.339952 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 281/555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:40 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:41.363063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b7e79ca-5397-494d-b9bd-08402f8dafb3 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:41.517032 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7b7e79ca-5397-494d-b9bd-08402f8dafb3 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b7e79ca-5397-494d-b9bd-08402f8dafb3 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Request method failure captured: Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action HTTP/1.1 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 44 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73p8gbs76MPo7gQ5X4filFviohCrVdjC7N0VaB05e6xhQhd125Tv-Mgq6Zu4G4Alx4Jy01Venbavafv5sc0DiZwB2DtdaLFbZHj7rmq_ccWheEpHsRWDdkiQKQlJodPNQMud7p9GKS1KH-NRAAyvj7gdvL-Z4rsX-4JhEIIOiz1e4o Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:41.519527 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 78b60bdc00024f6f9cac34b07b8940ac Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:50:41.522807 ncdv-master-1 devstack@n-api.service[140520]: exception: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6481af08-50ad-4bef-b6c4-adf8294fc985', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:41.523742 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 03 20:50:41.524968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:41.526937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b7e79ca-5397-494d-b9bd-08402f8dafb3 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:41.527899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b7e79ca-5397-494d-b9bd-08402f8dafb3 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action" status: 404 len: 88 microversion: 2.1 time: 0.171266 Sep 03 20:50:41.532435 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 282/556] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:41 2022] POST /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985/action => generated 88 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:50:41.543430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:41.544220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:41.553235 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ad1dff1-985b-4ca2-99dd-77af821c6234 tempest-NetworksTest-1062278792 tempest-NetworksTest-1062278792-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 6074 microversion: 2.1 time: 0.309169 Sep 03 20:50:41.553824 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 275/557] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:50:41 2022] GET /compute/v2.1/os-networks => generated 6074 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:41.561517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:41.562033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:41.573161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.573676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.574160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.578515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.593812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.594611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.595233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.599097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.599818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.600761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.601419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.603468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.678268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:50:41.793341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:41.825076 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4581b1b-a903-4309-8edf-0e328925c2fd tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 204 len: 0 microversion: 2.1 time: 0.269008 Sep 03 20:50:41.828633 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 276/558] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:50:41 2022] DELETE /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:50:41.836933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:41.842543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:41.855407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.859372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.860047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:41.861306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:41.867154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:41.867986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.194311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.204245 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41317942-b631-4253-9dc3-7fb94015b04a tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1543 microversion: 2.1 time: 0.371389 Sep 03 20:50:42.214729 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 277/559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:41 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1543 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:42.221791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:42.229971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:42.250727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.253643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.255553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.258648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.261761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.262442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.349272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.360558 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b8a2ef4-37e8-4007-ab09-bab6c9f2fded tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1314 microversion: 2.1 time: 0.827976 Sep 03 20:50:42.363487 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 283/560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:41 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:42.387257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:42.391174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:42.404161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.405793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.408493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.409430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.409916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.411085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.616400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.623724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:42.630219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c95f26d4-2a1f-4680-aac9-7f83eaed5ba0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.414008 Sep 03 20:50:42.630806 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 278/561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:42 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:42.656813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.662458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:42.678339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:42.678687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.680415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:42.693655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.694195 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-069c6454-bb3c-4e53-ac4f-c1ba7c5609b7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.329522 Sep 03 20:50:42.694314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.694731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.694852 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 284/562] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:42 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:42.695481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:42.695961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:42.696390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:42.730744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:43.240956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:43.241499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:43.253172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:43.253678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:43.254121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:43.254846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:43.255302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:43.255726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:43.745886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:43.759282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f795212-ba6b-4eb8-a440-f6326eaf888b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1313 microversion: 2.1 time: 1.127398 Sep 03 20:50:43.759892 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 279/563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:42 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1313 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:43.766364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:43.766913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:43.788801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:43.799518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:43.800163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:43.803252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:43.803824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:43.804351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:44.090793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:44.118907 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c879e8ef-bc56-4b9f-9251-6576e4842485 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1543 microversion: 2.1 time: 0.881769 Sep 03 20:50:44.120350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 285/564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:43 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1543 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:44.155059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:44.163625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:44.182391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:44.184409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:44.185197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:44.186184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:44.186955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:44.187689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:44.653869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:44.666205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:44.677357 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3bff7217-1c6d-4ce4-85cd-c8a2f2f3abfb tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1314 microversion: 2.1 time: 0.913302 Sep 03 20:50:44.678222 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 280/565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:43 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:44.685221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:44.689110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:44.696916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:44.697703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:44.703340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:44.704489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:44.705241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:44.705908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:45.240155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:45.267963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:45.269644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:45.279565 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc5d12e5-f762-4a81-a6b7-171178f7b741 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.598513 Sep 03 20:50:45.304925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 281/566] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:44 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:45.344346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1804657313", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "2054595935", "adminPass": "***", "networks": [{"uuid": "5148a9b6-e1e4-44b4-9e4d-fbd66236154a"}], "security_groups": [{"name": "tempest-securitygroup--368912719"}], "key_name": "tempest-keypair-425500010", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:45.626345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:45.645082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5824af6e-c8d7-4b04-907a-5a9e570d43ca tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 1.520605 Sep 03 20:50:45.647400 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 286/567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:44 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:45.674330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:45.678619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:45.698095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:45.699093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:45.702173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:45.703251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:45.703906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:45.704489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:45.723853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] validate_networks() for [('5148a9b6-e1e4-44b4-9e4d-fbd66236154a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:50:46.200673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:46.213911 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2eb92651-231b-44a5-b094-6149d65fa273 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1462 microversion: 2.1 time: 0.560783 Sep 03 20:50:46.215191 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 287/568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:45 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1462 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:46.220254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:46.227676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:46.245054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.245791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.250523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.251805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.253623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.256115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.372289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.373044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.373647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.375985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lazy-loading 'fault' on Instance uuid 6481af08-50ad-4bef-b6c4-adf8294fc985 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:50:46.563155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b60bdc00024f6f9cac34b07b8940ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0ccd04fad8493fbef0a8afc12e0a38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:46.572077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d60f62e4-c86e-4bef-8910-c1f11c61ce73 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 200 len: 1322 microversion: 2.1 time: 0.355622 Sep 03 20:50:46.572649 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 288/569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:46 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:46.582612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47403d55-33e7-4317-975b-70d426624b25", "name": "network-vif-unplugged", "status": "completed", "tag": "27f9de8c-c701-4f5e-af87-e4db6a17edf5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:46.599447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:50:46.600100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:50:46.600686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:50:46.601440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:50:46.601971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:50:46.614735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.615493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.616098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.619165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.620812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.622030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.628177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.628802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.629387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.643037 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] Creating event network-vif-unplugged:27f9de8c-c701-4f5e-af87-e4db6a17edf5 for instance 47403d55-33e7-4317-975b-70d426624b25 on nch2-master-1 Sep 03 20:50:46.648879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-56ebaeee-8e8e-4aef-a531-7b4a487c1801 req-3161260d-2b70-43b6-b772-72a914ac8f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075040 Sep 03 20:50:46.649998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 289/570] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:46.655488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6481af08-50ad-4bef-b6c4-adf8294fc985", "name": "network-vif-deleted", "tag": "4c02269a-ed30-4041-8fee-981b93f1e881"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:46.687801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.688289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.688725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.691947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for project 68cdc132e95244478bf01490de3e0941. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:46.703613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] Creating event network-vif-deleted:4c02269a-ed30-4041-8fee-981b93f1e881 for instance 6481af08-50ad-4bef-b6c4-adf8294fc985 on nch1-master-1 Sep 03 20:50:46.707977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for user ee0fdf107484448d862ac3216df0d9dc and project 68cdc132e95244478bf01490de3e0941. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:46.718706 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f7026fea-4217-4cbb-9c44-eaeece854833 req-1744d5ab-ebe0-46b3-b08d-4e994c0d3233 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067158 Sep 03 20:50:46.719597 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 290/571] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:46.732934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:46.733657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:46.749387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.749775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:50:46.750146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.750594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.751311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:46.751769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:46.752196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:46.755116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:50:46.906491 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5f6c3b18-79cd-4899-8e9a-89fb3a93f56c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.612811 Sep 03 20:50:46.907747 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 282/572] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:50:47.087320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.090242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:47.100497 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e338ae04-5e7c-4315-983d-11435fb0e62b tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1314 microversion: 2.1 time: 0.379623 Sep 03 20:50:47.101274 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 291/573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:46 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:47.110711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:47.111330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:47.120196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.124282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.127191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.127961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.129531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.130345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.252952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.263851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.267855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.278885 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb794566-af1e-4f11-b30a-e53345351e2c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.176209 Sep 03 20:50:47.286922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 292/574] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:47 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:47.317016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6c3ae9-c010-4235-abf1-619067890146", "name": "network-vif-plugged", "status": "completed", "tag": "47b347d8-a51a-484a-93cd-c48f8dd558ae"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:47.348886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.349401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.349841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.361887 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] Creating event network-vif-plugged:47b347d8-a51a-484a-93cd-c48f8dd558ae for instance 7f6c3ae9-c010-4235-abf1-619067890146 on nch2-master-1 Sep 03 20:50:47.366858 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d31af0c8-e219-4878-a3b0-35039187230e req-c817de81-b564-47ef-b2f6-1544c5ad505b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077893 Sep 03 20:50:47.367795 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 293/575] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:47.373615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:47.374595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:47.381385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.382260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.382700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.383593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.384699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.385452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.463171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:47.463741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:47.477800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.478328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.478779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.479510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.479976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:47.480453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:47.690618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.705677 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-401c953b-859d-4f5e-a6f6-540773b1a9a2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.336629 Sep 03 20:50:47.706231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 294/576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:47 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:47.727295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f91a6f28-2de0-4020-b132-876c7ed93203 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:47.727658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f91a6f28-2de0-4020-b132-876c7ed93203 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:47.956040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f91a6f28-2de0-4020-b132-876c7ed93203 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:47.965796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f91a6f28-2de0-4020-b132-876c7ed93203 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1264 microversion: 2.1 time: 0.242714 Sep 03 20:50:47.968664 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 295/577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:47 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:47.980547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:47.982938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] [instance: 6481af08-50ad-4bef-b6c4-adf8294fc985] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:47.995196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:47.998623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.002757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.003721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.004353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.005092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.027212 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-312cd9ff-ada4-4704-bf43-44f4a986f7c6 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1613 microversion: 2.1 time: 1.116270 Sep 03 20:50:48.037371 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] HTTP exception thrown: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. Sep 03 20:50:48.042214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 283/578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:46 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1613 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Request method failure captured: Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 HTTP/1.1 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73p8gbs76MPo7gQ5X4filFviohCrVdjC7N0VaB05e6xhQhd125Tv-Mgq6Zu4G4Alx4Jy01Venbavafv5sc0DiZwB2DtdaLFbZHj7rmq_ccWheEpHsRWDdkiQKQlJodPNQMud7p9GKS1KH-NRAAyvj7gdvL-Z4rsX-4JhEIIOiz1e4o Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:50:48.045817 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d0ccd04fad8493fbef0a8afc12e0a38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8d0ccd04fad8493fbef0a8afc12e0a38 Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 78b60bdc00024f6f9cac34b07b8940ac Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:50:48.047235 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6481af08-50ad-4bef-b6c4-adf8294fc985'} Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:50:48.047903 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. Sep 03 20:50:48.049689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:50:48.050851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] Returning 404 to user: Instance 6481af08-50ad-4bef-b6c4-adf8294fc985 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:50:48.050851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a20bb3f-f108-4640-b1a9-4effc11117eb tempest-FloatingIPsAssociationNegativeTestJSON-2142388594 tempest-FloatingIPsAssociationNegativeTestJSON-2142388594-project] 10.222.0.16 "GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985" status: 404 len: 111 microversion: 2.1 time: 0.077423 Sep 03 20:50:48.059225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 296/579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:47 2022] GET /compute/v2.1/servers/6481af08-50ad-4bef-b6c4-adf8294fc985 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:50:48.065713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:48.066436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:48.083386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.084144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.084803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.085907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.086612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.087256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.129532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:48.130386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:48.143161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.144084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.144688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.145672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.146284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.146859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.255816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f91eb6e45a14d1e8c18c9b94ae1567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf7e7f35c3f42b0a853dc2a0c196753', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:48.256780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] flavor_id is None. Assuming migration. {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 03 20:50:48.257617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 20:50:48.600919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:48.615750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a65898b2-2552-405b-9881-2d6e260ea94d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1314 microversion: 2.1 time: 0.488884 Sep 03 20:50:48.620347 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 297/580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:48 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:48.632552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:48.634084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:48.634310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-82058e6f-7a00-4bea-a9d4-1fae071ffe6f tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4/action" status: 202 len: 0 microversion: 2.1 time: 0.576829 Sep 03 20:50:48.635221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 284/581] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:50:48 2022] POST /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:50:48.644059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:48.645018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:48.652791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.653682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.654842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.656223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.658169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.658987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.659773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.661585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.662053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.662944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.663568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.666871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.896341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:48.923926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:48.925560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:48.948457 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b421a68-b088-4559-aeae-4bae75a8006e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1537 microversion: 2.91 time: 0.324687 Sep 03 20:50:48.951546 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 298/582] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:48 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:48.962897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:48.965925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:48.987235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.988392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.989750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:48.992833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:48.993736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:48.994497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.375683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:49.385589 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-314e321e-93ad-4cee-a9d4-fb19ea2d08e2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.432752 Sep 03 20:50:49.389799 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 299/583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:48 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:49.400654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:49.401532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:49.409384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:49.412848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:49.414951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.416086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:49.417547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:49.420847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.499650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:49.509085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cb7a42e-f8bb-4354-b2f2-95c2f37f53cc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1322 microversion: 2.1 time: 0.114915 Sep 03 20:50:49.526212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 300/584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:49 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1322 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:49.535845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47403d55-33e7-4317-975b-70d426624b25", "tag": "27f9de8c-c701-4f5e-af87-e4db6a17edf5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:49.552195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:49.552874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:49.553457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.571992 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] Creating event network-changed:27f9de8c-c701-4f5e-af87-e4db6a17edf5 for instance 47403d55-33e7-4317-975b-70d426624b25 on nch2-master-1 Sep 03 20:50:49.579571 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b6255b29-5cbf-4330-988b-deba9a431685 req-b7adffaf-234e-441a-ae5d-9c38f9927aaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051833 Sep 03 20:50:49.580632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 301/585] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:49.640995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:49.642352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:49.654308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:49.654829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:49.655278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.656007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:49.656476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:49.656931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:49.820557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:49.828516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f24089b-456d-45d0-8373-1534d0da3b20 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1471 microversion: 2.1 time: 1.188507 Sep 03 20:50:49.847503 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 285/586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:48 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1471 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:50.127634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1393842056", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:50.219047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:50:50.722177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:50.730772 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c800a05-2414-4b4a-99a6-6788554bf858 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1464 microversion: 2.1 time: 1.094569 Sep 03 20:50:50.735261 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 302/587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:49 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1464 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:50.754544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:50.755244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:50.777985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:50.778508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:50.779032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:50.779798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:50.789745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:50.791858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.021002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:50:51.022362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:50:51.024310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:50:51.025516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:50:51.025975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:50:51.078481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.081578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.083017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.083866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.084015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:51.090704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.093379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:51.095361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.099191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:51.143442 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d236b9a8-1ced-4a52-bed7-0420717c2589 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1537 microversion: 2.91 time: 0.391986 Sep 03 20:50:51.148212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 303/588] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:50 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1537 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:51.163841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:51.169013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:51.186810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.187565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.188186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.189038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Getting quotas for project f968aad8b96b4ba9ade8cafd689c1b7f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:50:51.189434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.190043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.190624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.210183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Getting quotas for user ad3cb96a474d4d04be4e16212a2bc8c9 and project f968aad8b96b4ba9ade8cafd689c1b7f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:50:51.236329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:50:51.239701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:50:51.321985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a445af71-3dbc-4686-b30f-93d5004e8ab6 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473242 Sep 03 20:50:51.325528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 286/589] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:50:51.331447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:51.332185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:51.361128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.361736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.363303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.365802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:51.367397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:51.368102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:51.640483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:51.655380 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b9b7093a-a3a2-44b0-9304-b431c1f4f5eb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1322 microversion: 2.1 time: 0.327665 Sep 03 20:50:51.674423 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 287/590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:51 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:52.066541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Calling method '.version_select at 0x7fae67d32700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.088469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.089393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.090142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.114997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.139666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.142192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.143185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.143299 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da76cf9d-202a-441d-8f56-402f49cc1ee6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.989176 Sep 03 20:50:52.143952 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 304/591] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:51 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:52.187247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.187852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:52.203232 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5df693e8-754c-4734-b46e-4c81a51b3bfa tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/7ca286521ec549da9fde582fc148f45a?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405" status: 200 len: 695 microversion: 2.1 time: 0.542604 Sep 03 20:50:52.204622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 288/592] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Sep 3 20:50:51 2022] GET /compute/v2.1/os-simple-tenant-usage/7ca286521ec549da9fde582fc148f45a?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405 => generated 695 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:52.210891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.211389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.211823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.220445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.220974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.221426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.222069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ada48ef-33f6-40b0-9c40-7f9686ab87fd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.222967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ada48ef-33f6-40b0-9c40-7f9686ab87fd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:52.342643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ada48ef-33f6-40b0-9c40-7f9686ab87fd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.353878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ada48ef-33f6-40b0-9c40-7f9686ab87fd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1223 microversion: 2.1 time: 0.137299 Sep 03 20:50:52.375287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 289/593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:52 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:52.386673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.388289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:52.396161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.397028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.397740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.398732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.400308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.401072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.744928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.758970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.762434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.774611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:52.791124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f60a706-a40b-4b05-ab97-87bc5c86b43d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1471 microversion: 2.1 time: 0.626889 Sep 03 20:50:52.792193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 305/594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:52 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1471 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:52.804877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '.version_select at 0x7fae6722e430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.826203 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-309663b6-2629-4809-9ba7-90a8f9591256 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1480 microversion: 2.91 time: 0.441450 Sep 03 20:50:52.847449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 290/595] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:52 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1480 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:52.853914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.857530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.862799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.874112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:52.876100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:52.903700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.904626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.905125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.906407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.907192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.907848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.915806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:52.921596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:52.922395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:52.970409 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ebd4c0d2-c901-44e8-8779-2719edf4372d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/7ca286521ec549da9fde582fc148f45a?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405" status: 200 len: 695 microversion: 2.1 time: 0.176666 Sep 03 20:50:52.972165 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 306/596] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Sep 3 20:50:52 2022] GET /compute/v2.1/os-simple-tenant-usage/7ca286521ec549da9fde582fc148f45a?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405 => generated 695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:52.976917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:52.984365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:53.003767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.004521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.005184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.006101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.006780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.007379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.190493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140520) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 20:50:53.389122 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c811a08-cdf2-447a-bf71-298c32c6b4ec tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action" status: 202 len: 0 microversion: 2.91 time: 0.415595 Sep 03 20:50:53.393805 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 307/597] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:50:52 2022] POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:50:53.409053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Calling method '.version_select at 0x7fae6743a550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:53.429261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.433669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.434362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.519355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.519860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.520310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.583579 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f56cffe-7af6-45f8-beee-16f3cb42a944 tempest-TenantUsagesTestJSON-1959144195 tempest-TenantUsagesTestJSON-1959144195-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405&detailed=1" status: 200 len: 6245 microversion: 2.1 time: 0.187825 Sep 03 20:50:53.584926 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 308/598] 10.222.0.16 () {58 vars in 1335 bytes} [Sat Sep 3 20:50:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-02T20%3A50%3A50.752405&end=2022-09-04T20%3A50%3A50.752405&detailed=1 => generated 6245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:53.590767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:53.591644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:53.599506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.600000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.600631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.601539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.602137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.602808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.751142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:53.762258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8bad2214-a34a-4e63-bda0-70d561fa808c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.896387 Sep 03 20:50:53.762885 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 291/599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:52 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:53.781698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:53.782507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:53.793641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.794361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.795039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:53.797394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:53.798059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:53.800454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.118188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:54.147597 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee5928cd-b8bd-4f06-8bce-e647104893d7 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1275 microversion: 2.1 time: 0.383008 Sep 03 20:50:54.147933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 292/600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:53 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:54.160222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:54.161195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:54.176889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.177499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.178141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.179120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.179835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.182758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.443361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:54.461564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:54.463350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:54.480243 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7465bfa5-0dee-4503-b871-12ee912672ef tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1488 microversion: 2.91 time: 0.331206 Sep 03 20:50:54.481053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 293/601] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:54 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1488 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:54.482119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:54.487072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:54.492709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f208ca52-d646-4dac-ae20-33219e2e3751 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.906681 Sep 03 20:50:54.493326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 309/602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:53 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:54.493774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:54.509194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.510067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.510714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.511743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.511856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:54.512484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:54.512738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.513476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.533302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.538000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.540724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.541613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.543270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.545421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.562904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:50:54.665456 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da8f48b6-324b-4fb3-9364-afa0336673f6 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 204 len: 0 microversion: 2.1 time: 0.182640 Sep 03 20:50:54.667218 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 294/603] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:50:54 2022] DELETE /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:50:54.687454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:54.692360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:54.705372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.710559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.711363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:54.712430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:54.713088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:54.713662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.101868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.109592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:55.139257 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f02ebe86-0238-4ebd-ae40-ef26fb4e5fcf tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1470 microversion: 2.1 time: 0.467178 Sep 03 20:50:55.141189 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 295/604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:54 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:55.154411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:55.155465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:55.176188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.177735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.179035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.182433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.182922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.183931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.365415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.375631 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2cfe5ca-af7c-402d-a25a-846897d47ef1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1471 microversion: 2.1 time: 0.875887 Sep 03 20:50:55.376609 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 310/605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:54 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1471 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:55.382075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:55.382692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:55.389820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.390667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.391341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.392058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.392522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.392979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.410047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:55.495964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.504695 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a6e56b1e-65e5-4fdd-91df-76aa83b25739 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1281 microversion: 2.1 time: 0.126303 Sep 03 20:50:55.505612 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 311/606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:55 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:55.511973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b96611-6298-451a-9356-63a43f50dbbf", "tag": "6ed400e9-e401-4d6c-a318-0f30376c7981"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:55.522463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.523592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.524102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.539822 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] Creating event network-changed:6ed400e9-e401-4d6c-a318-0f30376c7981 for instance 80b96611-6298-451a-9356-63a43f50dbbf on nch1-master-1 Sep 03 20:50:55.549324 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6c67134f-5f4b-4db8-a01a-c7c062dca1a4 req-e59ef20c-6132-45cd-85e1-7a80518d9b6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041489 Sep 03 20:50:55.550051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 312/607] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:55.557434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:55.558187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:55.564732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.565569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.566021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.566812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.567280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.567715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.590777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.607797 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cebf6589-89d4-49cb-8353-77ea7e506d8d tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.462230 Sep 03 20:50:55.609099 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 296/608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:55 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:55.626033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:55.627028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:55.647290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.649250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.650304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.651310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:55.652592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:55.653319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:55.742343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.770203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.774639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:55.795061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-65a753fd-15cc-42c6-8b69-a8cda041e5d9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.243113 Sep 03 20:50:55.809524 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 313/609] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:55 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:56.165487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:56.166558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:56.171820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:56.173946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.174788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.175543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:56.176596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.178143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.178591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:56.181194 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-983660eb-994e-402d-a77a-29f3d68ebe08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.570576 Sep 03 20:50:56.197311 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 297/610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:55 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:56.398901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:56.399633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:56.407500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.408276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.409072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:56.410213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.412427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.415953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:56.785845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:56.800423 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-354a69ea-35e2-4d1c-b69b-22e85a636918 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1470 microversion: 2.1 time: 0.640337 Sep 03 20:50:56.802056 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 314/611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:56 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1470 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:56.810444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:56.812287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:56.822667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.824656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.825749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:56.827664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:56.828408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:56.829711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.245244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.285374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff40f763-707e-4f68-9af4-0f59d9be51bb tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1281 microversion: 2.1 time: 0.476244 Sep 03 20:50:57.286353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 315/612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:56 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1281 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:57.291096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:57.293030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:57.305617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.306667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.307484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.308580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.309287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.310008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.441353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.488367 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-186d05b4-6c1d-4af0-b38a-dccade3f1153 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 1.087760 Sep 03 20:50:57.491438 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 298/613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:56 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:57.504616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:57.506407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:57.517419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.518200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.518929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.519856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.520520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.521483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.674477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.689792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.692150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.700272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24f02056-ce48-41c1-8907-7fc692804099 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.207324 Sep 03 20:50:57.715159 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 299/614] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:57 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:57.735845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:57.737563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:57.758373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.759050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.759910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.761126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:57.780654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:57.782616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:57.961650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:57.967083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:57.978397 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f893054b-a853-4f0d-868b-e6f80c636a6c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.690926 Sep 03 20:50:57.984862 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 316/615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:57 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:57.996369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:57.997390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:58.019293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.019872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.020438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.022549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.023083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.023654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.180704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:58.196764 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c4871eba-099e-4228-9289-f109f7d099f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 0.477487 Sep 03 20:50:58.220230 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 300/616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:57 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:58.232233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6c3ae9-c010-4235-abf1-619067890146", "name": "network-vif-deleted", "tag": "47b347d8-a51a-484a-93cd-c48f8dd558ae"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:50:58.270348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.271842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.272469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.314865 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] Creating event network-vif-deleted:47b347d8-a51a-484a-93cd-c48f8dd558ae for instance 7f6c3ae9-c010-4235-abf1-619067890146 on nch2-master-1 Sep 03 20:50:58.334275 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1b4de519-372c-4557-b7de-466dcbcb1211 req-dfdfd952-1aa0-4413-bdfa-21c9c081e696 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108688 Sep 03 20:50:58.337896 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 301/617] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:50:58.344087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7956df7a8954bbc9571a8d7c29e3f34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca286521ec549da9fde582fc148f45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:58.360871 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91a108a7-267b-4cd3-92b7-b7ddcb87243d tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 200 len: 1428 microversion: 2.1 time: 0.367129 Sep 03 20:50:58.365418 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 317/618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:57 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 1428 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:58.368329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:58.374270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:58.383815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:58.387292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.396210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.396957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.398016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.402053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.402821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.523873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:58.525335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:58.537521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.539285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.540670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.541674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:58.543605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:58.544743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:58.965582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:58.977703 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-79adea8b-9410-44e5-8059-4d3634f91f76 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.628708 Sep 03 20:50:58.981626 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 302/619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:58 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:50:58.992774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:58.993449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:59.009506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.010124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.010634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:59.013279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.015414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.015910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:59.240670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:59.260945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:59.270919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:59.288371 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c1ea95b-579c-45da-b373-40d8a96c1b2d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.305444 Sep 03 20:50:59.305778 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 303/620] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:50:58 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:50:59.305778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:59.305778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:59.309913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.310703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.311364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:59.312382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.313338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:50:59.314410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.318027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:59.327206 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f1b9280-f451-4af5-b264-909891e0df8b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.809107 Sep 03 20:50:59.344312 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 318/621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:58 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:50:59.359278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:50:59.359917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:50:59.378986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.379415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.379869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:50:59.380611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:50:59.381101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:50:59.389591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.071912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:00.091170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d283dec-ee3d-46fb-bf0d-b68d8213e98c tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.800619 Sep 03 20:51:00.095327 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 304/622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:59 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:00.108341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:00.109449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] [instance: 7f6c3ae9-c010-4235-abf1-619067890146] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:00.129262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.130089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.130712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.131632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.132279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.132890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.161495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] HTTP exception thrown: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Request method failure captured: Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 HTTP/1.1 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE74TT1Ifk5CYqzA8v5eOcG0rILPmy47ovylT_3nSiQ0x7om0D1yBm2Qrz7vBgXcfi3luz3iRDcldJaRuDSdxKKijrzZpevkuK3mqqtyCLpcCvcYXbO273JRfmmzYffK3IIaDzSxBiGIlXfjcqTZ3UbMq9nSpPmiSr_iQQ9Av1AD5AN4 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7ca286521ec549da9fde582fc148f45a Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TenantUsagesTestJSON-258967548 Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:51:00.170692 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ca286521ec549da9fde582fc148f45a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ca286521ec549da9fde582fc148f45a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ca286521ec549da9fde582fc148f45a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ca286521ec549da9fde582fc148f45a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TenantUsagesTestJSON-258967548 Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7ca286521ec549da9fde582fc148f45a Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TenantUsagesTestJSON-258967548 Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TenantUsagesTestJSON-258967548-project Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d7956df7a8954bbc9571a8d7c29e3f34 Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TenantUsagesTestJSON-258967548-project Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. Sep 03 20:51:00.172046 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '7f6c3ae9-c010-4235-abf1-619067890146'} Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:00.172792 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. Sep 03 20:51:00.173963 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:00.176156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] Returning 404 to user: Instance 7f6c3ae9-c010-4235-abf1-619067890146 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:00.177242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2af5940d-cd6d-4288-84f9-3f159a10d1c9 tempest-TenantUsagesTestJSON-258967548 tempest-TenantUsagesTestJSON-258967548-project] 10.222.0.16 "GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146" status: 404 len: 111 microversion: 2.1 time: 0.080038 Sep 03 20:51:00.177971 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 305/623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:00 2022] GET /compute/v2.1/servers/7f6c3ae9-c010-4235-abf1-619067890146 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:51:00.202500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:00.205823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:00.228422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.236399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.237741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.238875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.239879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.251633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.905761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:00.923921 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e3400b7-6847-43ca-b8ee-192b751be795 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.744296 Sep 03 20:51:00.926678 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 306/624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:00 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:00.938321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:00.949373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:00.951635 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-326f3607-e546-47b1-b301-261afa5e1f1a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1501 microversion: 2.1 time: 1.606127 Sep 03 20:51:00.951943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:00.956871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 319/625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:50:59 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1501 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:00.963731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.965404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.967952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.968810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.969333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:00.969476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.970061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.972257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:00.980364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:00.993355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.996681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:00.997356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:00.998845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:00.999483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:01.003283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:01.127158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:01.144021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:01.145863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:01.152470 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c7340391-65c7-4249-9ff6-96425aa0e19f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.221753 Sep 03 20:51:01.154310 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 307/626] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:00 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:01.161066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:01.165916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:01.182908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:01.183670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:01.186124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:01.187235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:01.188607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:01.191797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:01.730431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:01.742732 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b7bedc2e-c123-4d37-b51a-41cb8184b524 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.587003 Sep 03 20:51:01.744177 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 308/627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:01 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:01.949576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:01.950205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:01.980817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:01.983651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:01.985487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:01.989803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:01.992227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:01.992695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:02.139157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:02.347936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=24 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:02.425051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.460646 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf96e0f6-d2f1-487f-aaea-2e815248cbf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 1.500645 Sep 03 20:51:02.461743 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 320/628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:00 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:02.469500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:02.470925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:02.486671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:02.488562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:02.489574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:02.490528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:02.491027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:02.498169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.508663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:02.513549 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b98f5049-d115-4307-a1f9-71528a150da9 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.566970 Sep 03 20:51:02.529482 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 309/629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:01 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:02.534674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:02.535537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:02.563782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:02.565898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:02.565898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:02.565898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:02.573396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:02.578519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:02.931179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.940814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.947132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.961036 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42712033-7f12-48bf-8985-a8c0169f1d35 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.430320 Sep 03 20:51:02.965976 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 310/630] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:02 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:02.990656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:02.994758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:02.996482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:03.006941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f987575-03f9-4b2f-8824-143ef74509b0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1491 microversion: 2.1 time: 0.543948 Sep 03 20:51:03.020924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 321/631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:02 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1491 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:03.031016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.031016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.031016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.031016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.031459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.031459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.036357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c0f1c99-89bf-4167-bb81-b73c58fdfe11 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '.version_select at 0x7fae67a580d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:03.040168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c0f1c99-89bf-4167-bb81-b73c58fdfe11 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.043386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c0f1c99-89bf-4167-bb81-b73c58fdfe11 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.043933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c0f1c99-89bf-4167-bb81-b73c58fdfe11 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.112393 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c0f1c99-89bf-4167-bb81-b73c58fdfe11 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.079590 Sep 03 20:51:03.116924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 322/632] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:51:03 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:51:03.133071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:03.133071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:03.164050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.169471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.172326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.174613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.175301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.177765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.379473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:03.393297 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ea964b4-a3ae-4471-9956-532f82cbdbba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.405518 Sep 03 20:51:03.395501 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 311/633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:02 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:03.402851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b96611-6298-451a-9356-63a43f50dbbf", "name": "network-vif-plugged", "status": "completed", "tag": "6ed400e9-e401-4d6c-a318-0f30376c7981"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:03.414478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.415337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.416247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.435770 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] Creating event network-vif-plugged:6ed400e9-e401-4d6c-a318-0f30376c7981 for instance 80b96611-6298-451a-9356-63a43f50dbbf on nch1-master-1 Sep 03 20:51:03.442982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-70474187-cc84-4446-a41e-b762263e25c3 req-a99e9b79-8a5b-4c49-b7f3-04cfe4ac8c07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046044 Sep 03 20:51:03.447816 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 312/634] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:03.519474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:03.868825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f96df5f-6545-40e2-ac05-4a603fbba447 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] Calling method '.version_select at 0x7fae673ba700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:03.936419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f96df5f-6545-40e2-ac05-4a603fbba447 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] 10.222.0.16 "GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790" status: 200 len: 784 microversion: 2.1 time: 0.486513 Sep 03 20:51:03.937015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 313/635] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:51:03 2022] GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790 => generated 784 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:03.953348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:03.954094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:03.976711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.977284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.977697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.978423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:03.978876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:03.979312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:03.984262 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53987a1e-3071-4a85-a44b-264dbc25f82c tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1642 microversion: 2.1 time: 0.855835 Sep 03 20:51:03.997495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 323/636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:03 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1642 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:04.002621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:04.002917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:04.023635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.029387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.029387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.044153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.044604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.047290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.476863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.488514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59633a16-63e2-443f-94b8-d3648ccd8c0d tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.498477 Sep 03 20:51:04.489685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.493757 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 324/637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:03 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:04.515669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8aa53d50-c758-46dc-bf30-cded70c4f198 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] Calling method '.version_select at 0x7fae6718f790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:04.517918 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d43cf163-5486-4937-8880-bfc890f752b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.569537 Sep 03 20:51:04.531389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 314/638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:03 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:04.535577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:04.536281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:04.550303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.550884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.551397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.552337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.553607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.554661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.580209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:04.652301 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8aa53d50-c758-46dc-bf30-cded70c4f198 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.150704 Sep 03 20:51:04.653987 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 325/639] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 3 20:51:04 2022] GET /compute/v2.1/images => generated 445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:04.665440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-364740199", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "eca47d48-10bc-437f-b0d1-1cf63a3c4084"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:04.690207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.699952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.701696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.711351 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e5f0969-3f61-4d85-b108-604e8e02072f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.189777 Sep 03 20:51:04.712491 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 315/640] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:04 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:04.719866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:04.721066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:04.728937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.729750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.730371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.731991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] validate_networks() for [('eca47d48-10bc-437f-b0d1-1cf63a3c4084', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:51:04.734543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:04.735196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:04.735821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:04.985006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:04.995858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8353d310-0e78-4300-a418-195122df3daf tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1389 microversion: 2.1 time: 0.280759 Sep 03 20:51:04.999373 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 316/641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:04 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1389 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:05.008700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a22aafa-3bb4-4a70-82e5-03de63272a82", "tag": "5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:05.028516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:05.029053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:05.033213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:05.050283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] Creating event network-changed:5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d for instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 on nch2-master-1 Sep 03 20:51:05.058855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c554596b-e31f-4f4d-85e8-95dea54132c6 req-139279ba-c84d-4905-a49b-2a081fb1bfd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060145 Sep 03 20:51:05.059550 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 317/642] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:05.065160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24bfbf0b-729e-4ca2-8dac-5e0446d45359 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] Calling method '.version_select at 0x7fae6724fe50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:05.134499 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24bfbf0b-729e-4ca2-8dac-5e0446d45359 tempest-ListImagesTestJSON-63312368 tempest-ListImagesTestJSON-63312368-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.073683 Sep 03 20:51:05.135886 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 318/643] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:51:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:05.515956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:05.516744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:05.539896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:05.540980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:05.543352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:05.544555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:05.546572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:05.548191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.000992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.018255 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b00511dc-0788-42ec-b8a0-72ac2c30aece tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.507355 Sep 03 20:51:06.022123 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 319/644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:05 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:06.033818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:06.035729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:06.050885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.051373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.055039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.056012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.056492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.056977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.211370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:51:06.212273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:51:06.213122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:51:06.213843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:51:06.214667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:51:06.236111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.237348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.237718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.238767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.242511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.243965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.291992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:06.307311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for user 90d7e4c2e577467f949be3dc480cc7a2 and project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:06.354947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:51:06.375808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:51:06.432707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.453997 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c095c901-00cb-4364-b3ea-b33cbcfcb826 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.430710 Sep 03 20:51:06.470175 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 320/645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:06 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:06.479037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:06.481044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:06.483441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d75ac04b-eccf-40c5-963d-9f5e4bfb69ef tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827973 Sep 03 20:51:06.492545 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 326/646] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:51:06.499660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:06.501384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:06.511039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.512292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.512798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.513374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.513798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.515065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.516187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.517557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.517758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:06.518807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:06.518807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.520173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:06.710153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.721233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.728639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.742943 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1302ea5c-cb80-49d2-b2fc-f7560f1840e7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.270721 Sep 03 20:51:06.744137 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 321/647] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:06 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:06.771206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-313d5518-8ca9-46c4-a8bb-c72d438e7d78 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:06.773014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-313d5518-8ca9-46c4-a8bb-c72d438e7d78 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:06.916102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-313d5518-8ca9-46c4-a8bb-c72d438e7d78 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:06.926712 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-313d5518-8ca9-46c4-a8bb-c72d438e7d78 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1210 microversion: 2.1 time: 0.181255 Sep 03 20:51:06.927779 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 322/648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:06 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1210 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:07.045838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:07.046744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:07.070142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.070739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.071278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.072074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.072612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.073268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.119557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:07.132984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b52441e5-6424-4385-8e10-1d0bd5b5ea20 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1589 microversion: 2.1 time: 0.636889 Sep 03 20:51:07.148391 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 327/649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:06 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1589 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:07.445101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-71e24bf0-db8f-4506-9b00-b2c28c07b0a9 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:07.464642 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-71e24bf0-db8f-4506-9b00-b2c28c07b0a9 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.320666 Sep 03 20:51:07.467032 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 328/650] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:07.476978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:07.479135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:07.499632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.500313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.500940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.503635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.508878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.509606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.707186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:07.719716 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07709194-54bb-479d-bd8d-feab41fe5171 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.677877 Sep 03 20:51:07.722853 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 323/651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:07 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:07.732926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d077a42d-a06e-45f4-accb-1b0cd47233a6 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:07.781404 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-327004ad-2c31-4200-b214-fd0864a907dc tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312662 Sep 03 20:51:07.783001 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 329/652] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:51:07 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf/os-interface => generated 285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:07.791659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:07.794266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:07.814097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.817726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.819241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.822508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:07.823346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:07.828717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:07.843835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d077a42d-a06e-45f4-accb-1b0cd47233a6 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.119503 Sep 03 20:51:07.875468 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 324/653] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:51:07 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:08.205748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:08.229293 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-377924b5-340c-4611-a2d6-f2183dd0ab64 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.445103 Sep 03 20:51:08.232310 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 330/654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:07 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:08.243575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:08.250049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:08.270015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.273340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.274057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.289298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.290070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.291261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.351144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-860016884", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:08.430552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:08.440366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:08.449944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:08.458897 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd1d5613-0443-4439-9d29-539de6adc233 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.225220 Sep 03 20:51:08.473428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 331/655] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:08 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:08.496767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d117490-668c-4dcb-b9d4-19d0701a4f50 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:08.499608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] validate_networks() for [('57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:51:08.514297 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d117490-668c-4dcb-b9d4-19d0701a4f50 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039272 Sep 03 20:51:08.515051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 332/656] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:08.520067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:08.529461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:08.541599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.545504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.546288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.547149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.556754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.557406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.580085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:08.719267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:08.735947 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6297b490-e94c-438d-9e41-9c0b92781d08 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1262 microversion: 2.1 time: 0.219401 Sep 03 20:51:08.737127 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 333/657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:08 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1262 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:08.763818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e63337c9-fb73-4124-a1a4-37cd36d04971 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:08.781585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e63337c9-fb73-4124-a1a4-37cd36d04971 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036752 Sep 03 20:51:08.797034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 334/658] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:08.802210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:08.802977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:08.810750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.811407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.812047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.812925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:08.813546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:08.814084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:08.993031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:09.008277 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61f20d41-71c2-4b78-af20-8937a167c9ee tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.209878 Sep 03 20:51:09.009427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 335/659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:08 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:09.015009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c88a0d2d-d777-46fe-a380-88c904655358 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.043894 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c88a0d2d-d777-46fe-a380-88c904655358 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032364 Sep 03 20:51:09.043894 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 336/660] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:09.069138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f72dd83-6de0-46bd-a576-638bd6c68c01 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.085981 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f72dd83-6de0-46bd-a576-638bd6c68c01 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021737 Sep 03 20:51:09.086962 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 337/661] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:09.302223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5076e15-583e-449d-a8f7-81f0a5572c42 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae671d25e0>, body: {"keypair": {"name": "tempest-keypair-862532089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE2qevwrPf2F0yij0T/rUsEagFWHOnr2cytSkd960ib6vLcQkrtIgwr1ahl2kp6GT7E8y+IrAY5R2xwPU7G8IlSkqoSpcvmJXD6ct47hy/x4njY5iF4XaTwtsnvDH52iw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:09.347647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f5076e15-583e-449d-a8f7-81f0a5572c42 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:09.365763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f5076e15-583e-449d-a8f7-81f0a5572c42 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:09.428206 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5076e15-583e-449d-a8f7-81f0a5572c42 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.340098 Sep 03 20:51:09.428971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 338/662] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:51:09.433735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d386b48-2bc7-4bef-855c-d904d59f422f tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.472966 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d386b48-2bc7-4bef-855c-d904d59f422f tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.042849 Sep 03 20:51:09.473921 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 339/663] 10.222.0.16 () {58 vars in 1169 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:09.478866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.479476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:09.488336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.488834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.489315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:09.490952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.491418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.491889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:09.653961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:09.665481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8aa0470-e227-4963-aa49-8e64efae9d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.190434 Sep 03 20:51:09.680924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 340/664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:09.680924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f16f0e7f-dc6c-4e99-8834-f68dedb9b1d2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae67180670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.682808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f16f0e7f-dc6c-4e99-8834-f68dedb9b1d2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-862532089" status: 200 len: 511 microversion: 2.2 time: 0.013172 Sep 03 20:51:09.685000 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 341/665] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-862532089 => generated 511 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:09.689049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-33e8a23d-2b2f-436a-b1b5-2e02963f4388 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.703072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-33e8a23d-2b2f-436a-b1b5-2e02963f4388 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017799 Sep 03 20:51:09.703954 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 342/666] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:09.709219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.709792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:09.719282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.719706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.720141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:09.720947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.721446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.721842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:09.818628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:09.829853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:09.832319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:09.838514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e4a2db1-b135-47ec-ab02-1ac075e760d0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.133580 Sep 03 20:51:09.840013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 343/667] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:09.846261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0916149e-3b9b-4401-98e9-230e07a407e3 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6718f310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.869220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0916149e-3b9b-4401-98e9-230e07a407e3 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862532089" status: 204 len: 0 microversion: 2.2 time: 0.027756 Sep 03 20:51:09.870137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 344/668] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Sep 3 20:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862532089 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:09.883410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7ad6bd2-1131-4783-8665-dc9c879053b0 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.897838 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7ad6bd2-1131-4783-8665-dc9c879053b0 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026583 Sep 03 20:51:09.898824 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 345/669] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:09.920363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:09.921423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:09.930585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.931635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.932273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:09.934076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:09.934777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:09.936570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.070486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:10.081599 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a646379-f9fb-4de8-ba59-4da55ec6d9a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1262 microversion: 2.1 time: 0.172623 Sep 03 20:51:10.096541 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 346/670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:09 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:10.125797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85eeac7d-aa43-43aa-8536-b7ce9a262bd7 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae6711b430>, body: {"keypair": {"name": "tempest-keypair-1380036600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6yz2tOQ4aVTbpOT+KDHyJwAPY8RXFhKkQsrBDhZsbYfxGkAQ0Cd4qv0KlMYZu5bfI3FEEry1Bh/ZSBrC8JCfavKr9tv4uMjXX3R+5T2nbzGkvLo8fcgGPCpC0hWkeZLw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:10.160547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-85eeac7d-aa43-43aa-8536-b7ce9a262bd7 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:10.175239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-85eeac7d-aa43-43aa-8536-b7ce9a262bd7 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:10.210887 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85eeac7d-aa43-43aa-8536-b7ce9a262bd7 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.112702 Sep 03 20:51:10.218217 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 347/671] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:51:10.225804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12a76024-b8f8-4a5b-8f93-ee40770dd33d tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.280240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12a76024-b8f8-4a5b-8f93-ee40770dd33d tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.060765 Sep 03 20:51:10.287311 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 348/672] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:10.287311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.287311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:10.296610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.297173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.297615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.298457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.298816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.299279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.329371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:51:10.330893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:51:10.331657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:51:10.332315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:51:10.332986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:51:10.348170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.349056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.352142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.353881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.358445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.359013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.423167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:10.441002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for user 778561ee5e474accb31816f357985f44 and project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:10.459736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:51:10.463258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:51:10.579137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3bf64d5-dde9-4d1b-b4eb-eae82a768869 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.701657 Sep 03 20:51:10.586411 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 325/673] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:51:10.600443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d32a6b92-08bb-4027-aea4-53c5dacdedfc tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6724fb80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.652427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:10.663615 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a5cace06-c85b-43bc-8046-b4257a15a5e2 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.380826 Sep 03 20:51:10.664713 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 349/674] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:10.688319 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d32a6b92-08bb-4027-aea4-53c5dacdedfc tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380036600" status: 204 len: 0 microversion: 2.2 time: 0.087868 Sep 03 20:51:10.688813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83774a96-09c2-4f13-8803-8eaa08f1fcff tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.690601 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 326/675] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Sep 3 20:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380036600 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:10.711550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.713478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83774a96-09c2-4f13-8803-8eaa08f1fcff tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047457 Sep 03 20:51:10.715557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:10.720688 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 350/676] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:10.737496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.738987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:10.752144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:10.763208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.763983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.764478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.765544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:10.766134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:10.766665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:10.838137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:10.849463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:10.853359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:10.856990 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0a28f34-df40-4d5f-8f51-c83debcc0840 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1261 microversion: 2.25 time: 0.165164 Sep 03 20:51:10.859045 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 327/677] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:10.876246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6048ec73-9a1d-4a66-bec1-f05dd36ba747 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae6724fe50>, body: {"keypair": {"name": "tempest-keypair-2133459805", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:10.899597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6048ec73-9a1d-4a66-bec1-f05dd36ba747 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:10.905777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6048ec73-9a1d-4a66-bec1-f05dd36ba747 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:10.935573 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6048ec73-9a1d-4a66-bec1-f05dd36ba747 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.073308 Sep 03 20:51:10.936805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 328/678] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:10 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:51:10.946829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63d1603e-4ca1-4418-9f8f-493dddf17464 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.978280 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63d1603e-4ca1-4418-9f8f-493dddf17464 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.039968 Sep 03 20:51:10.988767 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 329/679] 10.222.0.16 () {58 vars in 1144 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:10.997065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:10.998124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:11.004684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.005514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.006023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.006806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.007330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.007909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.062819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.072697 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b2407dd-6474-4211-804c-052076dbce70 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.350813 Sep 03 20:51:11.074443 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 351/680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.079577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.080196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:11.086781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.087273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.087899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.088617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.089141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.089658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.113065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.122558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.124005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.135299 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5bccd6e2-96da-431e-a49c-d9de1c53556c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.144619 Sep 03 20:51:11.136759 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 330/681] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:10 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:11.161443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b96611-6298-451a-9356-63a43f50dbbf", "tag": "6ed400e9-e401-4d6c-a318-0f30376c7981"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:11.177958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.178580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.179167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.206307 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] Creating event network-changed:6ed400e9-e401-4d6c-a318-0f30376c7981 for instance 80b96611-6298-451a-9356-63a43f50dbbf on nch1-master-1 Sep 03 20:51:11.222709 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d0fe89f5-6511-4b92-a535-9d4a577473ee req-73bb41a7-cfe5-4bed-8b6e-f38ba548a50d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083539 Sep 03 20:51:11.226508 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 331/682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.232181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-39d99d4d-0487-407b-af55-c5f597a696de tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6724f790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.254353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:11.265492 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-39d99d4d-0487-407b-af55-c5f597a696de tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133459805" status: 204 len: 0 microversion: 2.2 time: 0.037493 Sep 03 20:51:11.271405 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 332/683] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Sep 3 20:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133459805 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:11.287591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c36c0e03-374b-4a2d-a1ef-88917deb83f6 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.299005 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c36c0e03-374b-4a2d-a1ef-88917deb83f6 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024090 Sep 03 20:51:11.307174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 333/684] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.313044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.313993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:11.333230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.333890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.334176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.336959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.338590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.340199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.375492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.390243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59d65531-7f72-48a5-b220-f370924fe70a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 200 len: 1589 microversion: 2.1 time: 0.313552 Sep 03 20:51:11.392650 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 352/685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 1589 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.400070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e956690c-7bbe-4b24-b9ca-096cf9975861 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae6711baf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1614980093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtKu+iiEVREA9M+S44XkarJnesvdFwh/J7bvVxqAJpeKASJh/3vyiAKXG/RKs3yawCN2AUUSXKH4h4Smmx2hZna+/jAgifi6yEkFTibWgL76qEF6/dL2OiRowizLHJiJA=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:11.427977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e956690c-7bbe-4b24-b9ca-096cf9975861 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:11.434469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e956690c-7bbe-4b24-b9ca-096cf9975861 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:11.463486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.471199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e956690c-7bbe-4b24-b9ca-096cf9975861 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.077301 Sep 03 20:51:11.471985 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 353/686] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:51:11.475059 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78c5381d-995d-4656-bffe-421d8532e275 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1270 microversion: 2.1 time: 0.165903 Sep 03 20:51:11.475798 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 334/687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.501937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-54afc162-8c71-45f1-9766-6f4636de15fe tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.502216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a61f491-64eb-4f9f-a059-8d4227bd0b13 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae67296550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-402138277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0twjE50HqhUt2g2rTiM7MYWaxA9tzJqBBCsHkHj/iLqAxlRoyDW0lIspOc9KzuVdA0cjmLle1nAUENKh5ak1qlx+0JN3lg0Xogwr9lK6SB3AKhwHZm/YaIqnwg9Goh2g=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:11.520531 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-54afc162-8c71-45f1-9766-6f4636de15fe tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.035729 Sep 03 20:51:11.521468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 354/688] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.527567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6a61f491-64eb-4f9f-a059-8d4227bd0b13 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:11.535370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6a61f491-64eb-4f9f-a059-8d4227bd0b13 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:11.538510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f92756bc-e638-46c2-b727-d61ebc521b45 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.552442 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f92756bc-e638-46c2-b727-d61ebc521b45 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020687 Sep 03 20:51:11.553885 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 355/689] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.565702 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a61f491-64eb-4f9f-a059-8d4227bd0b13 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.067240 Sep 03 20:51:11.566849 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 335/690] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:51:11.571402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4479413a-72cb-4f69-9b51-b22f287e8e1b tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.580352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c2ccddb-0032-4961-a5dd-f3d57d1c7bb2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae6734b940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1170325417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7ibTJegkxqwS25gNJkrkbaQ+FPrw4+vEzOavty1akNSopQbYmIMeb2pbvl0TRuD3NGFKA6CgPRvFvNmQk4qK2PUp2rN2GqMMZIXManDotcb+8SwPK6o4JY7r7tznNQlA=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:11.583733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4479413a-72cb-4f69-9b51-b22f287e8e1b tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020223 Sep 03 20:51:11.584810 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 356/691] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.597611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb893f11-f4ec-497f-a83e-cd6fab36a846 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.606150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2c2ccddb-0032-4961-a5dd-f3d57d1c7bb2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:11.614878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2c2ccddb-0032-4961-a5dd-f3d57d1c7bb2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:11.621573 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cb893f11-f4ec-497f-a83e-cd6fab36a846 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.028194 Sep 03 20:51:11.622710 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 357/692] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.638563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3ed1fbf-eea4-4da2-a0b2-4f0bc4188707 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.647317 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c2ccddb-0032-4961-a5dd-f3d57d1c7bb2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.071453 Sep 03 20:51:11.647930 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 336/693] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 03 20:51:11.658114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b419b8d1-e508-4985-a799-02e84d4b32fc tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae67222670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.661982 ncdv-master-1 devstack@n-api.service[140519]: WARNING oslo_db.sqlalchemy.utils [None req-b419b8d1-e508-4985-a799-02e84d4b32fc tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 20:51:11.665399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3ed1fbf-eea4-4da2-a0b2-4f0bc4188707 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031251 Sep 03 20:51:11.665998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 358/694] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:11.673020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b419b8d1-e508-4985-a799-02e84d4b32fc tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.017916 Sep 03 20:51:11.673020 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 337/695] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:11.685097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e95bfdff-6e47-469c-9d20-2f1bcd2cf934 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae67914ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.686425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20791703-0e78-4f53-a947-3fe7dc5c39a8 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.694641 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20791703-0e78-4f53-a947-3fe7dc5c39a8 tempest-FlavorsV2TestJSON-79939712 tempest-FlavorsV2TestJSON-79939712-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012987 Sep 03 20:51:11.701038 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 338/696] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.711248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e95bfdff-6e47-469c-9d20-2f1bcd2cf934 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1170325417" status: 204 len: 0 microversion: 2.2 time: 0.030874 Sep 03 20:51:11.712812 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 359/697] 10.222.0.16 () {60 vars in 1321 bytes} [Sat Sep 3 20:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1170325417 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:11.713821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.717085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:11.724586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4f6dc3d-ec5f-4557-b3f3-7beb1321ea96 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6708f670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.737047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.741428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.741877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.742817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.743283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.743735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.751688 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4f6dc3d-ec5f-4557-b3f3-7beb1321ea96 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-402138277" status: 204 len: 0 microversion: 2.2 time: 0.033346 Sep 03 20:51:11.752525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 360/698] 10.222.0.16 () {60 vars in 1318 bytes} [Sat Sep 3 20:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-402138277 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:11.761257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-853f1af6-9ddc-4b27-ae3f-2a4126819015 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6711baf0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.791657 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-853f1af6-9ddc-4b27-ae3f-2a4126819015 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1614980093" status: 204 len: 0 microversion: 2.2 time: 0.033634 Sep 03 20:51:11.793155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 361/699] 10.222.0.16 () {60 vars in 1321 bytes} [Sat Sep 3 20:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1614980093 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:51:11.810165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50ee6f86-e77d-4fa2-b568-2a408e36dca2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae67180790>, body: {"keypair": {"name": "tempest-keypair-1511447406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPesYdkJBajFp9ToscUwXBUQw7a4X6smuxWe1crg7tK4zOASquk0T/c3Mk1LRTQESQOieEAPK+N78pTzwd0q3jLa7+iaZy6Qc2hsuSjIWxqDQSYGQt/UOdvNgPZ6GP6hhQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:11.836062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-50ee6f86-e77d-4fa2-b568-2a408e36dca2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:11.843767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-50ee6f86-e77d-4fa2-b568-2a408e36dca2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:11.891431 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50ee6f86-e77d-4fa2-b568-2a408e36dca2 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.090282 Sep 03 20:51:11.892082 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 362/700] 10.222.0.16 () {62 vars in 1199 bytes} [Sat Sep 3 20:51:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 03 20:51:11.909393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.910024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:11.916187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.916689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.917731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.918460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:11.919092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:11.919511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:11.945241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:11.956414 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3330a96a-df2a-46d2-90c8-4e6be4c20e03 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.252282 Sep 03 20:51:11.957015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 339/701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:11.962462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6216d0d-267f-4f6f-a20d-c1efe818d20f tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae6734b790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:11.976691 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6216d0d-267f-4f6f-a20d-c1efe818d20f tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1511447406" status: 200 len: 513 microversion: 2.2 time: 0.018504 Sep 03 20:51:11.977523 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 340/702] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1511447406 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:11.992747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-669e444f-24bb-427b-b367-5a301201231b tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae672224c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:12.002577 ncdv-master-1 devstack@n-api.service[140519]: WARNING oslo_db.sqlalchemy.utils [None req-669e444f-24bb-427b-b367-5a301201231b tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 20:51:12.007780 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-669e444f-24bb-427b-b367-5a301201231b tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.019170 Sep 03 20:51:12.008784 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 341/703] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:12.012393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:12.020559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cba62cbf-1e63-442d-93d5-f35b02aca95c tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae67296ca0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:12.021951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:12.023399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:12.024794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7e5028f-198c-45c1-9dcb-7815c307a56f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1265 microversion: 2.25 time: 0.126478 Sep 03 20:51:12.025566 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 363/704] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:11 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:12.053676 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cba62cbf-1e63-442d-93d5-f35b02aca95c tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511447406" status: 204 len: 0 microversion: 2.2 time: 0.037481 Sep 03 20:51:12.060832 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 342/705] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Sep 3 20:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511447406 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:12.079948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Action: 'create', calling method: .version_select at 0x7fae6708f5e0>, body: {"keypair": {"name": "tempest-keypair-1875422214", "type": "x509"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:12.097365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:12.098225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:12.110015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.110722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.111312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.114391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.115088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.116113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.165323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:12.191205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:12.262122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.processutils [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp60dijeae/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp60dijeae/temp.key -subj /CN=33f68efd14004d2e8db0f18c588b6780 -extensions v3_req_client {{(pid=140520) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 03 20:51:12.561630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:12.572368 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0377ff0-804c-403b-903d-14f109d756b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1476 microversion: 2.1 time: 0.478986 Sep 03 20:51:12.575854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.processutils [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp60dijeae/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp60dijeae/temp.key -subj /CN=33f68efd14004d2e8db0f18c588b6780 -extensions v3_req_client" returned: 0 in 0.312s {{(pid=140520) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 03 20:51:12.578925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.processutils [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp60dijeae/temp.key -password pass: {{(pid=140520) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 03 20:51:12.581386 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 343/706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:12 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:12.600791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:12.601690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:12.613478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.615537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.619600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.623460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.623962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.633575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.676231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.processutils [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp60dijeae/temp.key -password pass:" returned: 0 in 0.097s {{(pid=140520) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 03 20:51:12.773349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:12.792612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Getting quotas for user 33f68efd14004d2e8db0f18c588b6780 and project ead11d740ca7415d85851b5b2ae62a75. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:12.836780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb3e23a6-ec48-4aa8-9a5d-9a92d7a32061 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.775563 Sep 03 20:51:12.838796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 364/707] 10.222.0.16 () {62 vars in 1198 bytes} [Sat Sep 3 20:51:12 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 778 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:12.846711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:12.847726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:12.857595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.858800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.859479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.861003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:12.862529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:12.863556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:12.963517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:12.975528 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-525cb6c3-2c2c-471f-a92c-e52c6869ff9f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1268 microversion: 2.1 time: 0.133802 Sep 03 20:51:12.977240 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 365/708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:12 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1268 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:12.986982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1f1cfcf-d07e-4cc4-acf1-f44c3d2f0b58 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae670e8c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.002145 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1f1cfcf-d07e-4cc4-acf1-f44c3d2f0b58 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1875422214" status: 200 len: 1534 microversion: 2.2 time: 0.022921 Sep 03 20:51:13.003251 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 366/709] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Sep 3 20:51:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1875422214 => generated 1534 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:13.006165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.010150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.010982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:13.020294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.021451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.022123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.022786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.024595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.024770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.025426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.026021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.033950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68f6d6ec-cf0e-4daa-8566-7463f04b5223 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.451213 Sep 03 20:51:13.056110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 344/710] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:12 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:13.063772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b567ef87-a7af-40e9-9eda-351521ede812 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae671c2940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.075643 ncdv-master-1 devstack@n-api.service[140519]: WARNING oslo_db.sqlalchemy.utils [None req-b567ef87-a7af-40e9-9eda-351521ede812 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 20:51:13.094708 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b567ef87-a7af-40e9-9eda-351521ede812 tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.035722 Sep 03 20:51:13.098761 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 345/711] 10.222.0.16 () {60 vars in 1177 bytes} [Sat Sep 3 20:51:13 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:13.112847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.113774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:13.132975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.134416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.138182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.147964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.147964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.147964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.385915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.396212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.397776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.399046 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1827f3e-2ffe-49e4-a787-9ad60550603a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1313 microversion: 2.25 time: 0.299006 Sep 03 20:51:13.410220 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 346/712] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:13 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:13.410220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-732c7ba7-f2d8-488d-804a-bbf4777dd02e tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] Calling method '.version_select at 0x7fae671c2af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.434867 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-732c7ba7-f2d8-488d-804a-bbf4777dd02e tempest-KeyPairsV22TestJSON-2043028028 tempest-KeyPairsV22TestJSON-2043028028-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875422214" status: 204 len: 0 microversion: 2.2 time: 0.033794 Sep 03 20:51:13.440869 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 347/713] 10.222.0.16 () {60 vars in 1261 bytes} [Sat Sep 3 20:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875422214 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:13.607347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:13.610188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:13.618686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.619380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.619977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.621373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:13.622187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:13.623465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:13.679442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:13.694523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-093bd28c-a5fc-443f-a120-bc7354707f04 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.689371 Sep 03 20:51:13.701931 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 367/714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:13 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:14.000226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:14.001107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:14.014836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.015591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.016214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.017145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.018304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.018901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.262117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.277749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9bac286-cb1d-4162-aab6-14143c133d54 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1475 microversion: 2.1 time: 0.676343 Sep 03 20:51:14.295885 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 348/715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:13 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1475 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:14.303141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:14.303953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:14.313237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.314055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.314852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.316604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.317704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.318416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.441657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.453727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.457236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.473455 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f3d09df-4b75-475a-a051-f314964a4b4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.175847 Sep 03 20:51:14.474626 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 349/716] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:14 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:14.483296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:14.485889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:14.500720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.504345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.505130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.510620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.512079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.512764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.563371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.572280 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d98f6492-3bb6-4e96-94fc-c748582ef8bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.576490 Sep 03 20:51:14.584875 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 368/717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:13 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:14.662696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a22aafa-3bb4-4a70-82e5-03de63272a82", "name": "network-vif-plugged", "status": "completed", "tag": "5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:14.672800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.682440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.683530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.683997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.684460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.685886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:14.687001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc071203-9c09-4811-877e-0f27cec7a403 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1319 microversion: 2.25 time: 0.211117 Sep 03 20:51:14.687563 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 350/718] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:14 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:14.720018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:14.720969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:14.730933 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] Creating event network-vif-plugged:5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d for instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 on nch2-master-1 Sep 03 20:51:14.734930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.735796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.736476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.737301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:14.737849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:14.738350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:14.744244 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d0387b04-98ee-48e5-9de1-71b1a8073d9c req-f8ff1f64-f5bc-4526-8166-2e36cd713505 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083014 Sep 03 20:51:14.747584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 369/719] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:51:15.189451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:15.210147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.212603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.214081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.252522 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Creating event network-vif-unplugged:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch2-master-1 Sep 03 20:51:15.303297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:51:15.322888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0fdf0927-20ea-4d5f-8e93-5a827ff04d8a req-a45a9527-3925-44cb-becf-8d017f957da9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138394 Sep 03 20:51:15.328305 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 370/720] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:51:15.345913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:15.349303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:15.367170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.371731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.372519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.375178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.376143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.378088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.453323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.482140 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ef8eb7d0-9926-4b3b-a170-f53de94425d1 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1323 microversion: 2.1 time: 0.765973 Sep 03 20:51:15.491205 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 351/721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:14 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1323 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:15.527719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:15.528367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:15.545189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.545696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.546144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.546861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.547326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.547756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.552301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:15.696887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.709266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.712239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.719842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ea0609f-b3f1-4d53-b683-e0e2fc5c63bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.217024 Sep 03 20:51:15.721523 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 352/722] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:15 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:15.729200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:15.730379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:15.740123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.741169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.742505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.743564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.745896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.746527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.787741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.805581 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a13a9054-2f5a-4b7a-b4c7-5be6733f4d45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1475 microversion: 2.1 time: 0.475713 Sep 03 20:51:15.806225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 371/723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:15 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1475 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:15.812298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:15.813201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:15.828487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.829182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.829712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.830527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:15.831075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:15.831721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:15.969486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.993061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.994735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:15.997827 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-abadf5c3-5762-4c03-ab89-b0fcdea6cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1319 microversion: 2.25 time: 0.190408 Sep 03 20:51:15.999441 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 372/724] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:15 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:16.007390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9709dc-96f2-4f5b-a2bf-0d650631ccee", "tag": "2c393c94-4352-403b-b4e0-98e4a866bdd6"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:16.021796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.022783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.023978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.041093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] Creating event network-changed:2c393c94-4352-403b-b4e0-98e4a866bdd6 for instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee on nch2-master-1 Sep 03 20:51:16.048977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5d6f719b-cd8f-462a-828d-5a0037bf1f93 req-33ac8110-dfdf-404a-856a-31a433616681 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047884 Sep 03 20:51:16.050275 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 373/725] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:16.175204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:16.195541 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80bd1c01-09fd-44b0-bb52-8745ded183be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.472721 Sep 03 20:51:16.213666 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 353/726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:15 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:16.506991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:16.507707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:16.509771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:16.525062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.530023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.530920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.531839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.533360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.534111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.752456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:16.754009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:16.766161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.769139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.770728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.772253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.773671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.774974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.903485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:16.912061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3c9f647-d27b-4893-aa9e-de25e3d13f1c tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1472 microversion: 2.1 time: 0.409388 Sep 03 20:51:16.913308 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 374/727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:16 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:16.918114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:16.919025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:16.925356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.926103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.926748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.927675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.928337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:16.928999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:16.931384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:16.952824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:16.954693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:16.962001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e212a1fc-bfdf-4615-9e1e-b3bea602940a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1533 microversion: 2.91 time: 0.213793 Sep 03 20:51:16.974807 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 354/728] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:16 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1533 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:16.986143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:16.989155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:16.998917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:16.999618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.000223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.001125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.001950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.002536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.029675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Request method failure captured: Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82/diagnostics HTTP/1.1 Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE74oml7YFvXamdWMWaD7cV65mWBmfwCoLeCbhBEqOb0qGAA1OofjlxrgOd9aPy1Nu5y0kyCOPgX3wi1miVbZ0Hpymzek1rlRC7jEXExQHschXd-Y8__tAqrb8wqFPy-DeKELMnHeWQ8O9_-Dt1yIZumfEodrcUf8TYM4d3Ndl6xkozs Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f968aad8b96b4ba9ade8cafd689c1b7f Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:51:17.031978 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f968aad8b96b4ba9ade8cafd689c1b7f Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerDiagnosticsNegativeTest-1654499210-project Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ad3cb96a474d4d04be4e16212a2bc8c9 Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1654499210-project Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:51:17.033332 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'server_id': '3a22aafa-3bb4-4a70-82e5-03de63272a82'} Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:51:17.034020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:17.035265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:17.036283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-134aa76c-17aa-4b0f-b3a9-989d3a81b811 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.059265 Sep 03 20:51:17.036283 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 355/729] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:51:16 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82/diagnostics => generated 117 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:51:17.047378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:17.047996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.054106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.054595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.055094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.055814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.056268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.056695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.204488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lazy-loading 'services' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:17.233791 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42fa0ef9-5c78-4734-9775-ab4d7bcb3318 tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1938 microversion: 2.91 time: 0.195308 Sep 03 20:51:17.234809 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 356/730] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:17 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1938 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:17.258356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:17.259113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.267924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.268630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.269576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.270755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.271383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.272210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.284212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.288594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:17.300446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-804d312a-4709-4774-916d-4ccc02f787d1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1475 microversion: 2.1 time: 0.385842 Sep 03 20:51:17.301930 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 375/731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:16 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:17.309167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:17.309845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.316596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.317525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.318107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.318895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.319425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.319924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.353421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:51:17.474179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:17.496018 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-631823cb-45c2-4bd2-be5f-75747f84017a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 204 len: 0 microversion: 2.1 time: 0.192368 Sep 03 20:51:17.496970 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 376/732] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:51:17 2022] DELETE /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:17.512181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:17.513974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.521984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.522596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.523084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.523968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.524617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.525079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.530309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.540572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.542132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.543303 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51b8cb75-ba8e-45ce-8633-302274b9feae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.307219 Sep 03 20:51:17.549240 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 357/733] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:17 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:17.557444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:17.558044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.577470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.578044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.578402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.579159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.579624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.580244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.623233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lazy-loading 'flavor' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:17.922073 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47cc6d5a-3d83-4575-9e42-6d845d99efa7 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action" status: 202 len: 0 microversion: 2.91 time: 0.371279 Sep 03 20:51:17.927458 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 358/734] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:51:17 2022] POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:17.933390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:17.945938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:17.960890 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5305a69b-b034-4cad-b65d-3a742bbbf941 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.461591 Sep 03 20:51:17.962563 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 377/735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:17 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:17.963392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.963924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.964632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.969915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:17.971503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:17.979778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.981687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.982429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.983578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:17.985964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:17.986676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:17.991134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Creating event network-changed:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch2-master-1 Sep 03 20:51:18.005309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:51:18.017435 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-48c06a77-dfd6-42dd-b545-9a82d3cd206b req-3430553a-3274-4afd-b80e-1a8c70e1876e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088515 Sep 03 20:51:18.018349 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 359/736] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:18.025292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:18.026456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:18.034686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.035666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.036331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.037350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.038030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.038707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.323333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.338731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.340547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.346893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8b70ea2-9934-4d0b-ab0b-c6bbcaad6030 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.327101 Sep 03 20:51:18.348485 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 360/737] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:18 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:18.365606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:18.366505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:18.374112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.374915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.375595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.376959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.377680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.378422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.448755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.460860 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e2146de-06f6-438d-8712-7fab9633cf38 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1478 microversion: 2.1 time: 0.496947 Sep 03 20:51:18.467073 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 378/738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:17 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1478 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:18.572623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:18.573328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:18.583092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.583947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.585101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.586356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.588058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.588669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:18.746928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.762056 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1867cd3b-ea62-4eec-8bb8-ac1c6b359a2d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1473 microversion: 2.1 time: 0.412251 Sep 03 20:51:18.762842 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 361/739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:18 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1473 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:18.876343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.889470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.891001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:18.892145 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b759d514-529c-4631-b008-b11e06060e0a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.323735 Sep 03 20:51:18.894978 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 379/740] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:18 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:18.988821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:18.989611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:18.997919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:18.999172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:18.999781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.003251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.004114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.004851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.376569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:19.377270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:19.401309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.401821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.402274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.403004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.403468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.403901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.549680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:19.563878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:19.568747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:19.575939 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94faaf75-e359-4eb7-acdd-b23c22300a10 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.203455 Sep 03 20:51:19.577556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 380/741] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:19 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:19.583067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:19.584098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:19.605247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.606038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.606651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.608619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.609484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.610166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.918368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:19.936609 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79bc6fbf-e9db-47ba-9072-bc59ba575750 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1478 microversion: 2.1 time: 0.356299 Sep 03 20:51:19.951350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 381/742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:19 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1478 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:19.951350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:19.951350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:19.964505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.965123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.965696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:19.966108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:19.979919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:19.980073 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cff85660-ba77-4189-a64d-807dbf653ab7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.994832 Sep 03 20:51:19.980073 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 362/743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:18 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:19.981789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:19.983695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.004529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:20.018041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:20.031411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.031901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.032511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.033465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.034068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.034647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.241288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.250429 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-882f7f37-ec10-4716-9ad6-42077be8ec1e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1473 microversion: 2.1 time: 0.307527 Sep 03 20:51:20.260418 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 382/744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:19 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:20.281957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60053839-fd83-4869-9c93-cc6ce1c6f6ee", "tag": "4b3e9c56-57de-488b-8332-f75b77ef84b3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:20.296243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.296618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.297140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.314986 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] Creating event network-changed:4b3e9c56-57de-488b-8332-f75b77ef84b3 for instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee on nch2-master-1 Sep 03 20:51:20.331750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9972d1af-e991-449b-8963-78b9065a97bb req-5a396293-41ef-4fe5-b75f-78e880425b55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069264 Sep 03 20:51:20.332393 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 383/745] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:20.390372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:20.566834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.584753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.593318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.595024 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54fdfdc9-d181-4b85-aa14-f2d2726625c2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.615405 Sep 03 20:51:20.595805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 363/746] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:19 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:20.618226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:20.621084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:20.628864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.629718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.630528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.631325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.631998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.632625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.734655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.762910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.764966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:20.773159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9deead85-0007-44c5-83f6-1c1e36969c02 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.165426 Sep 03 20:51:20.774314 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 384/747] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:20 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:20.964685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:20.965610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:20.968155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=95,nova_api:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:20.983837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.984733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.985570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:20.986540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:20.987339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:20.991492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.007699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:21.008539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:21.019810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.020678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.023695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.024750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.025775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.027551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.527711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:21.544815 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-584d978d-1321-4584-aecf-7158a0bfc58b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.541869 Sep 03 20:51:21.545466 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 385/748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:21 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:21.566177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:21.566826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:21.573457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.574180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.574821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.575701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.576325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.576932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.622447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=22 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:21.671611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:21.687155 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2dcc81f-cde1-46fa-9e90-5600bd5ce317 tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1478 microversion: 2.1 time: 0.727321 Sep 03 20:51:21.687742 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 364/749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:20 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1478 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:21.698021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:21.699408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:21.724174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.724860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.725587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:21.726456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:21.727062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:21.727668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.038066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.049342 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5e6a60f-6074-427d-8db9-f6195d11c9d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1470 microversion: 2.1 time: 0.484960 Sep 03 20:51:22.062279 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 386/750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:21 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1470 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:22.077918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:22.078732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:22.088302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.088834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.089344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.090058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.090511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.092717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.113594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.129379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.131565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.132884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-814acd8b-8f70-4ea8-a260-5357e3f3b770 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.444025 Sep 03 20:51:22.134383 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 365/751] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:21 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:22.144194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:22.144744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:22.159821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.160324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.160766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.161608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.162076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.162506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.226077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.236176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.237675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:22.259711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:22.263674 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe0a54da-1e10-44d1-8f3c-1c42c12dcc66 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.197112 Sep 03 20:51:22.269002 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 387/752] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:22 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:22.332714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16f7800c-56b7-4492-a40c-718983cf7483 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4/action" status: 204 len: 0 microversion: 2.1 time: 0.167439 Sep 03 20:51:22.333525 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 366/753] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:51:22 2022] POST /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:22.342646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:22.343264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:22.356707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.357244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.357691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.360649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.363517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.363977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.456093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a22aafa-3bb4-4a70-82e5-03de63272a82", "name": "network-vif-deleted", "tag": "5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:22.496375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.496865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.497973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.514075 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] Creating event network-vif-deleted:5ce8bbd9-a3d4-4e8a-b33b-fb1b47452d2d for instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 on nch2-master-1 Sep 03 20:51:22.520723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-33accd32-6732-4664-8d69-c0ca5bd6f249 req-56a779a5-7b4d-4f9f-bb32-6c89a3cf9b9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069694 Sep 03 20:51:22.521885 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 367/754] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:22.569902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:22.570700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:22.586927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.587499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.589593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.590386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:22.594542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:22.597773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:22.815853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=30 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:23.091098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.110038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e27c166-68c0-4bfb-8f8b-eb44143b6db3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.544745 Sep 03 20:51:23.127832 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 368/755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:22 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:23.154544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:23.158184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:23.179118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.179695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.180202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.181051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.181596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.182091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.235497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.235988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.236484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.236968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lazy-loading 'fault' on Instance uuid 3a22aafa-3bb4-4a70-82e5-03de63272a82 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:23.278053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.309017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83b2680b-3cd5-488c-814c-4247d4bbf64b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1470 microversion: 2.1 time: 0.954364 Sep 03 20:51:23.309017 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 388/756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:22 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1470 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:23.312515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:23.313505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:23.346168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.346874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.347726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.350372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cb96a474d4d04be4e16212a2bc8c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f968aad8b96b4ba9ade8cafd689c1b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.364079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a07f6ed4-a8b4-4c94-98a7-e0a7b91033dd tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 200 len: 1313 microversion: 2.1 time: 0.232700 Sep 03 20:51:23.366273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.367284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.375321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 369/757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:23 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:23.390781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:23.391926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:23.396640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.420544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.421176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.421622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.425530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.426021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.426465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.724746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.744286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.751439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:23.762444 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4aacde1-875d-488e-aad4-b3809bf61010 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.385621 Sep 03 20:51:23.769319 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 370/758] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:23 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:23.774051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9709dc-96f2-4f5b-a2bf-0d650631ccee", "name": "network-vif-plugged", "status": "completed", "tag": "2c393c94-4352-403b-b4e0-98e4a866bdd6"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:23.806056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:23.806573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:23.807100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:23.828537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] Creating event network-vif-plugged:2c393c94-4352-403b-b4e0-98e4a866bdd6 for instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee on nch2-master-1 Sep 03 20:51:23.836952 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3e247748-db92-4522-8c09-96929b5e17c6 req-518054b3-ca03-4bfa-b4ab-0e4903624db5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066279 Sep 03 20:51:23.840261 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 371/759] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:24.153001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:24.153701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:24.168286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.175641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.176396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.180194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.180842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.181472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.274876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:24.295918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:24.303040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:24.304220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ecc02c7-ab8d-49bf-b1ac-952c43d40d66 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 1.006605 Sep 03 20:51:24.324656 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 389/760] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:23 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:24.330837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:24.331821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:24.339750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.340593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.342238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.343197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.343875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.345136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.718979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:24.727386 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ccfb1be-0de4-4526-a53e-418f4082bacc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1470 microversion: 2.1 time: 0.401208 Sep 03 20:51:24.733427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 390/761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:24 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:24.740396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:24.742661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] [instance: 3a22aafa-3bb4-4a70-82e5-03de63272a82] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:24.760423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.764873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.765464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.766311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.768691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.769439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.771749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:24.782829 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63946a2b-3011-446f-aaec-6ff1c324da60 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.634687 Sep 03 20:51:24.797412 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 372/762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:24 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:24.806624 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] HTTP exception thrown: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Request method failure captured: Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 HTTP/1.1 Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74oml7YFvXamdWMWaD7cV65mWBmfwCoLeCbhBEqOb0qGAA1OofjlxrgOd9aPy1Nu5y0kyCOPgX3wi1miVbZ0Hpymzek1rlRC7jEXExQHschXd-Y8__tAqrb8wqFPy-DeKELMnHeWQ8O9_-Dt1yIZumfEodrcUf8TYM4d3Ndl6xkozs Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f968aad8b96b4ba9ade8cafd689c1b7f Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:51:24.809060 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f968aad8b96b4ba9ade8cafd689c1b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f968aad8b96b4ba9ade8cafd689c1b7f Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1654499210 Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerDiagnosticsNegativeTest-1654499210-project Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ad3cb96a474d4d04be4e16212a2bc8c9 Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1654499210-project Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. Sep 03 20:51:24.810387 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3a22aafa-3bb4-4a70-82e5-03de63272a82'} Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:24.811254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. Sep 03 20:51:24.812658 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:24.813829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:24.813921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] Returning 404 to user: Instance 3a22aafa-3bb4-4a70-82e5-03de63272a82 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:24.814009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:24.815686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cb655d83-c8c7-4742-bf66-4e9951dc571a tempest-ServerDiagnosticsNegativeTest-1654499210 tempest-ServerDiagnosticsNegativeTest-1654499210-project] 10.222.0.16 "GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82" status: 404 len: 111 microversion: 2.1 time: 0.080970 Sep 03 20:51:24.816366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 391/763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:24 2022] GET /compute/v2.1/servers/3a22aafa-3bb4-4a70-82e5-03de63272a82 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:51:24.834957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.835469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.835918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:24.836666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:24.837139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:24.848960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.171180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.203654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.209026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.243454 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48967a57-0cb0-4bf7-8d93-ac8a158d827c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.443127 Sep 03 20:51:25.244541 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 373/764] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:24 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:25.336666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:25.343992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:25.362628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.368411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.374189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.376607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.379534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.380072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.393557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:25.760246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:25.761839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:25.770962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.775601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.777050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.780332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.793663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.797933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.856537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.870354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.872170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:25.877083 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6bcc294f-7055-4f94-adbc-821783d32c59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.546636 Sep 03 20:51:25.879398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 392/765] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:25 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:25.888044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:25.894030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:25.906205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.909034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.910263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:25.913773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:25.914677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:25.915194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:26.281879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:26.306405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d3056ed-8ae9-4ebf-ab12-5565d7b1cd4f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1310 microversion: 2.1 time: 0.424942 Sep 03 20:51:26.311293 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 393/766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:25 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1310 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:26.327266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:26.329227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:26.356869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:26.358365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:26.359140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:26.368236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:26.369425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:26.383517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:26.591327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:26.602375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:26.609073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:26.616629 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff78a4f9-cf3a-4666-97ae-1e8507f1759e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.302209 Sep 03 20:51:26.626107 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 394/767] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:26 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:26.719021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:26.737076 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80b2e6ff-a234-4929-8d79-dcbbaea9ca23 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1470 microversion: 2.1 time: 0.979820 Sep 03 20:51:26.739658 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 374/768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:25 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1470 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:26.903710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:26.904700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:26.929861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:26.931106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:26.931780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:26.933370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:26.934046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:26.934693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.206123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a242298d-4335-43ac-9fac-aa6b1aa96530 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Action: 'create', calling method: .version_select at 0x7fae670e8c10>, body: {"pool": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:27.261836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.271182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.275653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.277110 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b7970e3-fd43-4bdf-8f2a-8ba48cef02ff tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.377807 Sep 03 20:51:27.294042 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 375/769] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:26 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:27.301331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "name": "network-vif-plugged", "status": "completed", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:27.313239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.314076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.317119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.332886 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] Creating event network-vif-plugged:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch2-master-1 Sep 03 20:51:27.345431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-cf80f6c5-3551-4ca4-a605-78a7f267902b req-fde993a6-24d7-4976-a80b-c02c32193b59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049628 Sep 03 20:51:27.348378 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 376/770] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:27.357399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:27.358425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:27.367477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.380268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.381215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.382228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.383113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.383764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.713361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.723582 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13edc5b0-6502-4943-8ce4-1a31ae33917c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1490 microversion: 2.1 time: 0.373687 Sep 03 20:51:27.728947 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 377/771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:27 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1490 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:27.753163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:27.754161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:27.763744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.764482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.765259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.766454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.767065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.767646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.850734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.868585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.870278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:27.878411 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1104a831-5f6a-4eb1-9409-305490853215 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.139188 Sep 03 20:51:27.882799 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 378/772] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:27 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:27.902127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:27.903206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:27.920077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.920594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.921388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:27.922311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:27.922774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:27.923206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.260392 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20ea9958-f810-4454-85ad-2ff2fbec62c0 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1641 microversion: 2.1 time: 0.376448 Sep 03 20:51:28.265026 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 379/773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:27 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1641 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:28.273407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:28.274034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:28.285705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.286255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.287161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.287893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.288361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.288797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.519282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:28.529046 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c02f9c5e-618a-462b-9d91-53b56dacf7a8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1462 microversion: 2.1 time: 0.262663 Sep 03 20:51:28.530079 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 380/774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:28 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1462 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:28.535206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:28.535970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:28.542826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.543681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.544271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.545167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.545774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.546425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.798752 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-faba5377-997e-4451-a8d0-c60b5da5dcc7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1641 microversion: 2.1 time: 0.267054 Sep 03 20:51:28.799933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 381/775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:28 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1641 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:28.805164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:28.806030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:28.813676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.814323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.814823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.815641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:28.816200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:28.816720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:28.982143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:28.997998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:28.999699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:29.002656 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00a90d3c-92df-4c70-bbba-066f46dcc8d4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.200037 Sep 03 20:51:29.018672 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 382/776] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:28 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:29.030921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:29.039750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:29.047394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.048191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.048786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.049873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.050516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.051268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.268342 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3f33e8c6-0a02-4881-8128-8b97583f9faf tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1613 microversion: 2.1 time: 0.246680 Sep 03 20:51:29.269600 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 383/777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:29 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:29.332008 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a242298d-4335-43ac-9fac-aa6b1aa96530 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.704381 Sep 03 20:51:29.332689 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 395/778] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:51:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:29.339931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:29.351673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.352878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.353629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.356466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.357206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.359044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.391419 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-03c7d98c-0b2e-45e7-bcc0-02c022b915a8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056979 Sep 03 20:51:29.400637 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 396/779] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:51:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:29.406177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:29.407083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:29.414810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.415529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.416201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.417280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.417927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.418469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.520211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:29.532833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:29.535539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:29.543231 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3641641c-d17b-493d-a6a7-ffc22e18014a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.143637 Sep 03 20:51:29.543768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-201847631", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "998e5845-f2b9-4041-bfc7-98a792282d5a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:29.556922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 397/780] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:29 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:29.556922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b137fd6-9269-463a-bfbb-b3fd9ab34ead tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '.version_select at 0x7fae6741f5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:29.556922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b137fd6-9269-463a-bfbb-b3fd9ab34ead tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:29.556922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b137fd6-9269-463a-bfbb-b3fd9ab34ead tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:29.557447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b137fd6-9269-463a-bfbb-b3fd9ab34ead tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:29.572560 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b137fd6-9269-463a-bfbb-b3fd9ab34ead tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.025526 Sep 03 20:51:29.575447 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 398/781] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:51:29 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:29.591340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f291a58d-7ca3-4110-8c95-4a9224dd844a tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Action: 'create', calling method: .version_select at 0x7fae670eaa60>, body: {"pool": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:29.627848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] validate_networks() for [('998e5845-f2b9-4041-bfc7-98a792282d5a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:51:30.159439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:51:30.160485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:51:30.161273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:51:30.162222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:51:30.162800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:51:30.175068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:30.175878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:30.176669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:30.178423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:30.180504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:30.181146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:30.192046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:30.205042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Getting quotas for project d196cef49e5040dea8885bcd8f179747. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:30.211812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Getting quotas for user 10bbfca2d8744acea2587037f190fe90 and project d196cef49e5040dea8885bcd8f179747. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:30.228204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:51:30.232370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:51:30.289296 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009640 Sep 03 20:51:30.297356 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 384/782] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:51:30.390713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3282e427-afb5-4bd0-a6bf-0802f9240685 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:30.400282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3282e427-afb5-4bd0-a6bf-0802f9240685 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.100788 Sep 03 20:51:30.413591 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 385/783] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:51:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:30.426128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:30.427055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:30.435070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:30.436033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:30.436586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:30.437443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:30.438226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:30.438548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:30.523508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c4f0d8c1-b03a-4649-9e82-605642436271 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee/action" status: 202 len: 0 microversion: 2.1 time: 0.108276 Sep 03 20:51:30.524396 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 386/784] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:51:30 2022] POST /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:30.536200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60053839-fd83-4869-9c93-cc6ce1c6f6ee", "name": "network-vif-plugged", "status": "completed", "tag": "4b3e9c56-57de-488b-8332-f75b77ef84b3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:30.550555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:30.551669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:30.552410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:30.590977 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] Creating event network-vif-plugged:4b3e9c56-57de-488b-8332-f75b77ef84b3 for instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee on nch2-master-1 Sep 03 20:51:30.608659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bc1b2a5d-f836-4f14-8ce5-833bcd466a9d req-f3bf6f13-7f20-433a-bc1f-5498d079a911 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077275 Sep 03 20:51:30.609969 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 387/785] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:30.626046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1602674611", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:30.744643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:51:31.167964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:51:31.169588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:51:31.170232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:51:31.170831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:51:31.171405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:51:31.187389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.188082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.188693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.190005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.190803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.191575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.221827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:31.241938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:31.261301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:51:31.264040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:51:31.359998 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-39770b6d-0734-4245-9cb4-592b4c673f93 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748132 Sep 03 20:51:31.366729 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 388/786] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:51:31.378780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:31.380331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:31.398301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.398968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.400004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.402684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.403241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.404772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.677874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:31.690291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:31.692211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:31.693618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e031907-fd83-4273-8fae-d400de7a6d5b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1361 microversion: 2.25 time: 0.331145 Sep 03 20:51:31.708910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 389/787] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:31 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:31.714024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:31.715296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:31.723148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.723958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.724710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.726040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.726666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.727250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.811668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:31.820475 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f542ed70-81d5-403c-ab93-c56c028f02c8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1268 microversion: 2.1 time: 0.110392 Sep 03 20:51:31.821638 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 390/788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:31 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1268 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:31.837714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:31.839162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:31.849652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.852365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.854006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:31.856475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:31.857883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:31.859061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.049790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e16ca157-9000-4dda-8671-15d4acd4cf4b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1626 microversion: 2.1 time: 0.226803 Sep 03 20:51:32.052806 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 391/789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:31 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1626 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:32.066691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:32.068190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:32.078016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.081834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.082366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.083576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.084067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.084970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.192253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:32.202214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:32.204076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:32.212235 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64eb1f89-78d9-4120-9c18-ad0ac920dd46 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.157594 Sep 03 20:51:32.214477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 392/790] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:32 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:32.220907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:32.222411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:32.229060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.230036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.230719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.233127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.234274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.234948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.286179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f291a58d-7ca3-4110-8c95-4a9224dd844a tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.708735 Sep 03 20:51:32.288231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 399/791] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:51:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:32.303079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1415395477", "imageRef": "01c0cc7b-c00d-4da1-8cc5-6156008ace93", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:32.337365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:32.348449 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-45e5642b-6f64-4c0d-87cd-7b42876ecf44 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1217 microversion: 2.1 time: 0.132230 Sep 03 20:51:32.368268 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 393/792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:32 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:32.380351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:51:32.403080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:32.410578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:32.433899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.434681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.435424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.436248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:32.436861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:32.437439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:32.471925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lazy-loading 'flavor' on Instance uuid 9c9709dc-96f2-4f5b-a2bf-0d650631ccee {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:32.487645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Going to try to live migrate instance to nch1-master-1 {{(pid=140519) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:51:32.500081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:32.738514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] Request method failure captured: Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 143 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE75RNY5E35V2XuQ2Rwb8i7WQyKyEnd9GbsW1Ckf87uHAXFKjxrNXiiM1E_8-a44kqQbL3418b2h14JatSlJisv6G9n7fAWrdl_6xYulgewcaI20xx2CLzQjbOwI_Xp5dGsXbWM_96QqIPhAIqOL7jYR9YfVl7wc_lODgegB_F4uGrN0 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: cd0212e91da8419da9a74763d36a990d Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FlavorsV2NegativeTest-1546019597 Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:51:32.742951 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd0212e91da8419da9a74763d36a990d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd0212e91da8419da9a74763d36a990d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd0212e91da8419da9a74763d36a990d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd0212e91da8419da9a74763d36a990d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FlavorsV2NegativeTest-1546019597 Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: cd0212e91da8419da9a74763d36a990d Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1546019597 Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FlavorsV2NegativeTest-1546019597-project Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 404086c2409f4135af212d4047c29223 Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FlavorsV2NegativeTest-1546019597-project Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1415395477", "imageRef": "01c0cc7b-c00d-4da1-8cc5-6156008ace93", "flavorRef": "452"}} Sep 03 20:51:32.744496 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor's memory is too small for requested image. Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1415395477', 'imageRef': '01c0cc7b-c00d-4da1-8cc5-6156008ace93', 'flavorRef': '452'}}} Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:32.745473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:32.746747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4b7d3b0-143a-4cdc-8990-cf0ecffa26d8 tempest-FlavorsV2NegativeTest-1546019597 tempest-FlavorsV2NegativeTest-1546019597-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.447087 Sep 03 20:51:32.748451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 400/793] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:51:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 451 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:32.771072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a78ad878-6f4c-436d-a044-dc73271a491f tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Action: 'create', calling method: .version_select at 0x7fae6705e280>, body: {"pool": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:35.574345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d4c3511-5c9a-4d66-864e-95c1e021723b tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee/action" status: 202 len: 0 microversion: 2.1 time: 3.201549 Sep 03 20:51:35.582343 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 394/794] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:51:32 2022] POST /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee/action => generated 0 bytes in 3212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:35.594036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:35.598793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:35.614734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.615591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.617441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.621363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.622165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.623913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.643457 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a78ad878-6f4c-436d-a044-dc73271a491f tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.885593 Sep 03 20:51:35.653159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 401/795] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:51:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:35.653159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:35.653159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:35.667636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.668212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.668672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.672004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.672640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.673428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.858132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:35.869556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-327bfde3-f5bd-432e-81ff-79be5a12e14b tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.222664 Sep 03 20:51:35.870745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 402/796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:35 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:35.875717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:35.876580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:35.883223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.884083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.884719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.885797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.886415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.887176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.916636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:35.928266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:35.929887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:35.931333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2e672fa-58b2-4c9e-ac3a-49cae6c7ce1a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1557 microversion: 2.25 time: 0.347706 Sep 03 20:51:35.932463 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 395/797] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:35 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1557 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:35.946030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:35.946997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:35.957592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.958645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.959888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.961006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:35.961719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:35.962421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:35.995478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:36.007847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:36.010410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:36.015874 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22dfb999-2cbe-4b90-be0a-2e0ff44b8b77 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.143923 Sep 03 20:51:36.016467 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 403/798] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:35 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:36.022608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8868ede-48ca-4ae8-aca7-54bdc6a7aeda", "tag": "1e3808ba-5d81-42f1-99fe-5637cfb9e9de"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:36.034104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.034595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.035038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.047864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] Creating event network-changed:1e3808ba-5d81-42f1-99fe-5637cfb9e9de for instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda on nch1-master-1 Sep 03 20:51:36.057124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4f8c84ff-d919-4b4f-a495-7b19fcbbe82f req-f502cc98-df62-4e2a-a373-b619487ef4c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037310 Sep 03 20:51:36.061159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 404/799] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:36.066715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:36.067427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:36.080438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.080989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.082438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.082438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.082651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.083449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.142888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:36.152038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1355c876-d8cc-4138-9b7d-73353d63de5c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.217670 Sep 03 20:51:36.153108 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 396/800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:35 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:36.157865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-021650f4-96ba-4023-ad9e-01d87de94ccf tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Action: 'create', calling method: .version_select at 0x7fae6718b670>, body: {"pool": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:36.291345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:36.306910 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56e0df40-0e8f-4c0d-89d5-12c81c936c2c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.244092 Sep 03 20:51:36.309536 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 405/801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:36 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:36.579289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:36.579990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:36.586900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.587754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.588444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.589463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.590131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.590793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.847528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 60053839-fd83-4869-9c93-cc6ce1c6f6ee {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:36.863834 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf740206-fe56-4400-a1b3-ab44f436a770 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 2049 microversion: 2.25 time: 0.553211 Sep 03 20:51:36.864616 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 406/802] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:36 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 2049 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:36.889578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:36.890081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:36.896707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.897425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.898023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:36.898916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:36.899527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:36.900109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:37.102074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 60053839-fd83-4869-9c93-cc6ce1c6f6ee {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:37.127472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ccec86ea-8f47-4736-af5b-675c7301395b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 2049 microversion: 2.25 time: 0.242115 Sep 03 20:51:37.128551 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 407/803] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:36 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 2049 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:37.133821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:37.134856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:37.142042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:37.143055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:37.143803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:37.145792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:37.146617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:37.147458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:37.897990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:37.908744 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8026f267-46a9-41f9-8701-1b4d4b4fd244 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.778791 Sep 03 20:51:37.911312 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 408/804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:37 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:37.921390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:37.922248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:37.933841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:37.937024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:37.937723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:37.938941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:37.939584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:37.940367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.040148 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-021650f4-96ba-4023-ad9e-01d87de94ccf tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.885696 Sep 03 20:51:38.040805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 397/805] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:51:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:38.045339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:38.049004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.049491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.049943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.050680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.051147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.051592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.113228 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba82abc7-959e-4095-8659-42c5970efb57 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.071233 Sep 03 20:51:38.121905 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 398/806] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Sep 3 20:51:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:51:38.140722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:38.141473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:38.148504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.149361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.149810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.150522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.151011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.151606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.188084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:38.198751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:38.200730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:38.207131 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0541a5dc-d2e3-41ed-ab20-f381c9925ce4 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.294564 Sep 03 20:51:38.207982 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 409/807] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:37 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:38.217757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:38.218621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:38.242553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.243063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.243506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.244561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.245646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.246090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.368001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:38.376382 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2ef08a6-4843-469c-b1e4-e206979abaff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.261001 Sep 03 20:51:38.377214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 399/808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:38 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:38.381789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c7fa10a7-f71a-4fc9-ab99-75b9b806e713 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae6718baf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:38.678553 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c7fa10a7-f71a-4fc9-ab99-75b9b806e713 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/80c4d970-391f-4d05-83b0-026504a6fcfc" status: 200 len: 142 microversion: 2.1 time: 0.300109 Sep 03 20:51:38.679843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:38.689967 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 400/809] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:51:38 2022] GET /compute/v2.1/os-floating-ips/80c4d970-391f-4d05-83b0-026504a6fcfc => generated 142 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:38.702482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:38.710198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:38.715230 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a84af13f-5c7c-40f7-9d5b-a1c00210c815 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.504122 Sep 03 20:51:38.717639 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 410/810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:38 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:38.728244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d38cb2cc-4830-424b-9929-3cebd578acf2 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae670ea670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:38.728537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.734037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.734935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.735886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:38.741897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:38.742536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:38.779007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'flavor' on Instance uuid 60053839-fd83-4869-9c93-cc6ce1c6f6ee {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:38.798295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Going to try to live migrate instance to nch1-master-1 {{(pid=140519) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:51:38.866600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:39.370277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:40.027499 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0d778e2-17e4-4e58-8b40-654e2208eec7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee/action" status: 202 len: 0 microversion: 2.25 time: 1.336226 Sep 03 20:51:40.028503 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 401/811] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:51:38 2022] POST /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee/action => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:40.037898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:40.038533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:40.048315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.048820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.049301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.050228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.050780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.058042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.208798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.218295 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dac3dd2e-1f57-4231-b45f-d87dfe37b3e4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.188532 Sep 03 20:51:40.218883 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 402/812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:40 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:40.223813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:40.224644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:40.231610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.232576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.234604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.235575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.236273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.236715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.310406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.317780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.319236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.324341 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b45fc01-109a-491d-bbef-b7b0895e90a5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.104470 Sep 03 20:51:40.324911 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 403/813] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:40 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:40.329257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:40.329856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:40.336235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.336701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.337164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.338045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.339057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.339493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.490005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.498072 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d2e54f1-ff5e-42ef-8018-a39c57df9b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.172151 Sep 03 20:51:40.498659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 404/814] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:40 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:40.503394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:40.504127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:40.511215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.511836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.512350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.513222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.513689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.514125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.675639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.685623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15c0653f-c054-42d2-b98f-ea9e3f1740a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.185866 Sep 03 20:51:40.686278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 405/815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:40 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:40.691282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:40.691963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:40.699340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.700359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.700619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.701579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.702116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.702667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.871189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.881243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.883278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:40.884811 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6004c220-ce08-4b43-8960-d2fe98e23ade tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.197545 Sep 03 20:51:40.886858 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 406/816] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:40 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:40.891884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:40.905627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.906816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.907468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.923941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] Creating event network-changed:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch1-master-1 Sep 03 20:51:40.929875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c4917945-9ad6-4777-9f7c-2e3f9611bcba req-a4bcb272-0c50-43ff-8adf-effc375be5d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041538 Sep 03 20:51:40.930844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 407/817] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:40.936019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8868ede-48ca-4ae8-aca7-54bdc6a7aeda", "name": "network-vif-plugged", "status": "completed", "tag": "1e3808ba-5d81-42f1-99fe-5637cfb9e9de"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:40.949922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:40.950406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:40.950839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:40.962587 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] Creating event network-vif-plugged:1e3808ba-5d81-42f1-99fe-5637cfb9e9de for instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda on nch1-master-1 Sep 03 20:51:40.967893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-08275940-7834-4d66-8328-c423dbcbd102 req-bc440005-89a2-4451-ba83-a8703c7b49bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Sep 03 20:51:40.968745 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 408/818] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:41.243494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.244184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:41.251476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.252146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.252587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.253314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.253764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.254187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.254730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:41.388551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.398080 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-86de8dc1-f39f-4fa4-8580-a7bc46a3251d tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.159122 Sep 03 20:51:41.414166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 409/819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:41.419527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.420138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:41.426640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.427126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.427865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.428564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.429053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.429478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.494044 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d38cb2cc-4830-424b-9929-3cebd578acf2 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/80c4d970-391f-4d05-83b0-026504a6fcfc" status: 202 len: 0 microversion: 2.1 time: 2.769292 Sep 03 20:51:41.495283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 411/820] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:51:38 2022] DELETE /compute/v2.1/os-floating-ips/80c4d970-391f-4d05-83b0-026504a6fcfc => generated 0 bytes in 2771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:41.501411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.504600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ee3fca4-1c14-47d4-940e-d6c80a76230b tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae6705e310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.510260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.511708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.518535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4711730a-4e5b-426c-972e-af00c8932e5b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.103232 Sep 03 20:51:41.519130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 410/821] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:41.524143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.524958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:41.531030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.531528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.531997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.532842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.533364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.533801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.671480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.679258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ded082e-5895-43f7-bde9-98fd9c4f90cd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.158927 Sep 03 20:51:41.680013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 411/822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:41.711521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.712304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:41.720143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.720740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.721298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.722239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.722796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.723296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.862324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:41.871133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28a3ef86-305c-4d20-abf4-8ec45314b4e7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.163399 Sep 03 20:51:41.871845 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 412/823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:41.914055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:41.914738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:41.921044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.921527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.921961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:41.922691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:41.923144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:41.923566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:42.062450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.071441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.073630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.074843 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c6e784e-3593-45a4-8f48-889f0ee330d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.164748 Sep 03 20:51:42.075403 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 413/824] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:42.185385 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ee3fca4-1c14-47d4-940e-d6c80a76230b tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.684736 Sep 03 20:51:42.186041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 412/825] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Sep 3 20:51:41 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:51:42.197177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8bbd223b-3494-4c85-b57f-21034f8dafeb tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae67222b80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:42.417228 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8bbd223b-3494-4c85-b57f-21034f8dafeb tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.223228 Sep 03 20:51:42.427266 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 414/826] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:51:42 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:42.427460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:42.427460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:42.431748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:42.431923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:42.432475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:42.433295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:42.433834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:42.434336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:42.437329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-69c18161-74c4-432c-9ee1-faf3f2083794 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae67147ca0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:42.830913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.844535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92be102c-0f99-4dd8-bbdd-92f35988a3c4 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.424141 Sep 03 20:51:42.857747 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 413/827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:42 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:42.867729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:42.868607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:42.875762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:42.876510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:42.877166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:42.878567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:42.879189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:42.879787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:42.971052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.982506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.984226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:42.989604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf172e04-607e-4746-9921-fe30b05ada5e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.130517 Sep 03 20:51:42.990181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 414/828] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:42 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:42.995444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:42.996270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:43.003055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.003754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.004362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.005273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.006049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.006860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.227756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:43.236282 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b680c2e3-4b1f-4077-96b2-0321aeca3055 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.244912 Sep 03 20:51:43.238039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 415/829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:42 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:43.267890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:43.270842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:43.285652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.286309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.287027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.287904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.288497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.289126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.289794 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-69c18161-74c4-432c-9ee1-faf3f2083794 tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/b50de4bd-b78f-4217-a0b9-d3da492b13dc" status: 202 len: 0 microversion: 2.1 time: 0.859481 Sep 03 20:51:43.291351 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 415/830] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:51:42 2022] DELETE /compute/v2.1/os-floating-ips/b50de4bd-b78f-4217-a0b9-d3da492b13dc => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:43.295018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:43.299710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9709dc-96f2-4f5b-a2bf-0d650631ccee", "name": "network-vif-unplugged", "status": "completed", "tag": "2c393c94-4352-403b-b4e0-98e4a866bdd6"}, {"name": "network-changed", "server_uuid": "9c9709dc-96f2-4f5b-a2bf-0d650631ccee", "tag": "2c393c94-4352-403b-b4e0-98e4a866bdd6"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:43.312549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.313219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.313750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.326615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Creating event network-vif-unplugged:2c393c94-4352-403b-b4e0-98e4a866bdd6 for instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee on nch2-master-1 Sep 03 20:51:43.327276 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] Creating event network-changed:2c393c94-4352-403b-b4e0-98e4a866bdd6 for instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee on nch2-master-1 Sep 03 20:51:43.333937 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8b410282-9b48-4d08-9160-0b0d08674a47 req-03abe9ce-08cf-4c50-ba59-74812e9a3d5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.041230 Sep 03 20:51:43.334836 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 416/831] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:43.340338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:43.341193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:43.349293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.349908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.350585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.351730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.352656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.353319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.514829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:43.524255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:43.526008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:43.527398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-841faf5b-d867-4672-84b6-c5b83cf5cc33 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.191156 Sep 03 20:51:43.533173 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 417/832] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:43 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:43.543931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83e16dee-fce7-48df-b6b2-36a260faa78b tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae672220d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:43.560105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:43.570720 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22504137-43f9-4fa8-a39a-e05b3fa53b42 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.331287 Sep 03 20:51:43.572001 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 416/833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:43 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:43.873249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:43.875289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:43.884538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.885471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.886087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:43.887583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:43.888397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:43.889070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.254515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.269637 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e78b7817-4377-4731-8051-aab4c9850cad tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1316 microversion: 2.1 time: 0.401471 Sep 03 20:51:44.271074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 417/834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:43 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:44.277154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:44.277984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:44.285182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.286164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.287129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.288067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.288705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.289405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.452734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.472097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.476106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.481944 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cab6d3be-7e90-402f-81a2-64af88f3b686 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1560 microversion: 2.91 time: 0.209607 Sep 03 20:51:44.497605 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 418/835] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:44 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:44.519498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:44.520582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:44.528123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.528636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.529110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.529834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.530475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.531075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.551477 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83e16dee-fce7-48df-b6b2-36a260faa78b tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/fb90b1b7-964d-41e4-ae7f-504410fb9f52" status: 202 len: 0 microversion: 2.1 time: 1.022373 Sep 03 20:51:44.555307 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 418/836] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:51:43 2022] DELETE /compute/v2.1/os-floating-ips/fb90b1b7-964d-41e4-ae7f-504410fb9f52 => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:44.560775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:44.561435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:44.579104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.579701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.580150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.580874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.581531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.581781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.837504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.857321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.859739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.862077 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a4b0e26-713f-497b-81a2-47559d113033 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.305325 Sep 03 20:51:44.863331 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 419/837] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:44 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:44.871376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-785c6144-c2c4-4370-bbd2-8514c720fd1f tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] Calling method '.version_select at 0x7fae671c23a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:44.931385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:44.943694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e18d34b1-b6a7-4e57-a513-1d42f183aabf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.443655 Sep 03 20:51:44.945608 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 419/838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:44 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:44.956559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:44.961751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:44.972220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.973506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.975869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:44.981283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:44.981831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:44.983109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:45.378327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:45.391695 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ecf15446-5117-4e17-adf7-b1485e58b7b9 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.442591 Sep 03 20:51:45.392875 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 420/839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:44 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:45.418032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:45.418935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:45.424996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:45.426856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:45.428467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:45.434736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:45.435798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:45.436459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:45.437111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:45.914394 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-785c6144-c2c4-4370-bbd2-8514c720fd1f tempest-FloatingIPDetailsTestJSON-221559168 tempest-FloatingIPDetailsTestJSON-221559168-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/21d852f4-4e39-4fa6-b442-1acde1f839de" status: 202 len: 0 microversion: 2.1 time: 1.049308 Sep 03 20:51:45.915295 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 420/840] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:51:44 2022] DELETE /compute/v2.1/os-floating-ips/21d852f4-4e39-4fa6-b442-1acde1f839de => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:45.922768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:45.923334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:45.934582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:45.935093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:45.935543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:45.936423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:45.936738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:45.942793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.044552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.065777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed7da24f-0d03-4a19-a64f-6728aa4da14f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1505 microversion: 2.1 time: 0.671138 Sep 03 20:51:46.066368 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 421/841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:45 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:46.097402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:46.097919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.098426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:46.106818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.108681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.109219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.109671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.110397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.110613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.110864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.111304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.120187 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6cee02c8-f443-462f-a331-ebee553be160 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.203175 Sep 03 20:51:46.133894 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 421/842] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:45 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:46.137460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:46.152629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:46.165521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.166042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.166539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.167285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.167755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.173450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.657978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.675538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.678825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.681469 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-251a07d1-adfa-4277-b90a-b2c0ce64d5c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.598965 Sep 03 20:51:46.682124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 422/843] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:46 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:46.711630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:46.712221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:46.736233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.737007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.737568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.739873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.743179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.743753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.808684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:46.811689 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b10b09c7-249e-4396-a5db-d9d644ea6de8 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/os-instance-actions/req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92" status: 200 len: 313 microversion: 2.1 time: 0.116831 Sep 03 20:51:46.812460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 423/844] 10.222.0.16 () {58 vars in 1419 bytes} [Sat Sep 3 20:51:46 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/os-instance-actions/req-6a076c6c-5fc1-4792-a6c8-aa47cfbc1b92 => generated 313 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:46.825618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:46.826491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:46.833272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.833982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.834601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.835482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:46.836306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:46.837393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:46.986947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:47.010727 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59f96579-7a4b-4408-84df-e8475f1422e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.886713 Sep 03 20:51:47.013052 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:46 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:47.033337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:47.035684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:47.080170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.080600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.084605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.085652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.090611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.091923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.204602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:47.215832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:47.220678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84bd49a7-af20-42f3-bc96-ee320ed0bfd4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.406693 Sep 03 20:51:47.221721 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 424/846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:46 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:47.233888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:47.236036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:47.250666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.251421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.252057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.253114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.255429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.256092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.264331 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-31a76122-8f13-4edb-83a7-d85d8052422a tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "POST /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/action" status: 202 len: 0 microversion: 2.1 time: 0.249979 Sep 03 20:51:47.270324 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 423/847] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:51:47 2022] POST /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:47.403072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbf7c79d-090b-423c-af73-169fa88520e5 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Calling method '.version_select at 0x7fae67146280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:47.536807 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbf7c79d-090b-423c-af73-169fa88520e5 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.264538 Sep 03 20:51:47.537790 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 424/848] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:51:47 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:51:47.545206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:47.551123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:47.552059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:47.562112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:47.563938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:47.566659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.567167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.570815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.572188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.574601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.576317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.595167 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-768449a8-d1f8-4701-ab5e-c4ea7e986c3e tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.371831 Sep 03 20:51:47.601078 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 425/849] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:47 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:47.630705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ec96015-82c8-4a9c-a224-da944dd97cc0 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Action: 'create', calling method: .version_select at 0x7fae67003c10>, body: {"pool": "non_exist_pool"} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:47.726216 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-3ec96015-82c8-4a9c-a224-da944dd97cc0 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] HTTP exception thrown: Floating IP pool not found. Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ec96015-82c8-4a9c-a224-da944dd97cc0 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Request method failure captured: Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 26 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE75iIVEAoRIzDZlrOtoo34-kKXL1QcR3wwepzK2QytdRnI93C55pFsdhHHNl8ybHmMy9xq_7rJXT44uQRDPeJ_sm2JGUMALXUUCym2flWX4W3Dyqkcd7U7LCNxicT9_dX8VsEHXJ8fy1zavTlNQlA4IuUxQu3R_zmCdipIDVtsLUCJo Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 47d6e91988314f84866964e998922059 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:51:47.728153 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47d6e91988314f84866964e998922059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47d6e91988314f84866964e998922059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47d6e91988314f84866964e998922059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47d6e91988314f84866964e998922059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 47d6e91988314f84866964e998922059 Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsNegativeTestJSON-1589891603-project Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9342065f3fb246008d09a2eed524ac22 Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1589891603-project Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: {"pool": "non_exist_pool"} Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: exception: Floating IP pool not found. Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 03 20:51:47.729898 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:47.731069 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ec96015-82c8-4a9c-a224-da944dd97cc0 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Returning 404 to user: Floating IP pool not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:47.732589 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ec96015-82c8-4a9c-a224-da944dd97cc0 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.129409 Sep 03 20:51:47.734589 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 426/850] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:51:47 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:51:47.742326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "name": "network-vif-plugged", "status": "completed", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:47.756728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.757475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.757983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.770782 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] Creating event network-vif-plugged:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch1-master-1 Sep 03 20:51:47.777717 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-554cd481-72b3-4b52-836b-1cd125054de0 req-c5e20226-6b54-45f0-bbd9-799d278a7297 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042355 Sep 03 20:51:47.784260 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 427/851] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:47.791057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:47.792009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:47.799133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.799859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.800517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:47.801525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:47.802158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:47.803022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.083514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.094313 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f390b52-ea0f-4e28-9d8e-01df91b2ab0f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1507 microversion: 2.1 time: 0.555487 Sep 03 20:51:48.098082 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 425/852] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:47 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:48.121756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Calling method '.version_select at 0x7fae6718bca0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:48.140002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:48.144291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.153543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.157593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.162492 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c732b3d4-0423-4632-9f14-ef736d8f487a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.376105 Sep 03 20:51:48.165150 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 428/853] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:47 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:48.179702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:48.180678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:48.198925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.199617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.200213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.205032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.205610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.207659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.257391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c90e6fc5-8cd7-4203-b9c4-722dd5887a32 could not be found", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:51:48.258462 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] HTTP exception thrown: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Request method failure captured: Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-floating-ips/c90e6fc5-8cd7-4203-b9c4-722dd5887a32 HTTP/1.1 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE75iIVEAoRIzDZlrOtoo34-kKXL1QcR3wwepzK2QytdRnI93C55pFsdhHHNl8ybHmMy9xq_7rJXT44uQRDPeJ_sm2JGUMALXUUCym2flWX4W3Dyqkcd7U7LCNxicT9_dX8VsEHXJ8fy1zavTlNQlA4IuUxQu3R_zmCdipIDVtsLUCJo Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 47d6e91988314f84866964e998922059 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:51:48.262456 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47d6e91988314f84866964e998922059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_47d6e91988314f84866964e998922059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/47d6e91988314f84866964e998922059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/47d6e91988314f84866964e998922059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 47d6e91988314f84866964e998922059 Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1589891603 Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FloatingIPsNegativeTestJSON-1589891603-project Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9342065f3fb246008d09a2eed524ac22 Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1589891603-project Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: exception: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32 Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c90e6fc5-8cd7-4203-b9c4-722dd5887a32'} Sep 03 20:51:48.263767 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:51:48.264532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c90e6fc5-8cd7-4203-b9c4-722dd5887a32 could not be found Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f447be2f-9080-4dfe-9b84-534f21b1f498'] Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32. Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:48.265657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32 Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:48.266797 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:48.267941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32 Sep 03 20:51:48.267941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:51:48.271774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] Returning 404 to user: Floating IP not found for ID c90e6fc5-8cd7-4203-b9c4-722dd5887a32 {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:48.273185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-574ac40c-bd1b-40d4-b364-9d008306b144 tempest-FloatingIPsNegativeTestJSON-1589891603 tempest-FloatingIPsNegativeTestJSON-1589891603-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/c90e6fc5-8cd7-4203-b9c4-722dd5887a32" status: 404 len: 111 microversion: 2.1 time: 0.171352 Sep 03 20:51:48.274284 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 426/854] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:51:48 2022] DELETE /compute/v2.1/os-floating-ips/c90e6fc5-8cd7-4203-b9c4-722dd5887a32 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:51:48.287140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:48.291199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:48.302162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.303299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.303971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.306153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.306908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.308142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.475788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.484968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c118fa1-1ff0-45bf-96a5-c2fe0c477e47 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.317251 Sep 03 20:51:48.486082 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 429/855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:48 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:48.630545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:48.631533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:48.640852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.642641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.643605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.645666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:48.646295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:48.647368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:48.696351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.709284 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46e98884-475e-4c5e-9f55-97bb614018f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.433351 Sep 03 20:51:48.710717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 427/856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:48 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:48.821310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.835668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.850412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:48.866520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b28294e-0ba1-4543-85b3-6447ff4daed1 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.240478 Sep 03 20:51:48.872325 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 430/857] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:48 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:49.131284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:49.132544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:49.145007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.145667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.146229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.147081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.147653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.148370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.196321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:49.197052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:49.214351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.215039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.215295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.216381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.217284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.217942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.481408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:49.496412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:49.498435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:49.500045 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e9991e1-4d5c-4be6-a61f-0e94e409bd3e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.308510 Sep 03 20:51:49.500940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 431/858] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:49 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:49.524839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:49.525839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:49.537622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.542638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.543453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.545331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.549832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.550587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.587961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:49.597506 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4fda3928-8242-4655-8a70-ccb77f0c490f tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1507 microversion: 2.1 time: 0.471548 Sep 03 20:51:49.598081 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 428/859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:49 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:49.736205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:49.736818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:49.750429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.750934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.751379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.752101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.752557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.753434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.778382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:49.793177 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83d9a2bb-c2c6-47ee-b065-c223f3770140 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1313 microversion: 2.1 time: 0.285572 Sep 03 20:51:49.798747 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 432/860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:49 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:49.899612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:49.900486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:49.911793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.912306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.912751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:49.913498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:49.913964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:49.914474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:50.107394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:50.119628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:50.124024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:50.136311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26a20223-ed5d-4ffd-933f-1babe6ea495a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.240310 Sep 03 20:51:50.150072 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 433/861] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:49 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:50.341252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:50.350915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bae37df6-4761-4928-9291-73e436452175 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.618686 Sep 03 20:51:50.359741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 429/862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:49 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:50.534606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:50.538035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:50.551445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:50.551965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:50.554078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:50.557668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:50.558191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:50.558639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:50.599657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:50.622420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:50.623552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:50.634658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:50.647718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:50.649478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:50.654814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:50.655570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:50.656251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.109839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.136607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.150362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.155554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d8ab7a4-3307-4209-9bd6-c3c5b3ca733e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.626172 Sep 03 20:51:51.162411 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 434/863] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:50 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:51.187360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:51.187983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:51.230911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.242129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.242963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.243859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.244443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.245631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.605049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.624645 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17eb5bd0-e6b2-45ff-a893-0e359a6d400c tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1505 microversion: 2.1 time: 1.007075 Sep 03 20:51:51.645851 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 430/864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:50 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1505 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:51:51.663635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:51.667117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:51.693973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.694542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.695899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.697238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.697921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.698425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.814567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.833535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68fd938f-4062-491b-a483-4501635ee682 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1463 microversion: 2.1 time: 0.654510 Sep 03 20:51:51.878989 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 435/865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:51 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1463 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:51.912336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:51.916435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:51.940302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.951330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.960054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.960512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.961290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:51.962093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.965553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:51.966947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:51.967805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:51.994758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4753f9ce-9b7e-4c17-a76c-1a41ee1ce98a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.346000 Sep 03 20:51:52.013013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 431/866] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:51 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:52.013013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '.version_select at 0x7fae67222280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:52.013013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:52.025360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.026738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.027398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.030209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.030894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.033929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.107107 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16169d44-6f10-4962-8487-20265d88edfc tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.099833 Sep 03 20:51:52.108859 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 432/867] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Sep 3 20:51:52 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda/os-instance-actions => generated 611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:52.117970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:52.121024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:52.130154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.130912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.131576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.132846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.133748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.134403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.254743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:52.269310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 20:51:52.299881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:51:52.301022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:51:52.301661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:51:52.302086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:51:52.302708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:51:52.370955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:52.379108 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7eaf1359-39ef-4d4c-b3ad-1cd8e37bf2aa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 0.497030 Sep 03 20:51:52.383888 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:51 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:52.392758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:52.399413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:52.410881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.411497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.411936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.412811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.413327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.413754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.469555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:51:52.545888 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1786b40c-2e6d-4d91-9112-ff479eb0e168 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd/action" status: 202 len: 0 microversion: 2.1 time: 0.435507 Sep 03 20:51:52.554238 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 433/869] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:51:52 2022] POST /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:51:52.575287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:52.575922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:52.595891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.595891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.596164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.597487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.598394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.598394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.650216 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b3f8e56-4334-4405-8661-0d292c650ed1 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 204 len: 0 microversion: 2.1 time: 0.264687 Sep 03 20:51:52.656585 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 437/870] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:51:52 2022] DELETE /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:51:52.674263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:52.674505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:52.694001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.696814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.697338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.712012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:52.715186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:52.715661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:52.951079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:52.959455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:52.971356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:52.972537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f8b4703-1325-42e4-903d-6482892377b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.416484 Sep 03 20:51:52.988089 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 434/871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:52 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:53.001639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:53.002261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:53.009153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.009652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.010129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.010849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.011303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.011725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.018656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:53.036459 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a258099-ecb8-4f63-b7ae-83cfa8f3de77 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1472 microversion: 2.1 time: 0.378383 Sep 03 20:51:53.042637 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 438/872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:52 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:53.061604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:53.065281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:53.085462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.085964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.086416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.088045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.091222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.091684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.336188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:53.349658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:53.352933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:53.362700 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ebc92a20-c709-4b07-872d-4977729ca3bb tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.316827 Sep 03 20:51:53.377858 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 439/873] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:53 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:53.412280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:53.413302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:53.430608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.431120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.431566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.432337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:53.434023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:53.440109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:53.484800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:53.495429 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-488d5996-c364-4631-a527-733920332e82 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1511 microversion: 2.1 time: 0.498595 Sep 03 20:51:53.496025 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 435/874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:52 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:54.004768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:54.005592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:54.026544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:54.027604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:54.031149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:54.033648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:54.034300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:54.036165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:54.711146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:54.733594 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24cf46ba-beab-4cce-a764-faa1934102c8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1500 microversion: 2.1 time: 1.315504 Sep 03 20:51:54.734799 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 440/875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:53 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1500 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:54.740346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:54.741194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:54.751236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:54.751992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:54.756189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:54.757195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:54.757827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:54.758436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.029144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.058926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.061140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.062854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6393f104-9b2e-49cd-9ad5-9bfad87aea43 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 1.062717 Sep 03 20:51:55.063738 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 436/876] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:53 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:55.087409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:55.093170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:55.113251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.114864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.116241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.117388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.118686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.119587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.407587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.423661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.427982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.453939 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d56adebd-986c-4a49-9051-0cbdcf2f39e6 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.388754 Sep 03 20:51:55.458198 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 437/877] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:55 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:55.466869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:55.468907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:55.490083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.490754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.491460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.492355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.493035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.493588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.566562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.594846 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5ec67cc-093a-4a7f-9885-bdc8470b7809 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1472 microversion: 2.1 time: 0.857650 Sep 03 20:51:55.595899 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 441/878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:54 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1472 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:55.767015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:55.767649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:55.808125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.808646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.813989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.818616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:55.822282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:55.824657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:55.884980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:55.894247 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd222beb-0ab8-4d97-a945-688ec2d8dc62 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1511 microversion: 2.1 time: 0.434647 Sep 03 20:51:55.908926 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 438/879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:55 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:56.093876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:56.094844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:56.111588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.112322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.112770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.113933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.114216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.114727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.308200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:56.344424 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-30128845-4865-4257-b7c5-445826bf8dc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1475 microversion: 2.1 time: 0.585565 Sep 03 20:51:56.346458 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 442/880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:55 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1475 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:56.368860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8259102-2cb6-4660-a7a1-e92eb87eca75 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '.version_select at 0x7fae670195e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:56.376539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8259102-2cb6-4660-a7a1-e92eb87eca75 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.383925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8259102-2cb6-4660-a7a1-e92eb87eca75 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.383925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8259102-2cb6-4660-a7a1-e92eb87eca75 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.403371 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8259102-2cb6-4660-a7a1-e92eb87eca75 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1953 microversion: 2.1 time: 0.038493 Sep 03 20:51:56.416350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 443/881] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:51:56 2022] GET /compute/v2.1/os-migrations => generated 1953 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:56.421227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:56.421949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:56.435117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.435719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.436388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.437402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.437701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.438137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.883592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:56.914681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:56.919844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:56.925381 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fd5048a-3475-4e74-911b-a44d5451cfae tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.835767 Sep 03 20:51:56.937092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 439/882] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:56 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:51:56.960419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:56.962771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:56.986242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.989216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:56.995168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:56.997065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:56.997558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.004502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.048823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:57.069798 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed65342d-c9e5-4ca3-966c-455715896498 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1626 microversion: 2.1 time: 0.652144 Sep 03 20:51:57.074443 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 444/883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:56 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1626 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:57.110166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:57.112062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:57.133186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.133186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.133186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.134436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.137999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.138997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.335820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:57.350957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:57.356543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:57.387363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-99b3ae12-0f45-4279-8f27-58732ec124bf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.448700 Sep 03 20:51:57.395331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:57.417619 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 440/884] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:56 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:57.422881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d217293-39a1-486b-b518-c230a4109ba1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1472 microversion: 2.1 time: 0.344672 Sep 03 20:51:57.428581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8868ede-48ca-4ae8-aca7-54bdc6a7aeda", "name": "network-vif-deleted", "tag": "1e3808ba-5d81-42f1-99fe-5637cfb9e9de"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:57.439826 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 445/885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:57 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:57.453292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.454074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.456435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.477667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] Creating event network-vif-deleted:1e3808ba-5d81-42f1-99fe-5637cfb9e9de for instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda on nch1-master-1 Sep 03 20:51:57.482865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:57.493064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:57.498287 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-99562b1f-5bcb-4f45-bd15-3e8e3b8c72c9 req-a7099470-93d0-455a-a964-795d1b924460 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079474 Sep 03 20:51:57.500356 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 441/886] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:57.513781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eaebdf87-b2a2-473d-b7a7-766a092733ac tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: .version_select at 0x7fae6715dee0>, body: {"keypair": {"name": "tempest-keypair-836234442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5+072h4YeNFZvF6E1L5c6ZY0svMB55NPUcHs5Nihhfl/jYzTwnq3MdnVuZnAOErKcuySxLFQbRfWIpW52mPPdR4pNdWPgcLS7dscTipvtZ4idsWE+FQxAabL92fVmT4A=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:51:57.519771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.522236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.523587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.530170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.531009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.531701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.550913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:57.575754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-eaebdf87-b2a2-473d-b7a7-766a092733ac tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:51:57.588263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-eaebdf87-b2a2-473d-b7a7-766a092733ac tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for user 90d7e4c2e577467f949be3dc480cc7a2 and project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:51:57.645173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eaebdf87-b2a2-473d-b7a7-766a092733ac tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141562 Sep 03 20:51:57.650947 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 442/887] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:51:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:51:57.710437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.711053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.712173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.713569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lazy-loading 'fault' on Instance uuid c8868ede-48ca-4ae8-aca7-54bdc6a7aeda {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:51:57.802047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bbfca2d8744acea2587037f190fe90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd196cef49e5040dea8885bcd8f179747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:57.812463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-519f34fd-c2d5-4ae3-88bb-a61970c8f1fa tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 200 len: 1306 microversion: 2.1 time: 0.371219 Sep 03 20:51:57.822380 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 446/888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:57 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 1306 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:57.953656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:57.954452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:57.968180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.971761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.972411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:57.975213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:57.975878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:57.976482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.336517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.353139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.360189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.363817 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eed5cc6d-f524-48ea-8aed-2f9bfb5f2797 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.415451 Sep 03 20:51:58.365945 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 443/889] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:57 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:58.432686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:58.434459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:58.457240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:58.458101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:58.459822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.460834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.466379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.470077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.473138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.473999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.476744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.490850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.499022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.502030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.503005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.508070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.737303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.754287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.772182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:58.790872 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-51a5061c-12aa-4275-aff3-d6271f6004d3 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.362448 Sep 03 20:51:58.792662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 447/890] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:58 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:51:58.856061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:58.860485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] [instance: c8868ede-48ca-4ae8-aca7-54bdc6a7aeda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:58.886423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.887950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.889871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.893163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:58.893923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:58.896821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:58.950717 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] HTTP exception thrown: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Request method failure captured: Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda HTTP/1.1 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE75Q6_024Di3GYaSmLVrZMPI_To72526OnAyLbDXv_HLkZvF_qRvzxvjrFWENE2CVwGzNB2nCLs6GPpvXP0dZhAxKdsyvWDeI2moadfunFuL2oXBLi_lYltCW90YqRVI5Wq1lXjt43xVFq2rfdllyzJyOeuwudXMVcxaGmM94hqSSwQ Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: d196cef49e5040dea8885bcd8f179747 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceActionsTestJSON-2059239928 Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:51:58.954548 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d196cef49e5040dea8885bcd8f179747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d196cef49e5040dea8885bcd8f179747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d196cef49e5040dea8885bcd8f179747"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d196cef49e5040dea8885bcd8f179747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceActionsTestJSON-2059239928 Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: d196cef49e5040dea8885bcd8f179747 Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2059239928 Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceActionsTestJSON-2059239928-project Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 10bbfca2d8744acea2587037f190fe90 Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceActionsTestJSON-2059239928-project Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. Sep 03 20:51:58.956003 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c8868ede-48ca-4ae8-aca7-54bdc6a7aeda'} Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:51:58.956753 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. Sep 03 20:51:58.960313 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:51:58.963972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] Returning 404 to user: Instance c8868ede-48ca-4ae8-aca7-54bdc6a7aeda could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:51:58.963972 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9da17fa5-ce35-432b-9c4a-75c9229e1853 tempest-InstanceActionsTestJSON-2059239928 tempest-InstanceActionsTestJSON-2059239928-project] 10.222.0.16 "GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda" status: 404 len: 111 microversion: 2.1 time: 0.111432 Sep 03 20:51:58.963972 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 448/891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:58 2022] GET /compute/v2.1/servers/c8868ede-48ca-4ae8-aca7-54bdc6a7aeda => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:51:59.266938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:51:59.276601 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7a3e858-d754-4d21-b532-086fb523be1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.824790 Sep 03 20:51:59.281663 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 444/892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:51:58 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:51:59.397831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:59.398709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:59.410932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:59.416682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:59.418657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:59.419739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:59.421499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:59.426661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:59.828373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:51:59.828373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:51:59.844867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:59.845401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:59.845845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:51:59.846564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:51:59.847018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:51:59.847444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:00.028861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.042942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.049952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.051478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91379d12-00fb-49c1-b6a4-72798065c42d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.658293 Sep 03 20:52:00.065510 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 449/893] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:59 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:00.309137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:00.310027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:00.328932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.330741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:00.331429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:00.332043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:00.332977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:00.333732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:00.333852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:00.343182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.351760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.364825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:00.377893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6dcc61c-c56d-4f23-98f8-a99971750f3f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.555982 Sep 03 20:52:00.378666 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 445/894] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:51:59 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:00.806397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:00.833977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d104b0a-03fc-47df-ad3c-ae981f3d8a14 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.528984 Sep 03 20:52:00.834950 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 450/895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:00 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:01.083599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:01.089753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:01.104203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.106912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.107378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:01.108119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.109611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.110069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:01.400799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.410716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:01.411691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:01.415080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.419637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.421670 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91245486-b497-43c7-8643-17546d930336 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.343192 Sep 03 20:52:01.423919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.424498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.426126 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 446/896] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:01 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:01.438328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:01.449660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.450349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.451040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:01.754375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.773182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.780498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:01.796680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f49af315-b4dc-428a-8e33-60e6de4b3b61 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.390720 Sep 03 20:52:01.801898 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 451/897] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:01 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:01.859859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:01.860702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:01.872979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.876592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.877825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:01.880354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:01.883436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:01.883947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:02.243468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:02.255770 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5192a662-c037-4bec-937b-36a45093f3c4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.395784 Sep 03 20:52:02.257169 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 447/898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:01 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:02.455494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:02.456188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:02.464145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:02.471479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:02.471992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:02.472800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:02.473309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:02.473740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:02.514017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60053839-fd83-4869-9c93-cc6ce1c6f6ee", "name": "network-vif-unplugged", "status": "completed", "tag": "4b3e9c56-57de-488b-8332-f75b77ef84b3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:02.540669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:02.541131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:02.541566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:02.573854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] Creating event network-vif-unplugged:4b3e9c56-57de-488b-8332-f75b77ef84b3 for instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee on nch2-master-1 Sep 03 20:52:02.595849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-999a7a26-73ca-4a0c-9afd-c4c6c4776cc7 req-9beb9453-22e0-434a-8ac0-d887eb80dc9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086161 Sep 03 20:52:02.596450 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 448/899] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:52:02.601943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1185891869", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "eca47d48-10bc-437f-b0d1-1cf63a3c4084"}], "security_groups": [{"name": "tempest-securitygroup--300197575"}], "key_name": "tempest-keypair-836234442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:02.842907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] validate_networks() for [('eca47d48-10bc-437f-b0d1-1cf63a3c4084', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:03.273510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.288131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.289958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.324243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca5f7eb3-755d-42f6-bb32-37f4e6f4c8ab tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.854967 Sep 03 20:52:03.329126 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 452/900] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:02 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:03.341643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:03.344863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:03.367609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.368336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.370403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:03.371393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.372525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.374648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:03.655310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.668206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.670129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:03.684298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53b9cd8b-040e-4d68-97b9-5f5dcadf4bc0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.351111 Sep 03 20:52:03.687631 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 453/901] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:03 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:03.705198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:03.706063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:03.717010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.720401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.721044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:03.722016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.722638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.723253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:03.955400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:03.955900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:03.956302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:03.956714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:03.957193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:03.977929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.978420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.980714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:03.984779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:03.985593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:03.986371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:04.040688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:04.054629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for user 90d7e4c2e577467f949be3dc480cc7a2 and project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:04.088629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:04.095989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:04.248618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b2be9a5-feb6-459a-8343-12aa3cdb7aed tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.650620 Sep 03 20:52:04.262057 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 449/902] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:52:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:52:04.287971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21befee3-51d5-4009-bf60-a32eec8f5ade tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:04.289370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-21befee3-51d5-4009-bf60-a32eec8f5ade tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:04.584523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-21befee3-51d5-4009-bf60-a32eec8f5ade tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:04.629079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21befee3-51d5-4009-bf60-a32eec8f5ade tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1234 microversion: 2.1 time: 0.351375 Sep 03 20:52:04.630089 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 450/903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:04 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1234 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:04.660737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:04.661481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:04.675338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:04.678143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:04.679642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:04.680703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:04.689642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:04.691016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:04.801452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:04.811744 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22e603d7-93eb-4b8f-a96f-d10d3818fa1f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 1.122841 Sep 03 20:52:04.823369 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 454/904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:03 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:04.847506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:04.851969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:04.883914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:04.885308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:04.885959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:04.895061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:04.897196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:04.898219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.143156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.155196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.163483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.182244 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bd488a45-dc2e-4adc-8b91-0fa1e1ec09d5 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.352095 Sep 03 20:52:05.184313 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 455/905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:04 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:05.210557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60053839-fd83-4869-9c93-cc6ce1c6f6ee", "tag": "4b3e9c56-57de-488b-8332-f75b77ef84b3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:05.227659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:05.228393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:05.229561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.265793 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] Creating event network-changed:4b3e9c56-57de-488b-8332-f75b77ef84b3 for instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee on nch2-master-1 Sep 03 20:52:05.279828 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0c9fd008-ad0f-49a5-91e8-e28dc00e00bf req-de8a3690-dd3e-42d4-90e7-1ad4fea09439 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087375 Sep 03 20:52:05.284453 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 456/906] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:05.520759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.539141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.543242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.549447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c0d0249-4b1e-46e8-9ff0-88fc14b73310 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.907737 Sep 03 20:52:05.551950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 451/907] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:04 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:05.657468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:05.658112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:05.677941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:05.683900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:05.684484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.685669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:05.685792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:05.686191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.855625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:05.856440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:05.870793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:05.871443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:05.871908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.872827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:05.878394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:05.878972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:05.911273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:05.923376 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7ee70b6-103e-4fe6-88ee-dcfa23994cd6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1230 microversion: 2.1 time: 0.270824 Sep 03 20:52:05.923964 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 457/908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:05 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1230 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:06.216019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:06.216589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:06.233863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.234387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.234850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:06.235590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.236053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.243006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:06.268624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:06.287817 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47fc1892-6763-44d8-80cc-6291c5459f87 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.434465 Sep 03 20:52:06.288687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 452/909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:05 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:06.422037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:06.433992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:06.436598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:06.442297 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-41050429-207e-4443-b7d4-ac798b49c835 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.231496 Sep 03 20:52:06.458409 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 458/910] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:06 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:52:06.576628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:06.578058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:06.604418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.610652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.613780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:06.616574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.622421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.623185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:06.949946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:06.950563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:06.963487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.964011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.968172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:06.969806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:06.971482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:06.977852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:07.226942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:07.236440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e0a66de-d52e-4460-9219-32f049a41824 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1304 microversion: 2.1 time: 0.290494 Sep 03 20:52:07.241530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 459/911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:06 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1304 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:07.313391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:07.314237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:07.327037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:07.329512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:07.330026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:07.330557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:07.331291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:07.331755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:07.332193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:07.834184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:07.850327 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e773a59-d931-46bf-9060-0d709a3549e0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.541464 Sep 03 20:52:07.851562 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 460/912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:07 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:07.868297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:07.871051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:07.886444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:07.902154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:07.902907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:07.903848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:07.904473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:07.905087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:08.018403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.029224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.031032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.032390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f85b5694-6a91-4fc5-acc3-8606ca2ae228 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 1.460246 Sep 03 20:52:08.033585 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 453/913] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:06 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:08.097705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.112566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.114061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.121663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afe72845-75e4-4102-a00c-c3ea9483996f tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1555 microversion: 2.91 time: 0.268727 Sep 03 20:52:08.122634 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 461/914] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:07 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:08.265173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:08.266174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:08.275478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:08.276835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:08.277516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:08.278758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:08.280192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:08.281121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:08.401408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:08.415884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-38989c61-9c64-47fd-8e51-51ea319d7afa tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1292 microversion: 2.1 time: 0.155807 Sep 03 20:52:08.417297 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 454/915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:08 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:08.878250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:08.879153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:08.892623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:08.893148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:08.893589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:08.898663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:08.899155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:08.907163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.065962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:09.066502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:09.083970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.084650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.085528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.086495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.089956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.090477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.488529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.501220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.502883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.511179 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24903973-5844-4b11-b041-c23509a29ca9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.451987 Sep 03 20:52:09.530767 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 455/916] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:09 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:09.530767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:09.530767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:09.539428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.545527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.546328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.547265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.547900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.548493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.749155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.759212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.760722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.789789 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c049a97-e61b-4509-96c5-cd3c6de35cfa tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1537 microversion: 2.91 time: 0.262502 Sep 03 20:52:09.791706 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 456/917] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:09 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1537 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:09.797298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:09.798356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:09.811179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.811929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.812426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.813182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:09.813645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:09.814078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:09.889068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.913368 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab3d7ce5-6b54-41ac-b37f-539ce837fafb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 1.039654 Sep 03 20:52:09.914988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 462/918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:08 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:09.973029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:09.985671 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c13747a-98a3-42d2-ae43-c2f83be9ef70 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1292 microversion: 2.1 time: 0.188703 Sep 03 20:52:09.986319 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 457/919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:09 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:10.538676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:10.540238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:10.550525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:10.552858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:10.553368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:10.557016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:10.557584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:10.558032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:10.821035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:10.826521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:10.844361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:10.855768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:10.856497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:10.866030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:10.866780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:10.867417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:11.145649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.164104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.175142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.176746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12e7d311-cce5-4cbd-81ee-0dbd0b9bb813 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.642225 Sep 03 20:52:11.177829 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 463/920] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:10 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:11.183588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:11.190623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:11.197780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:11.198539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:11.199218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:11.200184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:11.200868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:11.201559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:11.322704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.332798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.338448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.354324 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f4178da-9d29-491a-a273-8868ff1a2361 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1537 microversion: 2.91 time: 0.539040 Sep 03 20:52:11.361261 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 458/921] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:10 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1537 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:11.366368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:11.366989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:11.390043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:11.390550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:11.390998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:11.391731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:11.392198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:11.392636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:11.677524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:11.692042 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a76ac584-9726-43b9-8672-c55c092fc7b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.512751 Sep 03 20:52:11.693682 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 464/922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:11 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:12.168417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.178289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41623d65-9fe1-499b-b54d-9481de3d2f10 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.815823 Sep 03 20:52:12.179685 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 459/923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:11 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:12.207470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:12.208252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:12.216740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.218711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.220269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.221392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.222225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.222899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.396509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:12.397753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:12.408536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.409187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.409668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.410401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.411013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.411713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.509357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.519890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.524404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.528150 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1625a8c-bd8c-4aff-b72c-6ec97e482027 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.325117 Sep 03 20:52:12.557503 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 465/924] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:12 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:12.598287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.611522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.613177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:12.639037 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f515bc2d-4d73-4afe-998c-2febb33dc244 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1480 microversion: 2.91 time: 0.256922 Sep 03 20:52:12.639647 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 460/925] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:12 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1480 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:12.678573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:12.682645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:12.700471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.701024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.701720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.702667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.703289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.703925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.715715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:12.716386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:12.733186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.734133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.734133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.734842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:12.735304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:12.735736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:12.811348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:12.851683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140520) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 20:52:12.963597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:13.013588 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25e2e7ce-edf1-46c7-b076-fb8456f9e12d tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action" status: 202 len: 0 microversion: 2.91 time: 0.343966 Sep 03 20:52:13.015913 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 466/926] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:52:12 2022] POST /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:52:13.305477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:13.323278 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e46d0338-3575-47d3-a2d4-9d6feaa0073b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.611373 Sep 03 20:52:13.332538 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 461/927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:12 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:13.352215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:13.353248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:13.376255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:13.377108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:13.377729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:13.378717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:13.379367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:13.379955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:13.577496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:13.593477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:13.594956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:13.609534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8a5e271-b27e-4643-8dc3-9089a6f25489 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1488 microversion: 2.91 time: 0.275648 Sep 03 20:52:13.624921 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 462/928] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:13 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:13.624921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:13.624921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:13.633601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:13.638963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:13.639769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:13.640690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:13.641344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:13.642854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:13.718570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1911606244", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:13.788294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] validate_networks() for [('6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:14.007752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:14.084745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:14.097903 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f31e0ff1-0062-46df-8f63-5dfab8ea98a0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.486362 Sep 03 20:52:14.111249 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:13 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:14.146163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:14.151393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:14.191953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:14.196599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:14.197965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:14.205407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:14.206325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:14.207014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:14.612505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:14.770529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:14.784436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:14.786669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:14.788138 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d17673f-4018-4852-8e3c-0bf1b4d36f3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.672706 Sep 03 20:52:14.795741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 464/930] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:14 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:14.809632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:14.829212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:14.829963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:14.830627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:14.860269 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] Creating event network-changed:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch2-master-1 Sep 03 20:52:14.871518 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-662eb8bb-9b72-4973-be25-25091f27bb35 req-d6adb806-5ffa-4808-9bcc-a07f330976c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073833 Sep 03 20:52:14.872715 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 465/931] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:14.878233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:14.885099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:14.897196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:14.902874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:14.903612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:14.904852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:14.905567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:14.908560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.259583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:15.273685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5866fb5-0b29-4084-bb59-31f5636c395f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.397829 Sep 03 20:52:15.275007 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 466/932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:14 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:15.289537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:15.292373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:15.309927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.314093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.317935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.328723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.329617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.330342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.482580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:15.493807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:15.495440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:15.502441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e931ef7f-d66a-4b98-9483-51ff83a555e0 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.224229 Sep 03 20:52:15.505400 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 467/933] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:15 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:15.526633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:15.527272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:15.537532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.538046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.538474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.539476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.540583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.541095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.791677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:15.802729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-235d4b6a-eadf-4b94-b8f1-22f20291403e tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.294254 Sep 03 20:52:15.807571 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:15 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:15.825970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:15.826663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:15.843901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.844445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.844881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:15.852474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:15.853200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:15.853711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.146218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:16.147277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:16.147932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:16.149705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:16.150337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:16.164624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.165862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.166975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.168108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.169172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.169816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.194825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:16.204388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for user d9688dca94a841cfa29420ad780562cd and project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:16.228441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:16.233296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:16.326270 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f9f4821-49f3-4a7b-a5e2-1f068ac1c396 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.308682 Sep 03 20:52:16.327745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 467/935] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:52:16.333945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:16.335036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:16.343250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.344465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.345512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.346741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.347709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.348569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.551594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:16.564100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:16.566355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:16.568098 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fab5f86e-f6b9-4612-8464-8a12af584f42 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1567 microversion: 2.25 time: 0.754599 Sep 03 20:52:16.568998 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 469/936] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:15 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1567 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:16.588229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5213cdd-8393-4260-89ad-ee808c5e090c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:16.589702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5213cdd-8393-4260-89ad-ee808c5e090c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:16.632603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:16.646075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d8f023f-683a-4c04-8ab6-4072f8ecf96d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.316983 Sep 03 20:52:16.647868 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 468/937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:16 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:16.660975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:16.661925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:16.702592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.703141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.703594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:16.704635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:16.705348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:16.705989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:17.024337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5213cdd-8393-4260-89ad-ee808c5e090c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:17.032103 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5213cdd-8393-4260-89ad-ee808c5e090c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1208 microversion: 2.1 time: 0.461638 Sep 03 20:52:17.032678 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 470/938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:16 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1208 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:17.063118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:17.063951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:17.066188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:17.080479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:17.095899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:17.098411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:17.099264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:17.099837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:17.100197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:17.100787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:17.104467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:17.105149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:17.110881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d3244008-6a8e-4c20-b8b9-5c0b62ff82ad tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.461738 Sep 03 20:52:17.111510 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 469/939] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:16 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:17.594308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:17.595623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:17.611624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:17.612467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:17.616059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:17.623253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:17.624120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:17.626202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:18.116197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:18.139738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:18.146436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:18.157517 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e33eae6-7fb2-4145-b648-ff96d3c77525 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1557 microversion: 2.25 time: 0.567718 Sep 03 20:52:18.163883 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 470/940] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:17 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1557 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:18.182256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:18.182875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:18.222185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:18.222684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:18.223226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:18.223846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:18.224305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:18.224733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:18.680681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:18.705209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-76b26c47-d807-453f-b9a0-6d54a6acac79 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.534136 Sep 03 20:52:18.707900 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 471/941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:18 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:18.720457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:18.730621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:18.744533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:18.751051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:18.751827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:18.752834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:18.753659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:18.754482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:18.988662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:19.006258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bdb2bea8-7c01-4b9b-9f72-d93138cc05a4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 1.955136 Sep 03 20:52:19.008709 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 471/942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:17 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:19.020715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:19.026865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:19.047971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.049937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.050679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.053528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.054355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.058050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.070900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:19.084194 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e3becc5-a8ad-4ba4-9494-a7d885b2f9f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1260 microversion: 2.1 time: 0.374391 Sep 03 20:52:19.089327 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 472/943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:18 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1260 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:19.111728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6065f599-ff6c-40d8-8820-86488fd463de tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '.version_select at 0x7fae6705eee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:19.152138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6065f599-ff6c-40d8-8820-86488fd463de tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.155589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6065f599-ff6c-40d8-8820-86488fd463de tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.156408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6065f599-ff6c-40d8-8820-86488fd463de tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.213199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6065f599-ff6c-40d8-8820-86488fd463de tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.117660 Sep 03 20:52:19.220271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 473/944] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Sep 3 20:52:19 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:19.239642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:19.241268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:19.260277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.261531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.262225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.263411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.264105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.272105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.359817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:19.371024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:19.373356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:19.387437 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc35f268-62ab-4f3e-a0e2-67f85e937351 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.375931 Sep 03 20:52:19.404445 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 472/945] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:19 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:19.736527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:19.738300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:19.751794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.754764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.755686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:19.756608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:19.759645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:19.760656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:20.649398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 60053839-fd83-4869-9c93-cc6ce1c6f6ee {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:20.669300 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a638d2d0-2138-49bb-8e70-1d4d761045fa tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 2049 microversion: 2.25 time: 1.434458 Sep 03 20:52:20.694138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 474/946] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:19 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 2049 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:20.707850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:20.708465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:20.718535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:20.719071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:20.719507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:20.720406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:20.721151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:20.722014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:20.883502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:20.904405 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0198b8a1-1dd9-4d3b-8c1b-fa71d99d89ac tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 1.172676 Sep 03 20:52:20.912671 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 473/947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:19 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:20.938703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:20.940582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:20.972307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:20.973246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:20.973918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:20.974986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:20.975696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:20.976373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:21.168003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:21.176630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aaed56bc-8bc4-4080-bfeb-704cbe25406a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1266 microversion: 2.1 time: 0.262299 Sep 03 20:52:21.180265 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 474/948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:20 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:21.189933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:21.190719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:21.202950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:21.206691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:21.207440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:21.208446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:21.213591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:21.215892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:21.366907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:21.382584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:21.389837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac98c24d-ddd0-40c2-8a23-cc56876dbc19 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.688974 Sep 03 20:52:21.393254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:21.402428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 475/949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:20 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:21.404104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:21.417181 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b3b86e2-b3a9-4594-9fbd-6bdaca66f04b tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.235535 Sep 03 20:52:21.425641 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 475/950] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:21 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:21.474248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-573994962", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:21.628171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] Calling method '.version_select at 0x7fae66fca550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:21.630596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] validate_networks() for [('57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:21.727438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9e88e78d-25d3-4308-be06-bd368b7bffae could not be found", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:52:21.728927 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] HTTP exception thrown: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] Request method failure captured: Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-floating-ips/9e88e78d-25d3-4308-be06-bd368b7bffae HTTP/1.1 Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE76FAxz3pjsUDmEV1A4ItC_xROJudfWOlgc8gsJLTYDlwzDKHs7d0dNBxZj4KSKXVJH8_B7BM08cMNjAXe36KruI6m4AZkLhj-WcuWZu3uB9NxsTLDjzfxOzoEBDE2blfS2IES7WDRJiE5jmH9arRQfi1cLNerA-ZjP4iJBojSAx-Wg Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: e44f80b00bc14282af09e08925c79c7d Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1603296801 Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:52:21.731062 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44f80b00bc14282af09e08925c79c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e44f80b00bc14282af09e08925c79c7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e44f80b00bc14282af09e08925c79c7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e44f80b00bc14282af09e08925c79c7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1603296801 Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: e44f80b00bc14282af09e08925c79c7d Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1603296801 Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: b52bd1dc24db4078b99839e483934234 Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: exception: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae Sep 03 20:52:21.732667 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '9e88e78d-25d3-4308-be06-bd368b7bffae'} Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:52:21.733633 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9e88e78d-25d3-4308-be06-bd368b7bffae could not be found Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cd89601-d6e5-493f-adca-3de670421e55'] Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae. Sep 03 20:52:21.734998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:21.736352 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:52:21.737911 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:52:21.737911 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae Sep 03 20:52:21.737911 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:21.739005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] Returning 404 to user: Floating IP not found for ID 9e88e78d-25d3-4308-be06-bd368b7bffae {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:52:21.740096 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f06e8080-cf39-4dfa-9349-5635bf9492e0 tempest-FloatingIPDetailsNegativeTestJSON-1603296801 tempest-FloatingIPDetailsNegativeTestJSON-1603296801-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/9e88e78d-25d3-4308-be06-bd368b7bffae" status: 404 len: 111 microversion: 2.1 time: 0.199597 Sep 03 20:52:21.740879 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 476/951] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:52:21 2022] GET /compute/v2.1/os-floating-ips/9e88e78d-25d3-4308-be06-bd368b7bffae => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:52:21.935054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:21.936410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:21.945073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:21.954329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:21.958312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:21.963892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:21.968132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:21.968815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:22.903696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:22.915600 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ce23333-bdb7-4b35-bd05-2ae93799d8ff tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.984633 Sep 03 20:52:22.932032 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:21 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:22.937349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:22.938656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:22.958358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:22.959209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:22.959835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:22.960735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:22.962047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:22.963797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:23.215730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:23.227908 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0cfa0bb-0d0a-414a-900d-92a9bd7be038 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.294276 Sep 03 20:52:23.241671 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 478/953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:22 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:23.258396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:23.259246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:23.275663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:23.276533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:23.277176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:23.278157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:23.281163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:23.281868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:23.921289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:23.921860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:23.922355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:23.922778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:23.923249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:23.938077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:23.938558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:23.941582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:23.943347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:23.943788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:23.945899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:23.981388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:23.991659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:23.993962 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6ca7fac-03cb-4b69-9ce2-b36511923863 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.750261 Sep 03 20:52:23.994549 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 479/954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:23 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:24.004554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:24.008682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:24.024081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for user 778561ee5e474accb31816f357985f44 and project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:24.046761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.049342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.049794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.053192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.054078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.055190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.060532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:24.067342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:24.126331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:24.200875 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3175d984-2848-42f8-9de0-7d4b329816c4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.790721 Sep 03 20:52:24.209978 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 476/955] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:52:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:52:24.224757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "name": "network-vif-plugged", "status": "completed", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:24.265288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.266064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.267133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.302929 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] Creating event network-vif-plugged:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch2-master-1 Sep 03 20:52:24.311383 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c28e73df-01d8-4609-b380-7593a66f5669 req-ae9b79a4-3f7f-47ee-bcec-7fed284f5ece service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099757 Sep 03 20:52:24.312815 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 477/956] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:24.328401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:24.329870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:24.349205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.350419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.351100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.352549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.353332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.354175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.414783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:24.428157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:24.437942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:24.455579 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc673877-1f4c-48b7-ba10-f5d55a10ef8d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.459792 Sep 03 20:52:24.465265 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 480/957] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:23 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:24.472664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd89dac-67e7-4386-8d33-0ca58ab9c14d", "tag": "a8da193f-e198-4120-be6f-383cbe65b606"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:24.500069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.500814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.501503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.528598 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] Creating event network-changed:a8da193f-e198-4120-be6f-383cbe65b606 for instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d on nch2-master-1 Sep 03 20:52:24.536881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-85a38a5f-39ee-44b5-88a1-7d517d2512e7 req-540d5570-3355-4d3e-96bb-37bf5e3e3733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069344 Sep 03 20:52:24.549223 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 481/958] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:24.554775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:24.555844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:24.800746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:24.814357 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-be5f1670-915b-459e-b1ee-e1f45bcbfbd6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.499982 Sep 03 20:52:24.829519 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 478/959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:24 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:24.842764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:24.843701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:24.861615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.862384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.863013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:24.863909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:24.864549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:24.870292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.056277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.069954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.071436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.072630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-75a81d52-5f1b-44d6-97b6-b761d126b299 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1261 microversion: 2.25 time: 0.522007 Sep 03 20:52:25.100922 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 482/960] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:24 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1261 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:25.101737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:25.102367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:25.119447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.120025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.120483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.121290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.121750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.122442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.154973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.171163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-654dc013-7175-4d37-b627-795f08b4e6a8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.338875 Sep 03 20:52:25.173102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 479/961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:24 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:25.492078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:25.493136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:25.505729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.508735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.510120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.513611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.514459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.515116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.702431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.719878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-36a95ed0-20c6-41d4-9f14-e874a803f491 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.625146 Sep 03 20:52:25.721409 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 483/962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:25 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:25.731472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.741272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.749228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:25.772707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1037c922-085b-4162-b9da-81a3dc45ac22 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.286075 Sep 03 20:52:25.788003 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 480/963] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:25 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:25.854155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:25.855084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:25.865835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.867046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.867522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:25.870358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:25.870853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:25.871305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.116110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:26.117093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:26.142446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.145147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.146401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.148661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.151081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.152098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.296528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:26.312883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:26.314946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:26.319016 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc501ac4-7543-4b21-8f7f-13a589d819a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1257 microversion: 2.25 time: 0.208129 Sep 03 20:52:26.319947 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 481/964] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:26 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1257 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:26.331685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:26.336860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:26.350028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.350933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.351579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.356405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.357216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.359890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.368055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:26.377562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6dc01ac-c0cb-4fd0-860d-389bb499a1ce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.540029 Sep 03 20:52:26.396123 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 484/965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:25 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:26.752437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:26.753581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:26.760324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.760829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.773594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.774385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.774900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.775342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.883645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:26.895281 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb099d00-c738-4fea-9e26-f0c9824ca7d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.572762 Sep 03 20:52:26.896801 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:26 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:26.908415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:26.911030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:26.936550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.940151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.954242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:26.961908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:26.962381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:26.962854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.291815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.317244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.323619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.339722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d6167560-9107-4bf8-8dfd-64ed946ec06d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.440563 Sep 03 20:52:27.341533 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 483/967] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:26 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:27.357640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:27.359327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:27.386414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.390329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.391774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.393538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.395311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.396737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.402141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.423120 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f882860-d4d3-4458-a73a-94a3924e18f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1359 microversion: 2.1 time: 0.675686 Sep 03 20:52:27.429481 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 485/968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:26 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1359 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:27.436850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:27.437501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:27.466160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.466804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.467574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.468349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.469017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.469631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.698588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.721835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.729605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:27.730919 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3015a879-0687-44a3-8c80-dda1bd4e5555 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1313 microversion: 2.25 time: 0.379072 Sep 03 20:52:27.733741 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 484/969] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:27 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:27.744500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:27.764436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:27.780875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.784602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.785984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.787546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:27.793091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:27.812830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:27.870874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:27.927092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:52:28.222399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3da99f43-cc58-40cf-bc77-1f50c9e88bf2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 204 len: 0 microversion: 2.1 time: 0.485847 Sep 03 20:52:28.224529 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 485/970] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:52:27 2022] DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:52:28.231725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:28.236825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:28.247962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.248876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.249800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.251364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.252601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.253943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.544395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.564627 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e17b86b7-5c26-4320-9f2a-c96500969cd5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.338338 Sep 03 20:52:28.565754 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 486/971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:28 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:28.572314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:28.572976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:28.579903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.580649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.581211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.582027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.582555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.583055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.664442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.674899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.676727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.682179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:28.683898 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95bb3c75-ed21-4aea-8eb7-9fa7c879d122 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.117193 Sep 03 20:52:28.684733 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 487/972] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:28 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:28.690774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:28.692663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:28.699456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.700343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.700876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.701717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:28.702386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:28.702950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:28.874544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.887458 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d7bb626-3c1e-4f07-8d5b-9f55c7542cb1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 1.456609 Sep 03 20:52:28.888454 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 486/973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:27 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:28.902900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-53202007", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "1260316751", "adminPass": "***", "networks": [{"uuid": "5148a9b6-e1e4-44b4-9e4d-fbd66236154a"}], "security_groups": [{"name": "tempest-securitygroup--368912719"}], "key_name": "tempest-keypair-425500010", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:28.961271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:28.970896 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e9b640d9-a4af-41cc-86d2-545089cc27ba tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1540 microversion: 2.1 time: 0.283852 Sep 03 20:52:28.992293 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 488/974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:28 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1540 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:28.999562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:29.000200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:29.025154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.025669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.026114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.026845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.027288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.027714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.124450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:29.141150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:29.143057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:29.144333 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab94bf84-dae2-45c3-9aa2-d84873d6cc3d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1321 microversion: 2.25 time: 0.151276 Sep 03 20:52:29.155327 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 489/975] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:28 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:29.174035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:29.174724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:29.183442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.184063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.184508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.185314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.186047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.186595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.201008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] validate_networks() for [('5148a9b6-e1e4-44b4-9e4d-fbd66236154a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:29.290150 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93d4e0d6-a7ea-4f87-87c5-7eb5d92d7598 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121344 Sep 03 20:52:29.290976 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 490/976] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:52:29 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:29.595471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:29.600116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:29.611023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.614802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.615536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.617745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.618489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.621248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.882104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:29.884474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:29.885895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:29.887185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:29.887906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:29.911361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.912234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.912930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.916206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:29.930384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:29.932020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:29.967083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for project 68cdc132e95244478bf01490de3e0941. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:29.974579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Getting quotas for user ee0fdf107484448d862ac3216df0d9dc and project 68cdc132e95244478bf01490de3e0941. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:29.990782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:29.996719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:30.075620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.084312 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d048a8a-e012-4a4d-b271-747187fc1a50 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.191366 Sep 03 20:52:30.088471 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 487/977] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:52:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:52:30.091288 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5477335b-c845-423a-8582-d78e245d19c3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.499952 Sep 03 20:52:30.093097 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 491/978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:29 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:30.102752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:30.107444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:30.115462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:30.116284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:30.136808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.139589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.139589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.140162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.140351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.140782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.142818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.143100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.143884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.144005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.144204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.144789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.292047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.329593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.331267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.343805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a72ef95d-9da2-4a76-9561-b165e68eb888 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.254164 Sep 03 20:52:30.355912 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 488/979] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:30 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:30.371336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a024526-43b8-401b-a87a-fc2f1469cb89 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:30.372237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a024526-43b8-401b-a87a-fc2f1469cb89 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:30.641939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a024526-43b8-401b-a87a-fc2f1469cb89 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.649878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a024526-43b8-401b-a87a-fc2f1469cb89 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1262 microversion: 2.1 time: 0.291696 Sep 03 20:52:30.675534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 489/980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:30 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1262 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:30.684364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:30.684364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:30.720730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.727740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.727740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.727740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:30.727740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:30.738514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:30.945241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.949617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.966816 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7586631-4906-4730-a809-a3ec78a887b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.871596 Sep 03 20:52:30.969188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.977634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:30.982579 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c55cd73-873c-4bb1-b350-1dae0b56e5eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1321 microversion: 2.25 time: 0.307791 Sep 03 20:52:30.989326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 492/981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:30 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:30.998660 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 490/982] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:30 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:31.122771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:31.123721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:31.135180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:31.135809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:31.140109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:31.140109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:31.140494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:31.142260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:31.388547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:31.389428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:31.402684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:31.403845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:31.405686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:31.407610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:31.421189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:31.430724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:31.615191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:31.627486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:31.632419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:31.648945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a7ef404c-94be-4368-961e-91b4b20edb88 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.265652 Sep 03 20:52:31.650121 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 491/983] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:31 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:31.752784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1226564031", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "46c3663f-2ad6-4b0c-8a98-90501bb3a2e0"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:31.853650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] validate_networks() for [('46c3663f-2ad6-4b0c-8a98-90501bb3a2e0', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:31.987521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.007391 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5fc98bb-a2bf-4865-a7bb-abdb3d37957b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.890065 Sep 03 20:52:32.008088 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 493/984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:31 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:32.038553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd89dac-67e7-4386-8d33-0ca58ab9c14d", "name": "network-vif-plugged", "status": "completed", "tag": "a8da193f-e198-4120-be6f-383cbe65b606"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:32.059423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.059901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.060333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.074035 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] Creating event network-vif-plugged:a8da193f-e198-4120-be6f-383cbe65b606 for instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d on nch2-master-1 Sep 03 20:52:32.079209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e4ab705b-d897-48ba-b2db-0878f34bc39f req-77259589-9202-4828-adb4-e5bd0de9636a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056154 Sep 03 20:52:32.083087 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 494/985] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:32.088985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:32.089709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:32.096866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.097618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.098263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.099135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.099743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.100417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.205581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.217683 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d46e70e-a15d-499e-a06d-b05c25478f87 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1314 microversion: 2.1 time: 0.132789 Sep 03 20:52:32.219016 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 495/986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:32 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1314 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:32.224053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:32.225297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:32.233187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.240831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.241718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.244323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.245112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.245929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.555788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.565614 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cdf193a0-6517-44b9-a2fc-447926794abc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.345207 Sep 03 20:52:32.566210 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 496/987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:32 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:32.584263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:32.586803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:32.598580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.599700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.600420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.602144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.604068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.605863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.715941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.729354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.731059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.732441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a39ae578-259f-49d3-9735-bbfd1b6f9dc2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1321 microversion: 2.25 time: 0.161036 Sep 03 20:52:32.749021 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 497/988] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:32 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:32.749021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:32.752306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.752964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.753676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.772274 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] Creating event network-changed:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch2-master-1 Sep 03 20:52:32.779577 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b1d6f0f4-2cd6-4ad7-a7a8-5f028176d2e1 req-e450140b-ff88-4377-8209-07a76ef83d8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044367 Sep 03 20:52:32.781497 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 498/989] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:32.791121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:32.792391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:32.800602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.801210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.801658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.802695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:32.803396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:32.804023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:32.944003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.956516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.959064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:32.966745 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7cabe5f3-b8a4-407c-a161-9b5bef5ff1b9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.183338 Sep 03 20:52:32.999957 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 499/990] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:32 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:33.034402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:33.035237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:33.042373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.047106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.047709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.048481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.057375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.057938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.495854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:33.510257 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59ba611a-da0d-412b-9455-4d511893d7f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1308 microversion: 2.1 time: 0.480537 Sep 03 20:52:33.510850 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 500/991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:33 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:33.525636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:33.526315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:33.538586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.542020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.542510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.544081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.544571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.547103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.570516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:33.571461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:33.572636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:33.573359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:33.573958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:33.589973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.590481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.590985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.591924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.592657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.593267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.631956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Getting quotas for project c55700f621564ad5a52056d7a7854e20. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:33.637447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Getting quotas for user 86035889fc474973bc31a97989ec26fd and project c55700f621564ad5a52056d7a7854e20. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:33.674695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Going to run 2 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:33.677821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:33.704772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:33.727777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-536ed0b9-af25-42ef-85da-a799861d0632 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1320 microversion: 2.1 time: 0.215843 Sep 03 20:52:33.730140 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 501/992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:33 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:33.739954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:33.741132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:33.746940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=8ae50f5c-7ce0-4762-bab3-74765ba13d23,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:33.750847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.751575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.752222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.754018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.754634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.755519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.763115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:33.870909 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f61cf7e-f4e1-4807-8ced-6ecfd5f9bbc2 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218440 Sep 03 20:52:33.873616 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 492/993] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:52:33.884293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:33.885204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:33.908881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.910782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.911851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.913325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:33.914640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:33.920199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:33.964856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:34.049237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:34.176886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.195305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.196847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.198120 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b449dbe2-7bb3-45c0-8bdd-ecdee2b79b1d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1331 microversion: 2.25 time: 0.323251 Sep 03 20:52:34.198683 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 493/994] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:33 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1331 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:34.216548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:34.222192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.222981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Searching by: {'deleted': False, 'project_id': 'c55700f621564ad5a52056d7a7854e20'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:52:34.272571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.273903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.285898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.286911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.287420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.290806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.363776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.380981 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e4be1665-f11e-4242-93be-6b947a8c1650 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.649064 Sep 03 20:52:34.383009 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 502/995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:33 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:34.406397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:34.408087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:34.434334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.435719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.436507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.437674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.438464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.439126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.536751 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cfee3104-138c-47f2-8b67-5f2a6ad7fc80 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.336604 Sep 03 20:52:34.538092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 494/996] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:52:34 2022] GET /compute/v2.1/servers => generated 677 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:34.543854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:34.544654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:34.552057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.552809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.553500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.554480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:34.555205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:34.557056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:34.722099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.750649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.757960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:34.777613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13805f36-e1ed-4b2a-b116-61a277558eec tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.393042 Sep 03 20:52:34.781523 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 503/997] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:34 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:34.797816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f216c771-a1ed-4e5c-9007-892164054f9d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:34.798436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f216c771-a1ed-4e5c-9007-892164054f9d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.202106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f216c771-a1ed-4e5c-9007-892164054f9d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.215178 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f216c771-a1ed-4e5c-9007-892164054f9d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1220 microversion: 2.1 time: 0.432248 Sep 03 20:52:35.225310 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 504/998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:34 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1220 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:35.237008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:35.238021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.244022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.244847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.245009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.245695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.246334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.246927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.351215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.370527 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19eb2587-4b34-4332-a1bc-cb5ab1d938e8 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1320 microversion: 2.1 time: 0.142591 Sep 03 20:52:35.371384 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 505/999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:35 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1320 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:35.376772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:35.382854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.395693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.396482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.397126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.398137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.399111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.400243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.423364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.435902 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3578f47e-fed4-4a60-9668-3dd1c7a6a276 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1489 microversion: 2.1 time: 0.896526 Sep 03 20:52:35.455892 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 495/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:34 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1489 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:35.463935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:35.465571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.486221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.486919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.488078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.491964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.492452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.493162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.634193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.648627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.657104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:35.659521 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc87b22c-d007-4b33-adb5-c87514f1fafb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1319 microversion: 2.25 time: 0.286798 Sep 03 20:52:35.661227 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 506/1001] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:35 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:35.668497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:35.670455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.685438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.686087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.690539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.691873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.692471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.693058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.826389 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef15acb5-c74f-4d75-8eb5-2d1dd34e8e10 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d/action" status: 202 len: 0 microversion: 2.1 time: 0.163257 Sep 03 20:52:35.827663 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 507/1002] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:52:35 2022] POST /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:52:35.857977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:35.859006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:35.868676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.869437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.870227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:35.872140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:35.873078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:35.873698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.003230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.016955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.018243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.021321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.028785 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca14cd6c-e45d-4f59-b71e-db7f90a04f4a tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.198773 Sep 03 20:52:36.033626 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 508/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:35 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:36.048108 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f1fff9e7-1294-461a-b5fb-cc3bb3f84d8e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.599013 Sep 03 20:52:36.048662 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 496/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:35 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:36.052331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:36.053186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:36.073191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.073697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.074140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.074952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.075413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.075933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.242559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:36.244002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:36.250035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.250534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.250973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.251684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.252141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.252746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.389562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.401611 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2408ce6-bc77-4cdb-980a-4a642de90f52 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1272 microversion: 2.1 time: 0.162102 Sep 03 20:52:36.403949 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 497/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:36 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:36.418665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:36.419615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:36.432131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:36.438315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.440220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.442496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.443514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.443989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.444422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.815691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.840404 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ac0f937-f8d0-49e9-9efe-07523fdd0df2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1494 microversion: 2.1 time: 0.805465 Sep 03 20:52:36.841729 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 509/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:36 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1494 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:36.849154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:36.850229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:36.859753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.860686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.862246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.863710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:36.865655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:36.866263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:36.898118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:36.925659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f9e556fe-af5f-43a0-b83a-a9b1d46fc212 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 0.517833 Sep 03 20:52:36.926257 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 498/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:36 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:37.065588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:37.066204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:37.088074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.089101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.090114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:37.091028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.091702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.092532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:37.222531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:37.250109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:37.251585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:37.263183 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6366495-373d-478b-8662-dced181c2f0d tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.203126 Sep 03 20:52:37.293708 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 499/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:37 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:37.298812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:37.302416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:37.309368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.309933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.310456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:37.311249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.312775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.313229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:37.861512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:37.894305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49719e22-6513-4d32-8d34-2b3a2cce155c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1477 microversion: 2.1 time: 0.592314 Sep 03 20:52:37.897709 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 500/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:37 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1477 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:37.920097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:37.920748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:37.943231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.948291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.948778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:37.949559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:37.952260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:37.954811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.141437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:38.152926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:38.157950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5560f5f4-fc31-4e9b-b4d0-75be70945261 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1278 microversion: 2.1 time: 0.258251 Sep 03 20:52:38.176745 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 501/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:37 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:38.186301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c", "tag": "6fb307ff-e272-4c6b-a010-76e4ba966dde"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:38.207108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.208191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.209622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.235481 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] Creating event network-changed:6fb307ff-e272-4c6b-a010-76e4ba966dde for instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c on nch2-master-1 Sep 03 20:52:38.243309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d263043f-f690-445c-873f-3cfd06eee4ce req-96ec09a2-62fd-490a-be93-b6a5e129ad34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064108 Sep 03 20:52:38.245982 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 502/1011] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:38.265953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "name": "network-vif-unplugged", "status": "completed", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:38.289703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.290238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.290853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.312048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Creating event network-vif-unplugged:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch2-master-1 Sep 03 20:52:38.330709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:52:38.355063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5a8bd88d-7a96-4e3e-ae22-21d2a577d05b req-bd620f26-47eb-46f8-8ef2-bd08d7b79365 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105537 Sep 03 20:52:38.359207 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 503/1012] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:38.367986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:38.372365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:38.383807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.395431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.398265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.399376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.402572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.403182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.428858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:38.439445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:38.447181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:38.448395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cbe73767-066a-4f4f-9588-7e492649e068 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 1.604835 Sep 03 20:52:38.456201 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 510/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:36 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:38.468839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:38.469514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:38.488571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.489133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.489606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:38.490399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:38.492547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:38.493051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.092710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.107868 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-464e5a39-1776-42be-af21-2b0dfc8c74a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 200 len: 1474 microversion: 2.1 time: 0.744067 Sep 03 20:52:39.108463 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 504/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:38 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 1474 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:39.120573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:39.121594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:39.135062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.137562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.138160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.144329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.144329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.144329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.291986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.304253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.307849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.317503 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e7d4e92a-07b2-45f6-9025-9f0db44e4834 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1546 microversion: 2.91 time: 0.204562 Sep 03 20:52:39.321172 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 505/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:39 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:39.326673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:39.328351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:39.345916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.346921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.348714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.351082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.351800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.354725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.854247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.863995 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48b60343-05e4-4234-8d00-8f93d250fffc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1476 microversion: 2.1 time: 0.540964 Sep 03 20:52:39.865904 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 506/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:39 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1476 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:39.919930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:39.940686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3db4c93-be9b-43ec-9ec0-141137efed5f tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 1.474682 Sep 03 20:52:39.941577 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 511/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:38 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:39.955912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1437818454"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:39.959431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:39.976656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.977505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.978190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:39.979137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:39.981488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:39.982205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:40.269023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-567915553", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:40.326305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c1e4eb6-1112-4c32-a9a3-1cd4e91ae412 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d/action" status: 202 len: 0 microversion: 2.1 time: 0.380004 Sep 03 20:52:40.329697 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 512/1018] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:52:39 2022] POST /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:52:40.344408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:40.345518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:40.362856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:40.363416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:40.364058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:40.364325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:52:40.374083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:40.374700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:40.375159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:40.592023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:40.602037 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88c31cfa-4a2c-4ad8-a639-5e61a4c4738d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1278 microversion: 2.1 time: 0.270843 Sep 03 20:52:40.612025 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 513/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:40 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:40.638314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:40.639317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:40.656388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:40.657299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:40.658101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:40.660249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:40.662982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:40.663764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.123034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.142506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.155286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.157015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef990db1-a78c-408f-9aa0-4882b15d01bf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.543454 Sep 03 20:52:41.161601 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 514/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:40 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:41.182035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b96611-6298-451a-9356-63a43f50dbbf", "name": "network-vif-deleted", "tag": "6ed400e9-e401-4d6c-a318-0f30376c7981"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:41.230939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.239781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.241502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.271231 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] Creating event network-vif-deleted:6ed400e9-e401-4d6c-a318-0f30376c7981 for instance 80b96611-6298-451a-9356-63a43f50dbbf on nch1-master-1 Sep 03 20:52:41.282528 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-197357fc-3884-4909-b548-95afbd3e505b req-b260ecd0-ea25-496a-8781-6d877f357126 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119284 Sep 03 20:52:41.283436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 515/1021] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:41.288716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b75cdbb-d288-497f-a0ad-7b8a2d0ef077 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b948430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:41.389169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b75cdbb-d288-497f-a0ad-7b8a2d0ef077 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.104428 Sep 03 20:52:41.397316 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 516/1022] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:41 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:41.401261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:41.430781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.430962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.431441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.456308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Creating event network-changed:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch2-master-1 Sep 03 20:52:41.478435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:52:41.511845 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2407ae76-016d-41e9-b1e4-38ea874601ba req-97baf6d1-f039-4a35-906e-b180254a4b71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120286 Sep 03 20:52:41.513460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 517/1023] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:41.523186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:41.523946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:41.532439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.533000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.533455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.534295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.534943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.535385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.654969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:52:41.656034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:52:41.656715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:52:41.657348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:52:41.657950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:52:41.679436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.679688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.680152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.681151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.686083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.686773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.739273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Getting quotas for project 44e122acac834fc2843f725beb5daeff. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:41.745550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Getting quotas for user ddb7b29dc8464329abda9836b09b907f and project 44e122acac834fc2843f725beb5daeff. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:41.760586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:52:41.763227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:52:41.833210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5670dfdf-6e4d-4692-9c7a-3d5a99a7fe40 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964672 Sep 03 20:52:41.836222 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 507/1024] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:52:41.840490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.846531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:41.847739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:41.855476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.856382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.857204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.857853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.858725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:41.859133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.859964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.860766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.867153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e2a76fb-88c5-4eae-9f49-096503f1c992 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1533 microversion: 2.91 time: 0.351481 Sep 03 20:52:41.868069 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 518/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:41 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1533 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:41.873261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:41.873890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:41.880071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.880572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.881119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.881840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:41.882300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:41.882736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:41.906277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:42.247082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:42.257264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d5970b4-3b1d-48a9-81bd-ed5210eba875 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1476 microversion: 2.1 time: 0.419462 Sep 03 20:52:42.269163 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 508/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:41 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:42.277636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:42.278238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:42.288299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.288819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.294374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.295724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.296079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.296523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.589213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:42.598738 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d064f359-3fc0-42f7-8355-4f5f295a7967 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.331807 Sep 03 20:52:42.599911 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 509/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:42 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:42.617749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:42.620317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:42.631849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.633131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.633862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.637156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.637844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.638486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.741339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:42.752522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-be664808-95c5-4a4b-be13-2aac3b39af43 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1212 microversion: 2.1 time: 0.151250 Sep 03 20:52:42.754220 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 510/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:42 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:42.759812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:42.760491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:42.768311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.769847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.771147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.772766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.773964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.774828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.901768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] Lazy-loading 'services' on Instance uuid f820a3e3-137a-43e9-8150-9c76d045c844 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:42.903518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:42.914077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-750b2e87-d091-4229-b20d-55e87b2c566e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 1.044371 Sep 03 20:52:42.917598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 519/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:41 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:42.928505 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94da5c58-1646-4697-bfa5-807f1506a4ad tempest-UnshelveToHostMultiNodesTest-628609545 tempest-UnshelveToHostMultiNodesTest-628609545-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1938 microversion: 2.91 time: 0.172360 Sep 03 20:52:42.929731 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 511/1030] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:42 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1938 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:42.931122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:42.931743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:42.935205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21eb8912-1601-4795-9f9c-90b6ad30f0f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6706f820>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:42.945623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.946152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.946639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:42.947382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:42.948008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:42.948438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.009907 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21eb8912-1601-4795-9f9c-90b6ad30f0f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.078722 Sep 03 20:52:43.010815 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 512/1031] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:42 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:43.020556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.023526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.038203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.038903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.039781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.041324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.041791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.042220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.070042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:52:43.156950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-52e16ee4-1a8b-493b-a057-11be0f469bcd tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 204 len: 0 microversion: 2.91 time: 0.144419 Sep 03 20:52:43.158143 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 513/1032] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:52:43 2022] DELETE /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:52:43.176048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.177245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.187437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.188263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.189032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.190208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.190969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.191701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.295029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.303869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.305720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.311767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41ebd7cb-dba3-422e-a881-b7ad782ac0f9 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.147289 Sep 03 20:52:43.312379 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 514/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:43 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:43.321057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.321057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.326136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.326136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.326817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.327644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.328198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.328634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.548073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.561562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dc1770f-b3ed-4a43-86f0-ede192199406 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1474 microversion: 2.1 time: 0.247740 Sep 03 20:52:43.573656 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 515/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:43 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1474 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:43.584757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf9f6a0-a5cb-4458-8402-6600ef7605fe", "tag": "f6c9c6fa-589a-463a-afdd-a5bbccade4e9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:43.595489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.595974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.596408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.608467 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] Creating event network-changed:f6c9c6fa-589a-463a-afdd-a5bbccade4e9 for instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe on nch1-master-1 Sep 03 20:52:43.614013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-309c2e84-243b-4bff-bc59-ea96987d8a8a req-65e9b06f-ecfe-4833-939e-2cb713d8239e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038752 Sep 03 20:52:43.615154 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 516/1035] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:43.626053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.626946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.633672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.634875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.635320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.636023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.636481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.636933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.783841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.784013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.794333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a251b97-557a-4889-9ffa-309d9941bdec tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.173204 Sep 03 20:52:43.794592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.796220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.797665 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13e96dad-199b-45d8-b42a-1a5ff91c9dc4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.879086 Sep 03 20:52:43.798673 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 520/1036] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:42 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:43.803641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.804525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.811586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.812308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.813009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.813932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.814606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.815904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.817570 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:43 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:43.906848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:43.915123 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb8be25b-8880-47cd-bc2e-c76706f94248 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1268 microversion: 2.1 time: 0.115211 Sep 03 20:52:43.915718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 521/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:43 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1268 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:43.949278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:43.949916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:43.956650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.957182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.957697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:43.958544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:43.959011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:43.959598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.026717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-117737d4-0b0c-4222-9758-cb8764d78a3a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae67019ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:44.099604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-117737d4-0b0c-4222-9758-cb8764d78a3a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.078036 Sep 03 20:52:44.100942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 522/1039] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:44 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:44.111591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:44.120371 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e97b3bc2-aa38-46da-a593-30438cb67121 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 0.176529 Sep 03 20:52:44.121239 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 518/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:43 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:44.340582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:44.341215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:44.347521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.347987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.348421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.349155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.349611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.350038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.432278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:44.443693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:44.445196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:44.450646 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d5db563-11e5-49c6-a1f6-74f18963d946 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.114650 Sep 03 20:52:44.451383 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 523/1041] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:44 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:44.591149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:44.591742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:44.598190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.599283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.599960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.600871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.601514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.601945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.737390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:44.741250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:44.746907 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-570013b6-d315-4c70-8b57-505480bfac1d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1474 microversion: 2.1 time: 0.160252 Sep 03 20:52:44.747522 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 519/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:44 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:44.823917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:44.824955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:44.831083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.831890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.832553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.833631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.834344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.834810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.835848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:44.836469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:44.854621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.855122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.855562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:44.856274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:44.856728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:44.857175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.105733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.116130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.139760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.141061 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-03a7dd31-303e-4814-b8fe-be4b61c9c1d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.321856 Sep 03 20:52:45.144172 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 520/1043] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:44 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:45.155725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:45.157551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:45.172082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.172880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.174519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.175845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.177686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.178789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.206113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:45.367284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.374102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.380929 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-170ccc3a-d166-4833-9716-c1832ece2f2b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.561639 Sep 03 20:52:45.382086 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 524/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:44 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:45.383544 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ca3120e-3696-4b1a-9efa-a3e9587d751d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1276 microversion: 2.1 time: 0.237922 Sep 03 20:52:45.389658 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 521/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:45 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:45.396913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:45.397693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-16c30c46-5548-478e-aa72-7b392997cff2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae670034c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:45.398417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:45.418285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.418788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.421402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.422260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.422634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.423092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.505510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-16c30c46-5548-478e-aa72-7b392997cff2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.119000 Sep 03 20:52:45.512687 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 525/1046] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:45 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:45.522759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c", "name": "network-vif-plugged", "status": "completed", "tag": "6fb307ff-e272-4c6b-a010-76e4ba966dde"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:45.558014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.558869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.559408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.575008 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] Creating event network-vif-plugged:6fb307ff-e272-4c6b-a010-76e4ba966dde for instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c on nch2-master-1 Sep 03 20:52:45.583136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8edd7177-0953-4e5f-a0e0-8d7b97cf2e24 req-aaeea14b-8bea-4783-9565-8a79182fd2e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068166 Sep 03 20:52:45.584117 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 526/1047] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:45.612292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:45.614761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:45.635946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.643042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.643648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.646072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.646667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.650938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.847452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.859556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.862144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.871516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-27f479d7-2b4d-4aa8-affa-f8f7d10f5f71 tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.285571 Sep 03 20:52:45.873595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 527/1048] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:45 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:45.885785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4246896c-887f-4a47-8b4c-0f2239038887", "tag": "25c3d175-79c2-4191-a727-f30618f9033e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:45.904343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.906239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.907644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.924038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] Creating event network-changed:25c3d175-79c2-4191-a727-f30618f9033e for instance 4246896c-887f-4a47-8b4c-0f2239038887 on nch2-master-1 Sep 03 20:52:45.931579 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a2bc62c0-0e35-4ad6-a4ba-5daede721921 req-4a6961f7-da5c-40db-8ebe-6d4872c66c02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055404 Sep 03 20:52:45.932478 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 528/1049] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:45.940067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:45.940637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:45.949492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.950001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.950499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.951638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:45.952059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:45.952520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:45.953700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:45.969651 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9cea6d7e-ae68-46b1-960a-0ec90c19d49b tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 0.570565 Sep 03 20:52:45.970403 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 522/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:45 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.176664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.177665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.192612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.195257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.195932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.198058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.199848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.200592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.233198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.261850 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75d9930d-4566-4b60-a8ab-6a74d5487951 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.314208 Sep 03 20:52:46.263527 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 529/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:45 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.290514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:46.294443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.307153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.307654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.308100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.308816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.313848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.314925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.414823 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ee1aabe-b9e2-4592-8e7d-ea41603b5022 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd/action" status: 204 len: 0 microversion: 2.1 time: 0.132274 Sep 03 20:52:46.415687 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 530/1052] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:52:46 2022] POST /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd/action => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:52:46.426024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.426473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.434694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.435465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.435676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.436352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.436813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.437289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.484075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.492677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.494390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.499944 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd407992-edd4-4c19-a0da-bb3f71b43807 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.326964 Sep 03 20:52:46.501101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 523/1053] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:46.506098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.506955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.514676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.515369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.516030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.516797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.517729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.518325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.662115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.681463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8eaf43c-2d43-4179-a5b5-fe0487c2a6ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.260764 Sep 03 20:52:46.682553 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 531/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.688735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.689812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.696089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.697621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.699040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.699591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.700370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.700816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.752326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.769947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a96a15b-6c9b-4722-aca3-b1c07db62d6b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.267355 Sep 03 20:52:46.785259 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 524/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.790642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b842629-00f6-47a2-b7de-bd13ba6f926d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66eba430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.863726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:46.877151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8564004d-5dac-4643-b651-dcb0544ccc7c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1274 microversion: 2.1 time: 0.193183 Sep 03 20:52:46.878331 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 532/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.905398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.906478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:46.909197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:46.925563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.926330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.927004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.927994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:46.928800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:46.929321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b842629-00f6-47a2-b7de-bd13ba6f926d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.157299 Sep 03 20:52:46.930035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:46.930280 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 525/1057] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:46.996729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:46.998094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:47.010189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.014452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.018135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:47.027724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.028428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.029195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:47.104060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:47.118933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:47.129116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb51295631fd43fd8323ea06097a632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a72b0776bdcd4644afed4d9cbc966e4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:47.141512 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8ba49dd-0344-4950-91c6-6f97ab864e0c tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 200 len: 1539 microversion: 2.91 time: 0.240285 Sep 03 20:52:47.157511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 533/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:52:47.299910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:47.312224 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-976628e4-eb1a-4675-8762-b1f0b761f980 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1387 microversion: 2.1 time: 0.320330 Sep 03 20:52:47.313397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 526/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:46 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1387 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:47.529733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:47.530279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:47.542213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.546641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.547134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:47.547938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.548451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.548924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:47.706162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:47.706917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:47.720990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.721501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.722083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:47.723073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:47.723531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:47.726975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.013026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.022863 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-532cff06-e341-444e-81e0-f4848da547dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.321059 Sep 03 20:52:48.028987 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 527/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:47 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:48.043547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:48.044512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:48.054201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.055339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.060341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.061345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.061978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.062592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.362609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.381692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8990a237-0b18-414d-8685-095730058c94 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.348964 Sep 03 20:52:48.382612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 528/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:48 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:48.393712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:48.396242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:48.411976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.415412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.417878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.418861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.422165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.422803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.536650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.559423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.563502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.564975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f9ed2b3-06aa-44f8-b118-6281420f9461 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 1.039514 Sep 03 20:52:48.566215 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 534/1062] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:47 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:48.575503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-539d1a45-20e7-490a-9f5a-04276390d119 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae67034790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:48.675029 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-539d1a45-20e7-490a-9f5a-04276390d119 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.105886 Sep 03 20:52:48.677081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 535/1063] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:48 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:48.685745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae50f5c-7ce0-4762-bab3-74765ba13d23", "tag": "3451c701-24db-45fe-91e9-299002399c5a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:48.711005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.711490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.713223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.742153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] Creating event network-changed:3451c701-24db-45fe-91e9-299002399c5a for instance 8ae50f5c-7ce0-4762-bab3-74765ba13d23 on nch1-master-1 Sep 03 20:52:48.752665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:48.753076 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-acb0f5c2-1c7e-405a-b328-faa7244a52c4 req-60ddfd2f-7c48-4519-baeb-d9693806c81f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072720 Sep 03 20:52:48.754332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 536/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:48.769772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd89dac-67e7-4386-8d33-0ca58ab9c14d", "name": "network-vif-plugged", "status": "completed", "tag": "a8da193f-e198-4120-be6f-383cbe65b606"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:48.771884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-61c75e17-5273-4a4e-a0b9-eb3b6c10d678 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.379931 Sep 03 20:52:48.785185 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 529/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:48 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:48.785790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:48.786427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] [instance: f820a3e3-137a-43e9-8150-9c76d045c844] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:48.794697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.797177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.799193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.816399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.820739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.821928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.822842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.825466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] Creating event network-vif-plugged:a8da193f-e198-4120-be6f-383cbe65b606 for instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d on nch2-master-1 Sep 03 20:52:48.826854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.828077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.836332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6fdebb1c-2558-4941-b33a-db34d1b8c8ac req-447e6114-5b46-44dc-b254-bcb17ee31be4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078478 Sep 03 20:52:48.841382 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 537/1066] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:48.854221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:48.858296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:48.867706 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] HTTP exception thrown: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Request method failure captured: Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 HTTP/1.1 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73myA2WXIJWqVVSz_ng9yOvHqKgndWuAhnU6UQ0LlmB2jV4jVgLKNpveFvRRu75HOR8L9jjxmIxkIBVfUd0h8Lsn0u7jDyOHGl5m6zIp4h_jmOb98Lw0frzGvoox05IdSjk7pnjF1ZPGc6WkDTIC4ClnLKsERUptZbn4fuBf04Pf1M Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.91 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a72b0776bdcd4644afed4d9cbc966e4e Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1413122434 Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:52:48.870684 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a72b0776bdcd4644afed4d9cbc966e4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a72b0776bdcd4644afed4d9cbc966e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a72b0776bdcd4644afed4d9cbc966e4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a72b0776bdcd4644afed4d9cbc966e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1413122434 Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a72b0776bdcd4644afed4d9cbc966e4e Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1413122434 Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-UnshelveToHostMultiNodesTest-1413122434-project Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: cb51295631fd43fd8323ea06097a632e Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1413122434-project Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. Sep 03 20:52:48.872430 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'f820a3e3-137a-43e9-8150-9c76d045c844'} Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:52:48.873437 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. Sep 03 20:52:48.874950 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:52:48.877637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.878134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.878577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.879103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] Returning 404 to user: Instance f820a3e3-137a-43e9-8150-9c76d045c844 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:52:48.879291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:48.879744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:48.880504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:48.883748 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0901a36-6219-460a-a8fe-467341da7dcf tempest-UnshelveToHostMultiNodesTest-1413122434 tempest-UnshelveToHostMultiNodesTest-1413122434-project] 10.222.0.16 "GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844" status: 404 len: 111 microversion: 2.91 time: 0.108385 Sep 03 20:52:48.884680 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 530/1067] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:48 2022] GET /compute/v2.1/servers/f820a3e3-137a-43e9-8150-9c76d045c844 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:52:49.053864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:49.055629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:49.068526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.082204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.085905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.091302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.108417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.108927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.388135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:49.400398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d13f305-ab85-4536-abfd-4642a3c545cc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.351480 Sep 03 20:52:49.413818 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 531/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:49 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:49.427533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:49.442989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.444195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.444838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.458570 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] Creating event network-changed:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:52:49.467817 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ceba1235-adf9-415f-b3d0-4e81e01928de req-4ca3da10-0b24-4cf1-be8a-ace170afb780 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050630 Sep 03 20:52:49.469092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 532/1069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:49.474820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:49.476779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:49.485234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.485966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.486650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.487636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.488345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.489093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.748100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:49.758443 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1440c0cd-c8dd-4fd3-a96f-13da7d176585 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.287647 Sep 03 20:52:49.759894 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 533/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:49 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:49.765042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:49.765602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:49.772015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.772517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.772989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:49.773712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:49.775117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:49.775564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.102130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.110925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3cb13154-461d-48b4-8e56-ceaaeafd5287 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1586 microversion: 2.1 time: 1.268238 Sep 03 20:52:50.125488 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 538/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:48 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1586 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:50.146004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe08bdc8-b5df-498a-817b-13d931f3477e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b9480d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:50.164222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.198577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.204948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.210079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83f530c8-3c5f-4eed-a7ba-71f6ea850d4a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.449141 Sep 03 20:52:50.212806 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 534/1072] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:49 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:50.225686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:50.226507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:50.238002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.238254 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe08bdc8-b5df-498a-817b-13d931f3477e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.110817 Sep 03 20:52:50.238487 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 539/1073] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:50 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:50.245688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.246523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.247782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.249336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.250045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.254243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:50.254974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:50.265830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.266590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.267606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.269220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.269875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.270475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.469575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-088d8741-9c39-4ffd-a4c3-4bba22461d14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220448 Sep 03 20:52:50.470972 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 540/1074] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:52:50 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:50.480789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:50.490681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:50.506825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.513596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.514460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.516203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.538694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.541267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.838944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.857918 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f52d4551-ed55-4cc8-8af6-afb889b194e7 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.643430 Sep 03 20:52:50.862554 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 535/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:50 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:50.870564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:50.872547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:50.873288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:50.877722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:50.879364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:50.881647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.882149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.882865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.884759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.885359 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40cc56f3-c5ef-4114-aa11-437f05e76b48 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.410658 Sep 03 20:52:50.886100 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 541/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:50 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:50.886702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.887292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:50.921224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf9f6a0-a5cb-4458-8402-6600ef7605fe", "name": "network-vif-plugged", "status": "completed", "tag": "f6c9c6fa-589a-463a-afdd-a5bbccade4e9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:50.963702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:50.966252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:50.968024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:51.013539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] Creating event network-vif-plugged:f6c9c6fa-589a-463a-afdd-a5bbccade4e9 for instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe on nch1-master-1 Sep 03 20:52:51.052435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-61c5976d-32dc-400a-859c-a6090f884451 req-f34dd65b-4c9a-4469-b084-1c0fb31fe1ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151962 Sep 03 20:52:51.053084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 542/1077] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:51.144929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:51.169576 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53eb135b-2261-403a-aa4e-6c0ee9fde73b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.305532 Sep 03 20:52:51.171909 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:50 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:51.245125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:51.246764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:51.256501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-177a706c-43e5-4831-afd7-5939bb40c0fe tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66eba1f0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:51.292782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:51.293554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:51.297145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:51.298105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:51.303615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:51.305025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:51.348297 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-177a706c-43e5-4831-afd7-5939bb40c0fe tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.096659 Sep 03 20:52:51.350214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 537/1079] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:51 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:51.887496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:51.888281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=24 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:51.892771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:51.893630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:51.908078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:51.909254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:51.912044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:51.913012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:51.914427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:51.915071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:51.982588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.006755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.017611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.018786 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca4711c7-bd20-4dc4-bd55-86e32a878672 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.780556 Sep 03 20:52:52.020164 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 543/1080] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:51 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:52.025800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:52.026593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:52.042499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.043373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.044042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:52.045010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.045726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.046396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:52.155296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.165101 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-50c4bcc3-41a2-4fa9-8289-559a909d61c0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.278590 Sep 03 20:52:52.185779 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 538/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:51 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:52.199478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:52.201121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:52.207643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.208135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.208573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:52.209627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.210401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.211111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:52.420421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.454733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:52.466446 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa1411f3-a349-4caa-9e9d-ab291722ce93 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.272263 Sep 03 20:52:52.467899 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 539/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:52 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:52.496256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64aaea27-f685-477c-bc41-f8bcf64b5e0f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66f11670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:52.515170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:52.535808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91392d65-830d-4863-9893-711835521bdd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.514280 Sep 03 20:52:52.541867 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 544/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:52 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:52.568344 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64aaea27-f685-477c-bc41-f8bcf64b5e0f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.099012 Sep 03 20:52:52.569627 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 540/1084] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:52 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:52.974393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:52.975235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:52.984859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.989536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.990169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:52.991100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:52.991833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:52.994775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.010394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c", "tag": "6fb307ff-e272-4c6b-a010-76e4ba966dde"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:53.027379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.031943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.032659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.084048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] Creating event network-changed:6fb307ff-e272-4c6b-a010-76e4ba966dde for instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c on nch2-master-1 Sep 03 20:52:53.101895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ec0d98e9-8005-4808-9e4b-104d9fb5bd8b req-f9c76182-07d0-4791-9c2b-e216ded75d6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094700 Sep 03 20:52:53.106181 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 541/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:52:53.180378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:53.181840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:53.199325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.202203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.202921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.203914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.205435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.206304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.356361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:53.382170 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea47c4f1-4f2c-44ba-b8cd-9f6520b84a97 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1586 microversion: 2.1 time: 0.411492 Sep 03 20:52:53.383807 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 545/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:52 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1586 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:53.389287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:53.395016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:53.405248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.413219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.413713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.414488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.416464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.416932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.518378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:53.529481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:53.530901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:53.532022 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8daa3f05-53ee-4024-b00a-cfa5756c2f7b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.421525 Sep 03 20:52:53.532776 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 542/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:53 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:53.559505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4246896c-887f-4a47-8b4c-0f2239038887", "name": "network-vif-plugged", "status": "completed", "tag": "25c3d175-79c2-4191-a727-f30618f9033e"}, {"server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "name": "network-vif-plugged", "status": "completed", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:53.583470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.583967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.584398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.618607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Creating event network-vif-plugged:25c3d175-79c2-4191-a727-f30618f9033e for instance 4246896c-887f-4a47-8b4c-0f2239038887 on nch2-master-1 Sep 03 20:52:53.620844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Creating event network-vif-plugged:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch2-master-1 Sep 03 20:52:53.635078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:52:53.678348 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b8bd96c9-e761-464f-82e1-b80d55095552 req-18936f3e-5831-4a45-82ee-2ee497aa027f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144527 Sep 03 20:52:53.679253 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 543/1088] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:53.707025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:53.707937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:53.715617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.716464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.717156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.719055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:53.719815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:53.720412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:53.951261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:53.962317 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e11cf8eb-45be-47a6-820b-2c9e287e4be4 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.574825 Sep 03 20:52:53.969823 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 546/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:53 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:53.986025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:53.987033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:53.994593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:54.000269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:54.000269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:54.001269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:54.004301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:54.005084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:54.022353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:54.056996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08d5912a-6bd0-435b-8dfb-a0221d30b9cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.361987 Sep 03 20:52:54.057661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 544/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:53 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:54.066340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a56c179a-1ae8-4b2e-979e-e2a6ab597380 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66ee8b80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:54.142830 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a56c179a-1ae8-4b2e-979e-e2a6ab597380 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.084056 Sep 03 20:52:54.143993 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 545/1091] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:54 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:54.315828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:54.326287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19a2ffc6-e384-46fd-a2b6-d4c5061ddc5a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.354979 Sep 03 20:52:54.346421 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 547/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:53 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:54.560585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:54.561878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:54.599763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:54.601365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:54.604426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:54.607324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:54.609541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:54.610001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:54.995642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.001644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.002995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:55.021818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.025373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.028332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.028801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.031758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.032798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.033023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48743a31-e659-4bfb-8626-729dd9331745 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1361 microversion: 2.25 time: 0.477997 Sep 03 20:52:55.033483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.033932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.065702 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 546/1093] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:54 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1361 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:52:55.090446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.099770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:55.121797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.122672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.123624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.124570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.125452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.126454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.317311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.335047 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-169ea04e-bf08-4601-80bc-08ab0e0fc3d6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.344332 Sep 03 20:52:55.335647 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 548/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:54 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:55.340918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99f11cf7-e74f-4cd3-9b55-89f87e75b9c6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b972f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.454366 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99f11cf7-e74f-4cd3-9b55-89f87e75b9c6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.116956 Sep 03 20:52:55.457659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 549/1095] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:55.482490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.489603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:55.519404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.519812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.520253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.520992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.521446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.538729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.566235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.583847 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-96f4cea1-37dc-4c0e-a101-9c9fb7f0c23c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1320 microversion: 2.1 time: 0.501598 Sep 03 20:52:55.584447 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 547/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:55.807370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.811869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.812778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.813350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.814328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.814888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.815456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.846875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-97bef85e-76f7-430b-a86d-fbef7d171917 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.260832 Sep 03 20:52:55.856659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 548/1097] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/os-services => generated 947 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:55.862303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.867700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.868678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.869418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.870922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.871611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.872262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.888395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:55.898455 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70440427-a280-4e8f-9106-12e28f8c9bcd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1471 microversion: 2.1 time: 0.439045 Sep 03 20:52:55.899043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 550/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1471 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:55.902075 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd9495ed-d498-48a2-a02b-40e82c93fabe tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.043183 Sep 03 20:52:55.910520 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 549/1099] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:55.916333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.920280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.921041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.921686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.922660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.923325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.923963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.951470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b5bdb7c8-a708-40f8-bccc-ac61305bc987 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039260 Sep 03 20:52:55.959513 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 551/1100] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:52:55.965335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:55.971221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.971942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.972611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:55.973688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:55.974399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:55.975238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.000968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a027f994-75b8-46c1-a071-9c12cbb9ca15 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039791 Sep 03 20:52:56.001924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 550/1101] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Sep 3 20:52:55 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:52:56.014616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.018148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.021136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.021675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.022489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.023645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.024454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.056468 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-409de7e9-5661-40ef-93db-459f57dadc20 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.045272 Sep 03 20:52:56.065767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 552/1102] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:56.069313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.070062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:56.084116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.084860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.086493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.087104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.087940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.090702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.093163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.099074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.103840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.107071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.108172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.111236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.111883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.195740 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ae92802-4408-479c-9cd6-54e722b49d45 tempest-ServicesAdminNegativeTestJSON-520657946 tempest-ServicesAdminNegativeTestJSON-520657946-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.115825 Sep 03 20:52:56.200952 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 553/1103] 10.222.0.16 () {58 vars in 1198 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:52:56.336688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:56.353507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:56.357146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:56.362094 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbdc8472-07b4-49f3-8d31-42b4529d1607 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1557 microversion: 2.25 time: 0.295616 Sep 03 20:52:56.363129 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 551/1104] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1557 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:56.369214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.376159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:56.391713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.392532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.397080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.398064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.398635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.399350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.413577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c034a3df-406e-4e9b-b074-67d1edb0ad77 tempest-ServicesAdminNegativeTestJSON-313463755 tempest-ServicesAdminNegativeTestJSON-313463755-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.418364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c034a3df-406e-4e9b-b074-67d1edb0ad77 tempest-ServicesAdminNegativeTestJSON-313463755 tempest-ServicesAdminNegativeTestJSON-313463755-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2415e6e7c5d549e0b8a0a684e4dd58b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e0ecbfab5b4d5b8376c13a499d541b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c034a3df-406e-4e9b-b074-67d1edb0ad77 tempest-ServicesAdminNegativeTestJSON-313463755 tempest-ServicesAdminNegativeTestJSON-313463755-project] Request method failure captured: Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE76lurgXlnmJBm2bJhCVXkmoF-DvdzUzX7qQsY3QaBmfBQ9tlG-gm0FQnQ-cUzRToH-KYUojrYZtv9hd2Mh2S2SjsQacWWeYZsizqaHgOf4754PRZQADdIcy8BqBcJcq0a7EcJQeOu8nkuQ3AJhTCbpBzMPnf1ChUJWvLzp1Ytr6lrE Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 29e0ecbfab5b4d5b8376c13a499d541b Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-313463755 Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:52:56.420499 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29e0ecbfab5b4d5b8376c13a499d541b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29e0ecbfab5b4d5b8376c13a499d541b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29e0ecbfab5b4d5b8376c13a499d541b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29e0ecbfab5b4d5b8376c13a499d541b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-313463755 Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 29e0ecbfab5b4d5b8376c13a499d541b Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-313463755 Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServicesAdminNegativeTestJSON-313463755-project Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2415e6e7c5d549e0b8a0a684e4dd58b2 Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-313463755-project Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:52:56.422025 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 20:52:56.422935 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 03 20:52:56.424340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:52:56.426493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c034a3df-406e-4e9b-b074-67d1edb0ad77 tempest-ServicesAdminNegativeTestJSON-313463755 tempest-ServicesAdminNegativeTestJSON-313463755-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:52:56.427357 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c034a3df-406e-4e9b-b074-67d1edb0ad77 tempest-ServicesAdminNegativeTestJSON-313463755 tempest-ServicesAdminNegativeTestJSON-313463755-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.212709 Sep 03 20:52:56.429598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 554/1105] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:52:56.442691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.443642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:56.478711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.479620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.480246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.481015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.481480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.481917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.686311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:56.699286 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-758c6fd9-d90b-4bb6-bc87-d2188d496baf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.334444 Sep 03 20:52:56.700134 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 552/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:56.706215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c00d7141-dace-49d0-b3db-af5c9389c625 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66eea160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.745817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:56.776355 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72961455-0ae2-4da2-be79-a1ec0ebaac6f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 2049 microversion: 2.25 time: 0.334017 Sep 03 20:52:56.776355 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 555/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 2049 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:56.784759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.785908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:56.801493 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c00d7141-dace-49d0-b3db-af5c9389c625 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.099765 Sep 03 20:52:56.802845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.803389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.804004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.804721 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 553/1108] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:56.814078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.814842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.817102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.818843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:56.819912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:56.827851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.829153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.829894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:56.830808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:56.831578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:56.832177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.028305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:57.051026 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8081444a-0520-4710-a48f-24d58702f406 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 200 len: 1508 microversion: 2.1 time: 0.285282 Sep 03 20:52:57.072857 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 556/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:57.088852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:57.090961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:57.109085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.113347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.113872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:57.114229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.115079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.119526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.120292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.136500 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-976ba1d4-797f-41f3-b98e-0babcc032cbb tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 2049 microversion: 2.25 time: 0.329810 Sep 03 20:52:57.138387 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 554/1110] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:56 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 2049 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:57.144095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:57.145033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:57.153017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.153730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.157613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.159330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.159980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.160579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.448036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:57.466472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae1587da-1c8e-4ba7-8acd-4477ddb0aaac tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 200 len: 1320 microversion: 2.1 time: 0.326641 Sep 03 20:52:57.468048 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 555/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:57 2022] GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:57.477883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:57.498242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.498242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.498242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.498242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.498592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.498592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.535170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67bfdaee-694e-455e-8cc6-8a50d42daa77 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.065404 Sep 03 20:52:57.536021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 556/1112] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Sep 3 20:52:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:52:57.541159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-plugged", "status": "completed", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:57.551093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.551583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.552017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.574028 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] Creating event network-vif-plugged:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:52:57.582084 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3a1f6fa8-3da3-4be6-b46f-91c9ba457acd req-69df3db0-5e53-415e-bfbd-165156ca3a1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044747 Sep 03 20:52:57.583366 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 557/1113] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:57.590296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:57.591337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:57.602142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.603279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.603855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.604654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.605325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.605860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.722052 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2eaea0ea-13ae-47e6-be03-be366f31d914 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe/action" status: 202 len: 0 microversion: 2.25 time: 0.135978 Sep 03 20:52:57.729393 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 558/1114] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:52:57 2022] POST /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:52:57.738529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:57.741446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:57.749770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.751003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.751793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.752826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:57.753512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:57.754154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:57.973280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:57.987769 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bef183a7-6f2e-47ca-be86-5a1f9d8d66bc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1463 microversion: 2.1 time: 0.913578 Sep 03 20:52:58.014420 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 557/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:57 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1463 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:58.016022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:58.021110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:58.021946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:58.026894 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e7bc1e8-fd78-4a89-822d-2c740ca552cc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.294918 Sep 03 20:52:58.029338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.030351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.033099 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 559/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:57 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:58.037529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.039202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.043611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.050103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b52fee16-3e47-4a4b-869f-ce0e2e9afc83 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66ef9160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:58.050521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.142792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b52fee16-3e47-4a4b-869f-ce0e2e9afc83 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.110690 Sep 03 20:52:58.143387 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 560/1117] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:58 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:58.162480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:58.163348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:58.175013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.179557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.180081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.181450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.181916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.182349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.266891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:58.281138 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-099ba421-5a7a-4501-b8d6-da07d305a2d1 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 2054 microversion: 2.25 time: 0.264899 Sep 03 20:52:58.284958 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 558/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:58 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 2054 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:58.410091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:58.419328 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c07ebf55-93ca-43c8-a106-ae57b8bcc7d4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1463 microversion: 2.1 time: 0.274877 Sep 03 20:52:58.420260 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 561/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:58 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1463 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:58.448879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-439b6f5c-2690-4dd2-b106-f981a0921837 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'create', calling method: .version_select at 0x7fae6b93e4c0>, body: {"keypair": {"name": "tempest-keypair-1096013485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQOU3LIzv1HBagq/6dsBGcs53ecMTCfftDHpoeVshtjtjLMcSF5awDXRfbGK4Z67UBskX3NRhbu96RMpmlW4Y8h/5Vef3kQYenGdbxD744IgeClWDef4lGmOc/W4IesbQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:58.469043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-439b6f5c-2690-4dd2-b106-f981a0921837 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:52:58.475324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-439b6f5c-2690-4dd2-b106-f981a0921837 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:52:58.492247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:58.493848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:58.507991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.508778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.509432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.509937 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-439b6f5c-2690-4dd2-b106-f981a0921837 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066920 Sep 03 20:52:58.510462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:58.516630 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 559/1120] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:52:58.517984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:58.518430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:58.702657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:58.713535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b625207-a621-40c0-bd80-fb2ae25c25ce tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 200 len: 1320 microversion: 2.1 time: 0.225973 Sep 03 20:52:58.716691 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 562/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:58 2022] GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:59.055061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:59.056540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:59.067402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.070537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.072002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.072920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.074052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.074558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.159414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c9575b8-02cb-4744-899e-65b005da2b5e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6710f4c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:59.234998 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c9575b8-02cb-4744-899e-65b005da2b5e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.080260 Sep 03 20:52:59.235713 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 563/1122] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:52:59 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:52:59.303913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:52:59.309809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:59.310896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:59.320549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.323200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.325161 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8430153-f053-4f0a-81f6-310685359882 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1316 microversion: 2.1 time: 0.273751 Sep 03 20:52:59.325812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.326742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.327355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.329590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.342988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 560/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:59 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:52:59.365873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:59.591826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:59.627685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae50f5c-7ce0-4762-bab3-74765ba13d23", "name": "network-vif-plugged", "status": "completed", "tag": "3451c701-24db-45fe-91e9-299002399c5a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:59.628296 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a911d327-15c8-42c5-a2db-87a104849e5b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 2034 microversion: 2.25 time: 0.322628 Sep 03 20:52:59.631254 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 564/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:52:59 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 2034 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:52:59.655054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:52:59.659522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:59.662144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.664510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.665368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.668361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.669742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.670285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.671582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.672180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.672710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.703529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'flavor' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:52:59.707853 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] Creating event network-vif-plugged:3451c701-24db-45fe-91e9-299002399c5a for instance 8ae50f5c-7ce0-4762-bab3-74765ba13d23 on nch1-master-1 Sep 03 20:52:59.725419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Going to try to live migrate instance to nch2-master-1 {{(pid=140519) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:52:59.728479 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-81792263-803a-434c-9ea4-2e6646aa12de req-3b86cc70-4c97-4e19-b43d-fd37902c38dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104264 Sep 03 20:52:59.730257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 561/1125] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:52:59.743769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:52:59.744585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:52:59.770298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.771098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.771748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:52:59.772655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:52:59.775531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:52:59.777790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.044040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:00.053085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4469946f-7ea2-476f-9c09-78739ea6dbf3 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 200 len: 1320 microversion: 2.1 time: 0.319563 Sep 03 20:53:00.055269 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 562/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:52:59 2022] GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:00.250913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b55c22cb-977a-46db-9f8f-987825d011d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b90a790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:00.543904 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b55c22cb-977a-46db-9f8f-987825d011d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.297236 Sep 03 20:53:00.545187 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 563/1127] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:00 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:00.550495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:00.552037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:00.559834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:00.560605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:00.561325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.562272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:00.563183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:00.563838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.728558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:00.737103 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef9df9c8-5068-42f2-937c-04d52623daba tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1465 microversion: 2.1 time: 0.190377 Sep 03 20:53:00.737663 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 564/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:00 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:00.742883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47cd62bf-a68c-4d85-a25c-70cbdad12783 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '.version_select at 0x7fae6705eee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:00.746296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47cd62bf-a68c-4d85-a25c-70cbdad12783 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:00.746936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47cd62bf-a68c-4d85-a25c-70cbdad12783 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:00.747548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47cd62bf-a68c-4d85-a25c-70cbdad12783 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.751647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:00.762687 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-47cd62bf-a68c-4d85-a25c-70cbdad12783 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2291 microversion: 2.1 time: 0.022301 Sep 03 20:53:00.763329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 565/1129] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:53:00 2022] GET /compute/v2.1/os-migrations => generated 2291 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:00.768606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1777445799", "metadata": {"image_type": "test"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:00.771275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:00.788220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:00.788726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:00.789223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.790483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:00.790946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:00.791385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:00.844386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Getting quotas for project 44e122acac834fc2843f725beb5daeff. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:00.849993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Getting quotas for user ddb7b29dc8464329abda9836b09b907f and project 44e122acac834fc2843f725beb5daeff. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:01.079733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd377ae4-babe-4414-bd01-46e779de851d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "POST /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444/action" status: 202 len: 0 microversion: 2.1 time: 0.314802 Sep 03 20:53:01.080546 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 566/1130] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:00 2022] POST /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:53:01.088207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6831f13-2ac1-4a3e-b684-043b33ea5030 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.097256 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6831f13-2ac1-4a3e-b684-043b33ea5030 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015157 Sep 03 20:53:01.098114 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 567/1131] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:01.110106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.110944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:01.132443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:01.132975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:01.133493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:01.134408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:01.135036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:01.135671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:01.350933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:01.366724 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b2f00aee-9ed5-4b29-9520-f822832caccb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 200 len: 1320 microversion: 2.1 time: 0.265773 Sep 03 20:53:01.367556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 568/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:01.390954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ffad193-ee1a-4294-9ffb-608babffe6bf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b997c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.468125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ffad193-ee1a-4294-9ffb-608babffe6bf tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.082074 Sep 03 20:53:01.469059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 569/1133] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:01.474668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74481508-a1d3-436e-b22d-6ece066afff9 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-247784661", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:01.520374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74481508-a1d3-436e-b22d-6ece066afff9 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.048755 Sep 03 20:53:01.520552 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-70ce4cfd-f046-46af-abdd-153d090b6771 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe/action" status: 202 len: 0 microversion: 2.25 time: 1.869366 Sep 03 20:53:01.531348 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 565/1134] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:52:59 2022] POST /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe/action => generated 0 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:53:01.531454 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 570/1135] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Sep 3 20:53:01 2022] POST /compute/v2.1/flavors => generated 498 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:01.534803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.535425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:01.546749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a96599e0-6d9f-4156-908e-08bc2754f121 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.562191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:01.562677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:01.563196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:01.565226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:01.565742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:01.568842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:01.573653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a96599e0-6d9f-4156-908e-08bc2754f121 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034999 Sep 03 20:53:01.576868 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 571/1136] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:53:01.591445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-931aa287-792b-49bf-840e-5fc45054d45b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b90aee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:01.800723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:01.814751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:01.817322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:01.819055 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0454db1-6256-40e3-a853-173af29f8d83 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.293651 Sep 03 20:53:01.820078 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 566/1137] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:01.826014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-579902120", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "ad1e8442-2fd1-4252-b901-5f34d89af62d"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:02.233214 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-931aa287-792b-49bf-840e-5fc45054d45b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1414 microversion: 2.1 time: 0.654873 Sep 03 20:53:02.235649 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 572/1138] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:01 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1414 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:02.247649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e57c452f-65cb-4515-9d6b-4b31907458e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae671674c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.259603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:02.309491 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e57c452f-65cb-4515-9d6b-4b31907458e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328" status: 200 len: 661 microversion: 2.1 time: 0.070562 Sep 03 20:53:02.320441 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 573/1139] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328 => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:02.328080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3e49cf4-ac2b-48f2-b372-b8e7637d1131 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae670341f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.389020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3e49cf4-ac2b-48f2-b372-b8e7637d1131 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328" status: 200 len: 661 microversion: 2.1 time: 0.067021 Sep 03 20:53:02.398558 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328 => generated 661 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:02.398558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.406527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:02.423416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.424006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.424720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.425646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.426283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.426877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.590371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:02.598971 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-355f33bf-4b45-4bab-be02-74e8c602a7bb tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 200 len: 1509 microversion: 2.1 time: 0.204575 Sep 03 20:53:02.599774 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 575/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:02.615925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e88a2b42-2f2c-450a-93c2-e44f923154b8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae67019a60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.652518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:02.653074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:02.653603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:02.654085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:02.654687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:02.665720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.666332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.667036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.667880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.668442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.669002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.688911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:02.694411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:02.695394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e88a2b42-2f2c-450a-93c2-e44f923154b8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.085183 Sep 03 20:53:02.697337 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 576/1142] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:02.702965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.703695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:02.712100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.712793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.713457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.714680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.716107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.716701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.732812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:02.739733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:02.748041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 8ae50f5c-7ce0-4762-bab3-74765ba13d23] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:02.792125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83ac54f4-7743-483b-9449-d5672e5f4a63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970399 Sep 03 20:53:02.793275 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 567/1143] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:53:02.819473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f43256a9-5ff0-441c-b4a9-7c2d020a3f9a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.820599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f43256a9-5ff0-441c-b4a9-7c2d020a3f9a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:02.836629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:02.846655 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-853f5380-5cee-4d94-91dc-daa45b89e2f9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23" status: 204 len: 0 microversion: 2.1 time: 0.147397 Sep 03 20:53:02.847779 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 577/1144] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:02 2022] DELETE /compute/v2.1/servers/8ae50f5c-7ce0-4762-bab3-74765ba13d23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:02.854104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.855059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:02.862559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.863096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.863554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.864440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.865025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.865554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.912294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f43256a9-5ff0-441c-b4a9-7c2d020a3f9a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:02.920762 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f43256a9-5ff0-441c-b4a9-7c2d020a3f9a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1278 microversion: 2.1 time: 0.108623 Sep 03 20:53:02.921396 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 568/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:02.943469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:02.944088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:02.952801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.956632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.957223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.958052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:02.958599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:02.959101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:02.994767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 4246896c-887f-4a47-8b4c-0f2239038887] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:03.031123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:03.043112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:03.045041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:03.046418 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d168b2de-1ce6-42b6-8a28-7182c04757a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.197067 Sep 03 20:53:03.058901 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 578/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:02 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:03.089850 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13f4178b-1609-4640-8e16-3097f9953a9a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887" status: 204 len: 0 microversion: 2.1 time: 0.150128 Sep 03 20:53:03.090822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 569/1147] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:02 2022] DELETE /compute/v2.1/servers/4246896c-887f-4a47-8b4c-0f2239038887 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:03.235018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-483805871", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "46c3663f-2ad6-4b0c-8a98-90501bb3a2e0"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:03.252967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9eb4162f-eace-46e7-9f13-e6b959c0a095 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66e6fc10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:03.324795 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9eb4162f-eace-46e7-9f13-e6b959c0a095 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1423 microversion: 2.1 time: 0.076138 Sep 03 20:53:03.325769 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 570/1148] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:03 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:03.330340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] validate_networks() for [('46c3663f-2ad6-4b0c-8a98-90501bb3a2e0', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:03.341265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e09b7673-1b23-41ab-8147-30cf466118ad tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66e6f0d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:03.389005 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e09b7673-1b23-41ab-8147-30cf466118ad tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 200 len: 1423 microversion: 2.1 time: 0.052462 Sep 03 20:53:03.390197 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 571/1149] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:03 2022] GET /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 1423 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:03.405341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a4ea2a8-ddd1-400c-8a4b-0c7a94d39a31 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66eea550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:03.832166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:03.832601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:03.833179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:03.833595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:03.834258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:03.844439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:03.844883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:03.845354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:03.846230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:03.846546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:03.846980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:03.867287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Getting quotas for project c55700f621564ad5a52056d7a7854e20. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:03.873322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Getting quotas for user 86035889fc474973bc31a97989ec26fd and project c55700f621564ad5a52056d7a7854e20. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:03.888459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Going to run 2 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:03.891173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:03.932551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=09369a26-88c7-46c3-8ac5-99681094633f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:03.942028 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a4ea2a8-ddd1-400c-8a4b-0c7a94d39a31 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 204 len: 0 microversion: 2.1 time: 0.541287 Sep 03 20:53:03.943146 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 572/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:03 2022] DELETE /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:03.948064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf9f6a0-a5cb-4458-8402-6600ef7605fe", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c9c6fa-589a-463a-afdd-a5bbccade4e9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:03.959773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:03.960439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:03.960886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:03.973941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] Creating event network-vif-unplugged:f6c9c6fa-589a-463a-afdd-a5bbccade4e9 for instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe on nch1-master-1 Sep 03 20:53:03.982321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4171eeb9-a7c0-4591-b7bf-37c056d86ca1 req-790018dc-7bce-4f77-bb63-2db0235e1568 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037686 Sep 03 20:53:03.982925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 573/1151] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:03.989407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7b49dae-0345-49ee-99be-40aacbfb1d86 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66ee8820>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:03.996751 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a485e35c-8038-4a02-b18e-e09627bbe420 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.765600 Sep 03 20:53:04.005090 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 579/1152] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 03 20:53:04.014163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72c3d739-cb24-44ab-a8c6-82b5dca52ead tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b976790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.066246 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7b49dae-0345-49ee-99be-40aacbfb1d86 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.081897 Sep 03 20:53:04.066816 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 574/1153] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:03 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:04.071590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.072537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:04.073945 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72c3d739-cb24-44ab-a8c6-82b5dca52ead tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9" status: 200 len: 661 microversion: 2.1 time: 0.065473 Sep 03 20:53:04.080946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 580/1154] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:04.089342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.090013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:04.090823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.091746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.092689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.094054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.094658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.095281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.105983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.106487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.106958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.107944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.108626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.109192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.140468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:04.196023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.204847 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa72c5fc-9e8a-478f-b43a-fc24cae3f5b3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1282 microversion: 2.1 time: 0.136616 Sep 03 20:53:04.225219 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 575/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:04.233355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.238374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.239081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Searching by: {'deleted': False, 'project_id': 'c55700f621564ad5a52056d7a7854e20'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:53:04.253144 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-442740f7-7534-450b-939a-ce550fb20671 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 204 len: 0 microversion: 2.1 time: 0.175704 Sep 03 20:53:04.256970 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 581/1156] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:04 2022] DELETE /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:04.263742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.264459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:04.265141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.267082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.269180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.270689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.271284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.271649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.272043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.272580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.272726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.273611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:04.275060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:04.275661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:04.309836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:53:04.459357 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c2a5701-96ae-49b1-95dc-fa31669f76a9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.232160 Sep 03 20:53:04.459995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 576/1157] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/servers => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:04.459995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77b91c9d-828a-4942-aa5e-be8f6417d820 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6710fa60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.486645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.501417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.503201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.504745 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed8f43c3-90b2-46a1-be98-4e0fcad82928 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.246641 Sep 03 20:53:04.505344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 582/1158] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:04.526742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1540020956", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:04.542466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77b91c9d-828a-4942-aa5e-be8f6417d820 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9" status: 200 len: 661 microversion: 2.1 time: 0.080587 Sep 03 20:53:04.552130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 577/1159] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:04.557422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d592b12-0a6e-4f09-9c0a-4e225cacec83 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:04.558145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d592b12-0a6e-4f09-9c0a-4e225cacec83 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:04.607275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] validate_networks() for [('6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:04.639071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d592b12-0a6e-4f09-9c0a-4e225cacec83 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:04.660844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d592b12-0a6e-4f09-9c0a-4e225cacec83 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1217 microversion: 2.1 time: 0.106877 Sep 03 20:53:04.661822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 578/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:04 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:05.084007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e7fa4397-08a3-49cc-894e-7f2c8c38f3e3 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66e6f040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:05.153428 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e7fa4397-08a3-49cc-894e-7f2c8c38f3e3 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.073504 Sep 03 20:53:05.154627 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 579/1161] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:05 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:05.235845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:05.236597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:05.247629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.248402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.249594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.250579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.251263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.252108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.287798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:05.288852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:05.290139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:05.290901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:05.292007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:05.317697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.318229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.318768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.319646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.320110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.320541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.361373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:05.380760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for user d9688dca94a841cfa29420ad780562cd and project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:05.416391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:05.419162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:05.424427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.434993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0fd3c545-04d3-4046-a39b-31a9a96a8efe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1330 microversion: 2.1 time: 0.204742 Sep 03 20:53:05.442392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 580/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:05 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1330 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:05.463428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae50f5c-7ce0-4762-bab3-74765ba13d23", "name": "network-vif-deleted", "tag": "3451c701-24db-45fe-91e9-299002399c5a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:05.473801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:05.492289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.494224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.497149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.529237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cc02fab3-c8f0-4ee2-b105-f6d64211bd02 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022548 Sep 03 20:53:05.530824 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 583/1163] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:53:05.541768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee7d0746-b57d-4e30-adaa-39e8535f0979 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:05.543802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ee7d0746-b57d-4e30-adaa-39e8535f0979 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:05.547366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] Creating event network-vif-deleted:3451c701-24db-45fe-91e9-299002399c5a for instance 8ae50f5c-7ce0-4762-bab3-74765ba13d23 on nch1-master-1 Sep 03 20:53:05.566162 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-28baebc5-7d5c-4633-af26-be11665cfc15 req-b9c2fa6b-99d1-4199-9a74-af64f3522a77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121879 Sep 03 20:53:05.567159 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 581/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:05.579274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:05.583211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:05.599066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.599776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.600617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.606387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.607119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.608035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.643787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ee7d0746-b57d-4e30-adaa-39e8535f0979 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.654309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ee7d0746-b57d-4e30-adaa-39e8535f0979 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1208 microversion: 2.1 time: 0.116683 Sep 03 20:53:05.673198 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 584/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:05 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:05.696721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:05.697453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:05.717895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.718404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.721873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.724433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:05.725672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:05.727197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:05.837924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.848317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.850251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.851712 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5035844-c424-495b-96ed-12500ec33a0e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.283287 Sep 03 20:53:05.853564 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 582/1166] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:05 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:05.855497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:05.863794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e65e280f-74e5-42d8-8beb-48d1a7e1a1e9 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1213 microversion: 2.1 time: 0.183415 Sep 03 20:53:05.864763 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 585/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:05 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:06.003488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf9f6a0-a5cb-4458-8402-6600ef7605fe", "tag": "f6c9c6fa-589a-463a-afdd-a5bbccade4e9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:06.018002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.019783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.020726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.036375 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] Creating event network-changed:f6c9c6fa-589a-463a-afdd-a5bbccade4e9 for instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe on nch1-master-1 Sep 03 20:53:06.042308 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-41eadc7c-7a11-4073-9b50-1211fc85de25 req-093475e7-4ecc-4876-822c-f00b443b73a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045292 Sep 03 20:53:06.044130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 583/1168] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:06.134666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d827779-ce47-4726-9538-46279e8af94e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b90a4c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.171080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d0a9abd-2440-42db-bd6f-13102c1c4588 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae672223a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.182014 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d827779-ce47-4726-9538-46279e8af94e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23" status: 200 len: 662 microversion: 2.1 time: 0.051857 Sep 03 20:53:06.184945 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 586/1169] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23 => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:06.197031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f18282dc-66e8-42a3-b369-32e9c0407ed2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67167dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.244547 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d0a9abd-2440-42db-bd6f-13102c1c4588 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.077076 Sep 03 20:53:06.245532 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 584/1170] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:06.270785 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f18282dc-66e8-42a3-b369-32e9c0407ed2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23" status: 200 len: 662 microversion: 2.1 time: 0.078250 Sep 03 20:53:06.271365 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 587/1171] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23 => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:06.335359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-65827792", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:06.396512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:06.471762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.478758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:06.488927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.490114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.490715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.491776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.492486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.509326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.699999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:06.700403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:06.701155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:06.702402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:06.703207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:06.714438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.715678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.716602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.717995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.718679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.719313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.730944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:06.741981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Getting quotas for project 23ef148ffad044529cb3658ac1ed3107. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:06.745151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5967322a-9b0e-4f85-9076-5dbce9f868da tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1336 microversion: 2.1 time: 0.277551 Sep 03 20:53:06.751049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Getting quotas for user 0f8ece445698482795d9b9d5ad5b13aa and project 23ef148ffad044529cb3658ac1ed3107. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:06.752081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 588/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1336 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:06.757251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.757885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:06.771905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.772653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.773578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.774752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.775540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.776333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.783900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:06.786358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:06.837405 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4915780-10bc-46d1-bda1-57d165663b5d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506141 Sep 03 20:53:06.838468 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 585/1173] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:53:06.869425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:06.884745 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ef8b387-4dcf-41ab-9343-53e986903cc6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1260 microversion: 2.1 time: 0.131038 Sep 03 20:53:06.886138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 589/1174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1260 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:06.891156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.891865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:06.899602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.900084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.900710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.901507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.901965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.902593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.908177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:06.908866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:06.915718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.916222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.916668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.917415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:06.920138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:06.924372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:06.959232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:07.056167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:07.065284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd349bfe-624e-4ac5-bae8-f0935e8357e1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1269 microversion: 2.1 time: 0.177888 Sep 03 20:53:07.077889 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:07.087870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-440318809", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:07.187121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:07.192350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:07.207035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:07.210196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:07.211904 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e8acb3b-9e53-44e2-aa8f-16ed74cac83a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.333669 Sep 03 20:53:07.212475 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 586/1176] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:06 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:53:07.262900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71e59090-4550-4ae3-86a6-ea24225a48b6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66f115e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:07.338831 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-71e59090-4550-4ae3-86a6-ea24225a48b6 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.081539 Sep 03 20:53:07.340346 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 587/1177] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:07 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:07.367853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-plugged", "status": "completed", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:07.425148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:07.440382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:07.442868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:07.473581 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] Creating event network-vif-plugged:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:53:07.501248 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d748eb94-7b42-42a4-8c34-02383ba61c44 req-71cab230-f84b-4358-9226-b1c17cd538d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134125 Sep 03 20:53:07.509945 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 588/1178] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:53:07.778222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:07.779099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:07.802031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:07.802668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:07.806658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:07.809163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:07.810772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:07.813527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:08.311502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:08.312033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:08.312631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:08.313312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:08.313887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:08.343267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:08.343977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:08.344763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:08.345740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:08.346245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:08.346739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:08.389342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Getting quotas for project 23ef148ffad044529cb3658ac1ed3107. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:08.405849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Getting quotas for user 0f8ece445698482795d9b9d5ad5b13aa and project 23ef148ffad044529cb3658ac1ed3107. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:08.441355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:08.443824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:08.575468 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-320e54f2-0678-4e7b-89f6-40dcf5040556 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490622 Sep 03 20:53:08.578471 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 591/1179] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:53:08.609323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:08.617261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:08.637504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:08.638426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:08.639271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:08.640227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:08.641020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:08.641697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:09.469015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:09.493762 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90d11743-962e-451b-a38f-7891cf4a4bf4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 1.717309 Sep 03 20:53:09.494680 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 589/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:07 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:09.499644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:09.504694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:09.527145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:09.528873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:09.530179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:09.531240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:09.533660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:09.534359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:09.692483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:09.698418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:09.719562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a2e1eff-4865-40dc-8f3e-8a2b07f961a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1275 microversion: 2.1 time: 0.220383 Sep 03 20:53:09.720449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 590/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:09 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:09.741170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:09.742076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:09.768727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:09.770743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:09.771384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:09.773081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:09.775131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:09.775740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.087078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.099353 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-76cffd30-706d-402a-bb5c-6f07479cd182 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1268 microversion: 2.1 time: 1.511501 Sep 03 20:53:10.099750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 592/1182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:08 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1268 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:10.105442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d5182cf-5e20-4b0c-bead-fb6a5d97ae50 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b97e790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:10.240715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d5182cf-5e20-4b0c-bead-fb6a5d97ae50 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.139567 Sep 03 20:53:10.254911 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 593/1183] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:10 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:10.262333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:10.264243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:10.276559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.277322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.278283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.279526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.280566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.281293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.560381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.571294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.577922 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d51aaba-2872-492b-b401-641700236170 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1269 microversion: 2.1 time: 0.316288 Sep 03 20:53:10.579176 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 594/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:10 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1269 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:10.593870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd89dac-67e7-4386-8d33-0ca58ab9c14d", "name": "network-vif-unplugged", "status": "completed", "tag": "a8da193f-e198-4120-be6f-383cbe65b606"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:10.594055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.595521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.596708 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6aa7cb3c-e907-41a5-8280-76987c5c84a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.874961 Sep 03 20:53:10.608677 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 591/1185] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:09 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:10.632922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.634114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.634673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.644363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4246896c-887f-4a47-8b4c-0f2239038887", "name": "network-vif-deleted", "tag": "25c3d175-79c2-4191-a727-f30618f9033e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:10.650556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] Creating event network-vif-unplugged:a8da193f-e198-4120-be6f-383cbe65b606 for instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d on nch2-master-1 Sep 03 20:53:10.667796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.673223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.673892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.674262 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a36dcf27-0e05-4345-ab4d-3763319b6a36 req-fd062f21-8984-4b97-94b1-8e073a978c81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090661 Sep 03 20:53:10.675134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 595/1186] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:10.691303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:10.692952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:10.700735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.701399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.702297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.704009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.704009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.704456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.719782 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] Creating event network-vif-deleted:25c3d175-79c2-4191-a727-f30618f9033e for instance 4246896c-887f-4a47-8b4c-0f2239038887 on nch2-master-1 Sep 03 20:53:10.728540 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4cbef45f-6ce4-460e-a680-420ed6b3b73c req-8422dc3d-2908-4df3-a185-e9b6dcecb1e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116551 Sep 03 20:53:10.730428 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 592/1187] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:10.755838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:10.759352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:10.781070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.782788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.783496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.784741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:10.785449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:10.786213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:10.925427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:10.957094 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a6fdf7a-4148-4f92-bacc-9e430de59db1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1275 microversion: 2.1 time: 0.214760 Sep 03 20:53:10.959929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 593/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:10 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1275 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:10.990480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd89dac-67e7-4386-8d33-0ca58ab9c14d", "name": "network-vif-deleted", "tag": "a8da193f-e198-4120-be6f-383cbe65b606"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:11.061163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.066134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.074550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.153272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] Creating event network-vif-deleted:a8da193f-e198-4120-be6f-383cbe65b606 for instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d on nch2-master-1 Sep 03 20:53:11.171032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d2be7004-27eb-415b-9438-46c0e088baf6 req-2516e491-9cef-408d-a439-a686d2d2d07d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202971 Sep 03 20:53:11.171926 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 594/1189] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:11.177423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:11.183305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:11.198901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.199916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.200609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.203210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.205510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.206207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.370308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:11.380031 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c69f94a-297b-4b43-8480-1dcc957720ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1266 microversion: 2.1 time: 0.206650 Sep 03 20:53:11.396514 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 595/1190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:11 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:11.396514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d08cc9f-839c-4fc4-bef9-b42068415ad0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae670139d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:11.480669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d08cc9f-839c-4fc4-bef9-b42068415ad0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.090466 Sep 03 20:53:11.484040 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 596/1191] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:11 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:11.604871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:11.605572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:11.615176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.615676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.632846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.638142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.639322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.643264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.775340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:11.787791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5913c49-8cb9-4d18-b84a-31014005a0d5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 1.100867 Sep 03 20:53:11.788620 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 596/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:10 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:11.800790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:11.801844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:11.818333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.819225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.822779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.823777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:11.824675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:11.834437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:11.983902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:11.992378 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd9b28f6-e262-4fab-b458-3314f948a799 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1275 microversion: 2.1 time: 0.391956 Sep 03 20:53:11.995669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 597/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:11 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:12.015546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:12.016501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:12.033390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:12.034178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:12.034773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:12.035658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:12.036267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:12.036848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:12.250572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:12.259754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:12.271595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:12.274346 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc936094-4cd6-4a63-a35a-58587e5d2a20 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.483249 Sep 03 20:53:12.275110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 597/1194] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:11 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:12.404122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:12.404987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:12.429933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:12.450514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:12.451135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:12.452105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:12.452725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:12.453349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:12.884155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:12.899750 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c5f4de5-0853-4bd2-aa1c-63d8e5585a9e tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.896243 Sep 03 20:53:12.900672 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 598/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:11 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:12.909418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c86f28a6-8de3-4f97-baac-ac9a07e96529 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66ee8c10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:12.977051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c86f28a6-8de3-4f97-baac-ac9a07e96529 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.074986 Sep 03 20:53:12.977772 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 599/1196] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:12 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:12.990908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:12.993467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:13.011134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.012791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.015784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:13.018438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.020384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.022065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:13.632910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:13.642929 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0bf653e-209d-46ea-80e9-a6fa367bb0d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.663756 Sep 03 20:53:13.657844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 600/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:12 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:13.673282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:13.681852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:13.688359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.689144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.689742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:13.694666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.695313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.696492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:13.769984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:13.791168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8316085-bcda-4043-84e0-0d2901353f9b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 1.392068 Sep 03 20:53:13.792427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 598/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:12 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:13.798672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:13.809759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:13.822795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.831330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.833883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:13.835005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:13.835475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:13.835905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.106760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:14.115197 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0755d542-96cd-4f6c-8ea3-25e5f3103c82 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1275 microversion: 2.1 time: 0.450856 Sep 03 20:53:14.135564 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 601/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:13 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1275 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:14.141126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:14.142169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:14.148789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.149660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.150327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.151290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.151982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.152637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.378203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:14.392281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:14.393734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:14.395004 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01282433-64e1-4d68-892d-4de0dd9db471 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.601245 Sep 03 20:53:14.409963 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 599/1200] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:13 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:14.409963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6bb52ba2-6220-479a-8301-030bcd3d3494 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b918310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:14.517266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6bb52ba2-6220-479a-8301-030bcd3d3494 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.120321 Sep 03 20:53:14.517943 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 600/1201] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:14 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:14.522897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:14.534458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.537496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.538190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.561215 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] Creating event network-changed:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:53:14.563200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:14.576146 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d604f975-397f-4115-b19b-34659366ab17 req-4f834b68-169d-445a-8d12-c7cbd306430b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055134 Sep 03 20:53:14.576980 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 601/1202] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:14.583753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5faf005-916e-49ac-b36c-4887dd2a4e60 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.446442 Sep 03 20:53:14.597997 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 602/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:14 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:14.671047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:14.671891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:14.680652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.704577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.705457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.708455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.709229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.715211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.821769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:14.831753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:14.850777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.854956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.855731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:14.856833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:14.857636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:14.858504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:15.498541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:15.513213 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff5c39f9-8d7f-4ea7-8d21-85e0917eed72 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.692262 Sep 03 20:53:15.528635 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 603/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:14 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:15.535958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:15.541478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:15.554551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:15.561831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:15.562431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:15.563338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:15.564086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:15.564772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:15.635995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:15.650453 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c2ad288e-6190-4087-b9c4-baa97cd3fb45 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.983572 Sep 03 20:53:15.651031 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 602/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:14 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:15.660974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:15.665922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:15.675085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:15.680740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:15.681728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:15.682527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:15.683568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:15.684316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.037189 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf95f6e1-4852-4398-a30d-0bcc76904f0d tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1810 microversion: 2.1 time: 0.505182 Sep 03 20:53:16.039004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 604/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:15 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1810 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:16.056287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:16.057294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:16.068352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.072491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.073227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.074180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.074840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.077729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.604062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:16.632387 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9be05b84-4a58-442f-86a3-337338507d85 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.972544 Sep 03 20:53:16.633701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 603/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:15 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:16.644780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb63a923-ace5-4b3a-a9de-9c63f6de654a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b918f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:16.696763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:16.716375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:16.728347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:16.735227 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15268b2c-07b2-4d48-be67-42225c01498c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1567 microversion: 2.25 time: 0.685963 Sep 03 20:53:16.736528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 605/1208] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:16 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1567 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:16.743871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:16.744942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:16.759729 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb63a923-ace5-4b3a-a9de-9c63f6de654a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.123889 Sep 03 20:53:16.765582 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 604/1209] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:16 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:16.770102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:16.775022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.776969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:16.778030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.778713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.782389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.785413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.786270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.787501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:16.811676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.813551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.816305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.818908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:16.822114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:16.822813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:16.921034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:16.973856 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0617a7fb-d0a4-42d2-930e-aba21e58e1f6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.206564 Sep 03 20:53:17.027647 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 605/1210] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:53:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:17.048186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21abe17-0f3a-4cea-bd5c-437fc2a7394d", "tag": "d93c3119-2656-48a4-9f21-6856e826e455"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:17.097596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.098358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.101207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.131636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] Creating event network-changed:d93c3119-2656-48a4-9f21-6856e826e455 for instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d on nch1-master-1 Sep 03 20:53:17.143753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9e85d48b-e645-4058-92e6-c616be91ed0f req-3eaacb6a-918c-4b00-9b31-89ca9eb8d92c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114327 Sep 03 20:53:17.148037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 606/1211] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:17.166134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:17.168994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:17.187303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.189121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.190177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.193179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.193872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.194461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.274679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:17.289559 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87173286-144a-4bf9-9380-8eeb2d639460 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.546947 Sep 03 20:53:17.291205 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 606/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:16 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:17.298471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd", "tag": "9d132a32-0a12-45a3-bb6a-b25d42badeeb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:17.331639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.332402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.332963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.348564 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] Creating event network-changed:9d132a32-0a12-45a3-bb6a-b25d42badeeb for instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd on nch1-master-1 Sep 03 20:53:17.366749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6817532d-e3ce-4c14-9409-71638228290f req-1ccd25ed-75e3-4c39-9e61-d003fd63e874 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074264 Sep 03 20:53:17.368029 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 607/1213] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:17.378093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:17.381688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:17.398616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.399584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.400691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.402160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.407494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.408045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.689420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:17.699980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88122f10-7a34-4915-a1d2-eac8c1c33ed7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.549865 Sep 03 20:53:17.704926 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 607/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:17 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:17.719134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:17.722547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:17.743357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.744210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.746440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.747371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.749547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.749999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.838586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:17.854006 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1713510-b2a2-4c95-ad5e-e216f6b03c57 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.479900 Sep 03 20:53:17.855642 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 608/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:17 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:17.863352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:17.864369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:17.881619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.883159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.885331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:17.886330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:17.887476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:17.888170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.191555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:18.199870 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2dcd7279-0b62-40df-934a-2d3796fb9238 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.493095 Sep 03 20:53:18.200760 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 608/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:17 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:18.205170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76c0965f-4aae-42e0-b2d4-bf7bd2dfaacc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b90ab80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.261229 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-76c0965f-4aae-42e0-b2d4-bf7bd2dfaacc tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.059312 Sep 03 20:53:18.262374 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 609/1217] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:18.313720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:18.318376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.318988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:18.333808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.334124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:18.335654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.338170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:18.338486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.339378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.343265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.343644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.346673 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07778038-1b88-4e30-a38c-ea23f7a31138 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1542 microversion: 2.25 time: 0.488889 Sep 03 20:53:18.347419 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 609/1218] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:17 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1542 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:18.374698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87a831e7-1249-488f-a7f0-4ad6ba0fa4ba tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '.version_select at 0x7fae6756b3a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.378449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a831e7-1249-488f-a7f0-4ad6ba0fa4ba tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.379137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a831e7-1249-488f-a7f0-4ad6ba0fa4ba tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.379748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a831e7-1249-488f-a7f0-4ad6ba0fa4ba tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.407528 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87a831e7-1249-488f-a7f0-4ad6ba0fa4ba tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.037040 Sep 03 20:53:18.408717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 610/1219] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:18.423726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.424946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:18.429101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:18.449307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.450083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.450751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.454366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.455113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.457858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.556355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:18.565544 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5aca3fb-44da-42c4-99eb-865535597064 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.256499 Sep 03 20:53:18.577820 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 610/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:18.620498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid dbf9f6a0-a5cb-4458-8402-6600ef7605fe {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:53:18.626125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:18.637490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-05b45ccf-e716-410d-a813-d9af06e224c7 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 2034 microversion: 2.25 time: 0.217452 Sep 03 20:53:18.638840 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 611/1221] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 2034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:18.671100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1950b000-a1ac-4daf-857c-2c21917f1a87 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: .version_select at 0x7fae6b9183a0>, body: {"keypair": {"name": "tempest-keypair-1589833773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7L3tjxsg6DR4yuJG7yMNi39adX1Z4NM9hMjDLgRxwgjxk8BNTtYi0a2tvrBidAUbWzNzTIOyJdiHkZPoBZsVjupDH/j9R0ivduPdibwk8o9FJru6KOcT64PPyCjcQFFQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:18.690203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1950b000-a1ac-4daf-857c-2c21917f1a87 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for project 361f907a187547aabda6cb54eeeb3684. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:18.697658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1950b000-a1ac-4daf-857c-2c21917f1a87 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for user 778561ee5e474accb31816f357985f44 and project 361f907a187547aabda6cb54eeeb3684. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:18.729251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.729918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:18.741473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.741964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.743233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.743958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.744418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.744850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.745656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1950b000-a1ac-4daf-857c-2c21917f1a87 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.078451 Sep 03 20:53:18.750449 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 611/1222] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 20:53:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 03 20:53:18.881967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:18.882905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:18.891400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.892500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.893175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:18.894560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:18.895307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:18.896013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.278731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:19.281527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:19.294691 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2603f2aa-48c1-4ec4-929c-7b06b01488af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.418390 Sep 03 20:53:19.295290 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 612/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:19.306575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}, {"name": "network-changed", "server_uuid": "868e0374-e87b-47bb-b1c6-454b021cb0c7", "tag": "6fdb39ff-6197-4b7f-b337-ca2c08b9dbab"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:19.310723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-259d0f7f-0a9f-48ba-9360-0656684ca8d9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.584756 Sep 03 20:53:19.332562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.335301 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 612/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:18 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:19.336047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.338659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.349086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:19.356349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:19.372440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.373492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.374651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.375723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.378328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.379050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.382162 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Creating event network-changed:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:53:19.382681 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] Creating event network-changed:6fdb39ff-6197-4b7f-b337-ca2c08b9dbab for instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 on nch1-master-1 Sep 03 20:53:19.393666 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e6c19b90-2e5b-4503-b75d-ec17b0a0c380 req-c6cd0d5f-5adc-4d95-9b8a-daeba4512784 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092957 Sep 03 20:53:19.394181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 613/1225] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:19.422739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9fb6d06-77f2-4861-aff7-97126b1a3299 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b922940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:19.503878 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9fb6d06-77f2-4861-aff7-97126b1a3299 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.108449 Sep 03 20:53:19.510672 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 614/1226] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:19 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:19.518311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80e6d713-e5fc-4d1b-ae13-80868b12d778", "device": "/dev/xvdb"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:19.529949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:19.537990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.538831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.539668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.540640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.541328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.542154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.720574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:19.729317 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a2a6062-6ca6-4fc4-8b9a-b47b36298994 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.390507 Sep 03 20:53:19.733404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 613/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:19 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:19.745694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09369a26-88c7-46c3-8ac5-99681094633f", "tag": "cfd78dac-842a-47de-bd7f-bbb44dd7945c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:19.777031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.778358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.779015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.793832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] Creating event network-changed:cfd78dac-842a-47de-bd7f-bbb44dd7945c for instance 09369a26-88c7-46c3-8ac5-99681094633f on nch1-master-1 Sep 03 20:53:19.799902 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6c9413ff-7bb2-428a-8933-2c17bbad6918 req-96d3bf9f-da0a-4c95-8a71-8c84c8ba4094 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065028 Sep 03 20:53:19.801201 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 614/1228] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:19.809145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:19.810305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:19.819290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.820083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.821315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:19.822448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:19.823105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:19.823746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.074820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:20.100847 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9abda89e-e2c9-49e3-9b30-7794d4954492 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586923 Sep 03 20:53:20.113029 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 615/1229] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 3 20:53:19 2022] POST /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:20.320300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:20.321076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:20.328351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.328850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.330251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.331717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.332270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.333294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.517352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:20.526461 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-beebddf9-1799-490f-9294-bded8a5002a0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.210699 Sep 03 20:53:20.527395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 616/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:20 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:20.532561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:20.533247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:20.540161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.540782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.541144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.542010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.542668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.543001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.741149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:20.741395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:20.752641 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9ab213c0-1d43-4c81-b869-ec4ccee47856 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.222293 Sep 03 20:53:20.753569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 617/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:20 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:20.760731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b6e763a-ab2b-4fa8-8ab4-80934f571b55 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b886430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:20.771115 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95e440b6-0b59-46c9-8de9-916f0197571d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.968343 Sep 03 20:53:20.785745 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 615/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:19 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:20.795360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:20.796288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:20.805289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.806427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.807496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.808705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:20.810016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:20.810877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:20.845686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b6e763a-ab2b-4fa8-8ab4-80934f571b55 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.087300 Sep 03 20:53:20.847194 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 618/1233] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:20 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:21.143419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:21.157595 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2509d8bd-07c3-4ca0-96f7-f2988893345f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.370417 Sep 03 20:53:21.159866 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 616/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:20 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:21.557995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:21.559182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:21.569875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:21.570428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:21.570885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:21.571634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:21.572101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:21.572541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:21.776417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:21.777688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:21.793525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:21.794682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:21.799225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:21.803946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:21.805908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:21.808513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:22.239391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:22.254812 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd64d8ff-68d9-4f95-b462-f81bc311a3d8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.702085 Sep 03 20:53:22.258590 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 619/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:21 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:22.276959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:22.277714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:22.343094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:22.343618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:22.344074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:22.344815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:22.345309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:22.345747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:22.388246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:22.397625 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c67e6c29-d592-48c8-a55b-b6d126d8e2f5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.625811 Sep 03 20:53:22.402744 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 617/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:21 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:22.419275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57553c87-065f-4ca2-8657-35b963e3a98b tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66fed670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:22.520630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57553c87-065f-4ca2-8657-35b963e3a98b tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.113436 Sep 03 20:53:22.521713 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 618/1237] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:22 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:22.529126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:22.529866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:22.536918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:22.537615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:22.538127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:22.538938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:22.539502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:22.541070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:22.756229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:22.759459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:22.766715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-425df2d1-aa9b-424e-a99a-02e69a949c0a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.505926 Sep 03 20:53:22.780992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 620/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:22 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:22.781153 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff7d60fe-a745-4aeb-a8c0-6f13fc4d18a2 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.245408 Sep 03 20:53:22.781153 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 619/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:22 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:22.781655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-202449042", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859"}], "security_groups": [{"name": "tempest-securitygroup--1279386873"}], "key_name": "tempest-keypair-1589833773", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:22.895320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] validate_networks() for [('57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:53:23.278912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.279578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:23.293080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.293552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.294040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.296098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.298732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.299387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.332486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:23.332942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:23.333431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:23.333852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:23.334303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:23.356454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.357294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.359457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.360441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.361129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.361730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.382565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:53:23.388506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for user 778561ee5e474accb31816f357985f44 and project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:53:23.403054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:53:23.405984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:53:23.488520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8170897-4259-424b-b52c-73aa897d90f8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.719763 Sep 03 20:53:23.492845 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 621/1240] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:53:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:53:23.499770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.500649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:23.508290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.509115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.510808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.512024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.512804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.513475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.557038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:23.572575 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-554d1efd-f40b-4624-adc8-93b27c9bcaf0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.297010 Sep 03 20:53:23.575440 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 620/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:23.580281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-plugged", "status": "completed", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:23.617650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.618550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.619606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.636516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] Creating event network-vif-plugged:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:53:23.643945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-070b321a-ef2d-435c-be95-4f33106db5f3 req-92854301-0573-43ee-b387-6702674d81b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066858 Sep 03 20:53:23.645485 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 621/1242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:23.667377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.668545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:23.745357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:23.755027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:23.758255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:23.762711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbc196c7-14d6-47da-86b9-701c8f49e2a1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1285 microversion: 2.25 time: 0.114905 Sep 03 20:53:23.763477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 622/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:23.786582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d929e5d1-a43e-4fab-8979-19b2046248ed tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66fed9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.813278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:23.824215 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5d64424-7d14-414f-9e61-489c610ff26a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.329936 Sep 03 20:53:23.832968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 622/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:23.832968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.832968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:23.846675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.847227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.847671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.848388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.848921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.849520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.889538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d929e5d1-a43e-4fab-8979-19b2046248ed tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.123691 Sep 03 20:53:23.890478 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 623/1245] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:23.903402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:23.917668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:23.940146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.941266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.941916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:23.943778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:23.944621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:23.946163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.141780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:24.157226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-312a5725-3064-4696-b0ad-c43d19ea1748 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.330745 Sep 03 20:53:24.174525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 623/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:24.187838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:24.196827 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b3adfe07-32c8-4eb8-8fcf-584baa12cdd1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.303816 Sep 03 20:53:24.198130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 624/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:23 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:24.601938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:24.603529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:24.627513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.628738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.631412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.635232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.637129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.639522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.799723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:24.800336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:24.814887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.815744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.816360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.817357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.817809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.820025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.906398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:24.931656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:24.933649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:24.939788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2cb20a00-b91d-4c77-b6ce-55b1155b90e7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1281 microversion: 2.25 time: 0.142058 Sep 03 20:53:24.942753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 625/1248] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:24 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:53:24.952557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:24.969925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:24.982772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.983447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.983902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:24.985167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:24.986374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:24.987110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.262070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:25.270624 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ef872e15-47c2-42ae-9352-d874056a5c70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.326273 Sep 03 20:53:25.277008 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 626/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:24 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:25.284865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2bade3a6-f1ea-4899-9082-b3cc3dc8f7f0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6707d430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:25.347397 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2bade3a6-f1ea-4899-9082-b3cc3dc8f7f0 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1422 microversion: 2.1 time: 0.070344 Sep 03 20:53:25.348391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 627/1250] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:25 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:25.360402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:25.361610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:25.377201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.382166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.382166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.383052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.383641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.385756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.583860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:25.592851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eff31737-0b2f-487d-8b71-c64055078136 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.995517 Sep 03 20:53:25.593662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 624/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:24 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:25.598405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:25.599009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:25.605636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.606348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.606980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.615647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.616322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.616962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.645431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:25.656552 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d238463-5c7d-4d67-b7ad-85e605962d18 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.306848 Sep 03 20:53:25.657319 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 628/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:25 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:25.675481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-plugged", "status": "completed", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:25.685576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.686467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.686917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.701288 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] Creating event network-vif-plugged:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:53:25.707915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c7205206-bca2-4497-8480-8bc296936a3c req-897fe6e3-9428-4c7d-bc84-d889ee3bf750 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036549 Sep 03 20:53:25.708963 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 629/1253] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:25.777396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:25.785774 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0790e056-72f8-4b8b-a707-9b7cdaf929a7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.190909 Sep 03 20:53:25.786494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 625/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:25 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:25.970765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:25.971731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:25.979286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.980003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.980449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:25.981177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:25.981632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:25.982055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.044627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.054059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.055536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.056842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ee59434-5e4f-43ec-b04d-2bf6630426fa tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1337 microversion: 2.25 time: 0.091316 Sep 03 20:53:26.057429 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 630/1255] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:25 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1337 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:26.300395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.301049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:26.307724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.308216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.308656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.309396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.309846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.310271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.363933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3a139336-ebf7-4ddf-b575-cf1b392f07b2 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66e704c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.420288 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3a139336-ebf7-4ddf-b575-cf1b392f07b2 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1431 microversion: 2.1 time: 0.060076 Sep 03 20:53:26.430631 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 631/1256] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1431 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:26.435827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d71c2b38-4fa8-43ff-9eb0-86e2417a7f93 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66dc8820>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.463988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.476184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6416e5d5-788b-45a3-a741-b5ad49bdd80f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.180045 Sep 03 20:53:26.489468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 626/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:26.496067 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d71c2b38-4fa8-43ff-9eb0-86e2417a7f93 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 200 len: 1431 microversion: 2.1 time: 0.063922 Sep 03 20:53:26.496622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 632/1258] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 1431 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:26.510183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.510798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:26.516749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.517271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.517711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.518405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.518861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.519287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.615505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.616377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:26.618447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:26.625264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.625750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.626212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.626902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.627361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.627782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.661244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.672753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-feec1e78-e664-4a94-b9b9-5fe84c8eed8f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1465 microversion: 2.1 time: 0.166314 Sep 03 20:53:26.673457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 627/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:26.679491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.680226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:26.686628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.687137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.687741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.688613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.690649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.691366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.834498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.843494 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-040f86b7-5155-4bea-8159-b0184749f7bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.167783 Sep 03 20:53:26.844403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 628/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:26.853702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0862ecfd-6592-4e6b-b319-e0b5fee2a156 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b889dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.858007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:26.869817 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6845faf-15f6-4dca-8371-a22b7d9a1ea1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.258127 Sep 03 20:53:26.870694 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 633/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:26.875401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.876327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:26.882596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.884479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.886412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.887358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:26.888029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:26.888681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:26.899160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0862ecfd-6592-4e6b-b319-e0b5fee2a156 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790" status: 200 len: 784 microversion: 2.1 time: 0.048430 Sep 03 20:53:26.899729 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790 => generated 784 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:26.914585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97d5c291-5ef5-469c-9c57-59613220d341 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:26.922991 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-97d5c291-5ef5-469c-9c57-59613220d341 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012426 Sep 03 20:53:26.923628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 630/1263] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:53:26.935903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4635d95f-def1-4bd6-b962-5f1571a3ccdb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b97eaf0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.127039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:27.142246 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-19d858ef-8c77-4383-88a3-d6fe5eea0698 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.269882 Sep 03 20:53:27.142921 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 634/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:27.147885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.148573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:27.156430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.157036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.157586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.158488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.159014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.159658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.387181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:27.396101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:27.397889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:27.399224 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73aba685-cc3f-43a4-8c43-e4cc6f934e09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.255146 Sep 03 20:53:27.400504 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 635/1265] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:27.420128 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4635d95f-def1-4bd6-b962-5f1571a3ccdb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "DELETE /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 204 len: 0 microversion: 2.1 time: 0.488072 Sep 03 20:53:27.420860 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 631/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:26 2022] DELETE /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:53:27.428947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0de3b36-34b7-4000-8850-878cf526a009 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66dc8310>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.452822 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b0de3b36-34b7-4000-8850-878cf526a009 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] HTTP exception thrown: Image not found. Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0de3b36-34b7-4000-8850-878cf526a009 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Request method failure captured: Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 HTTP/1.1 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE76WVVYpy3aI7nUXrxkTxlZvomHg04cAYhF7WnRsCuoqDdKTjRG7PCKtPuMKCApLn7t6-qE4O5NY_mMFe1P_ih0yr3irUpf3HmtZ6dwrrQSq9M2vEnU_eNytUKNKMXHhIv_OYYw-i5pFbbg89qZvpWVbJCvlzOYl4IGnNx-7JtjT8f0 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:53:27.483285 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_44e122acac834fc2843f725beb5daeff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/44e122acac834fc2843f725beb5daeff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ddb7b29dc8464329abda9836b09b907f Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b589c08a-0026-4766-bbd2-cf3200a87343'} Sep 03 20:53:27.484957 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:53:27.485893 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b589c08a-0026-4766-bbd2-cf3200a87343 Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:53:27.487200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b589c08a-0026-4766-bbd2-cf3200a87343 could not be found. Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:53:27.488601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0de3b36-34b7-4000-8850-878cf526a009 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:27.489862 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0de3b36-34b7-4000-8850-878cf526a009 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 404 len: 62 microversion: 2.1 time: 0.059948 Sep 03 20:53:27.490939 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 636/1267] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 20:53:27.497922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-754909332"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:27.500185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:27.501321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.502036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:27.507651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.508697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.509761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.510487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.511277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.511419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.511419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.511690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.512263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.513118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.513677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.514368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.541402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:27.722950 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc36252f-7323-4721-9ac3-9962a03c7ba8 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "POST /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444/action" status: 202 len: 0 microversion: 2.1 time: 0.228758 Sep 03 20:53:27.723620 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 632/1268] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:27 2022] POST /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:53:27.729820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd", "name": "network-vif-plugged", "status": "completed", "tag": "9d132a32-0a12-45a3-bb6a-b25d42badeeb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:27.741112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:27.748536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.749523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.750106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.751157 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c3204cf0-4f49-4d92-b171-1ac6d2224819 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.253652 Sep 03 20:53:27.752291 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 637/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:27.764081 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] Creating event network-vif-plugged:9d132a32-0a12-45a3-bb6a-b25d42badeeb for instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd on nch1-master-1 Sep 03 20:53:27.765051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-959f9805-e718-4354-ab31-20f2d6122ddb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66e27160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.770039 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b5904f29-80ad-4306-be8a-5895b19a4fb8 req-e0672d88-c63e-4d56-8dc5-6c9be1041b07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044806 Sep 03 20:53:27.772553 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 633/1270] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:27.825193 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-959f9805-e718-4354-ab31-20f2d6122ddb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.071125 Sep 03 20:53:27.837620 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 638/1271] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:27.868974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.869869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:27.876717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.877251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.877887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.878771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.879477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.879909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.896335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:27.896989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:27.915969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.916469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.916929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:27.917634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:27.924054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:27.925782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.116076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.139037 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b583cf1f-2bd5-4ef2-91a7-8eabc0bd15ab tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.275003 Sep 03 20:53:28.139843 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 634/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:28.166819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:28.167450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:28.175612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.177827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.178287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.179018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.180239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.180733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.190197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.201854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98880b36-92d5-4fb7-83e3-69fc8edd0aec tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.309655 Sep 03 20:53:28.203147 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:27 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:28.281245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "tag": "a7600aef-f597-4126-9418-5db497d829db"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:28.297200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.298611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.299293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.314192 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] Creating event network-changed:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch2-master-1 Sep 03 20:53:28.321224 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f98890d6-9556-4346-880f-0ee49d345502 req-1d5722a4-233e-4d35-8224-de7755234916 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043848 Sep 03 20:53:28.322653 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 640/1274] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:53:28.355174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.363291 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e74c8221-9fdf-48ec-a979-4774806ce71d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.201142 Sep 03 20:53:28.363860 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 635/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:28 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:28.425459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:28.426153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:28.433128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.433621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.434262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.434779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.435241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.435694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.640777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.649516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.650979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.652134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a38f2157-bd9e-4adc-98c5-1dd1a2f42dea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.231029 Sep 03 20:53:28.652719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 641/1276] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:28 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:28.774124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:28.774736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:28.781767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.782197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.782636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.783341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:28.783803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:28.784234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:28.806391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:28.844935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d074be9-c0fd-45c1-b168-62d574bcbf3b tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66dc8af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:28.899968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d074be9-c0fd-45c1-b168-62d574bcbf3b tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.059063 Sep 03 20:53:28.900628 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 642/1277] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:28 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:28.963936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:28.971855 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f640487-e789-4a6d-837a-abbcc8454554 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.202139 Sep 03 20:53:28.972422 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 636/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:28 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:29.162101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.162717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:29.168783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.169319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.169763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.170461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.170938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.171353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.224046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.224666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:29.230829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.231327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.231795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.232505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.233030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.233469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.301295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.309011 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e46427af-0e05-4ada-a736-5836962ec5d7 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.151236 Sep 03 20:53:29.309613 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 643/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:29.379688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.386574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.387117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:29.387936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-868fc6dc-5837-4fa4-93b3-1af81e5bce72 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.167799 Sep 03 20:53:29.388517 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 637/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:29.393845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.394343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.394784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.395493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.395982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.396413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.528352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.536083 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56dce37e-931b-4994-a68a-e33c14e07ecc tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.153546 Sep 03 20:53:29.536649 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 644/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:29.677513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.678047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:29.684686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.685215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.685663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.686365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:29.686829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:29.687259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:29.815907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.824363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.825833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:29.832640 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d5feb40-4f29-4ea7-b9ce-e1d68fdbf774 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.153479 Sep 03 20:53:29.832640 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 638/1282] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:29.915919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a3836b4-2197-42cd-bea4-e3bfcf3ec69d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6707d9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.957713 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a3836b4-2197-42cd-bea4-e3bfcf3ec69d tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.046025 Sep 03 20:53:29.958270 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 645/1283] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:29.996234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:29.996954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:30.003085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.003721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.004291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.005094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.005629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.006067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.143228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:30.152041 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b604c9ef-f71a-445e-91f3-32a186f40470 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.160523 Sep 03 20:53:30.152628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 639/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:29 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:30.332715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:30.334079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:30.341191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.341846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.342401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.343432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.343960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.344465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.412191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:30.413232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:30.420614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.421644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.422313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.423780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.424680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.425379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.703631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:30.714496 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e8e1b595-b619-4c1c-b58e-052a013e5127 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.386366 Sep 03 20:53:30.715141 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 646/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:30 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:30.724501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21abe17-0f3a-4cea-bd5c-437fc2a7394d", "name": "network-vif-plugged", "status": "completed", "tag": "d93c3119-2656-48a4-9f21-6856e826e455"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:30.737014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.738049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.739070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.754342 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] Creating event network-vif-plugged:d93c3119-2656-48a4-9f21-6856e826e455 for instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d on nch1-master-1 Sep 03 20:53:30.761808 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-43ae6512-4aea-41c6-b861-a34fd85ab423 req-8d8317cd-2437-4e03-b023-9f7fe0b92905 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044667 Sep 03 20:53:30.763191 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 647/1286] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:30.770873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:30.772033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:30.779356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.780382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.781222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.782340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.783037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.783680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.828318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:30.837890 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58ec145a-ab67-4cf6-acf3-b20c858f1dc7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.429743 Sep 03 20:53:30.838480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 640/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:30 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:30.853492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:30.854266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:30.860691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.861325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.861838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:30.862645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:30.863105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:30.863532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.007221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.015549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.017039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.018171 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ece3f6af-6090-41ea-a6f4-b99c8229c6f6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.170229 Sep 03 20:53:31.018948 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 641/1288] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:30 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:31.023773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1b00f12-8770-48ae-b79f-7b4cdb9a7010 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b88e820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:31.087391 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1b00f12-8770-48ae-b79f-7b4cdb9a7010 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.067611 Sep 03 20:53:31.096746 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 642/1289] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:31 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:31.162651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.171646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6915ce7f-1ff8-4276-a250-c469e2ac9326 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.406931 Sep 03 20:53:31.172310 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 648/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:30 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:31.175438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:31.176104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:31.182451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.182947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.183385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.184120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.184580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.185091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.314093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.322231 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bdf741af-3599-454e-a178-466d36f2585b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.150602 Sep 03 20:53:31.322790 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 643/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:31 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:31.738565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:31.739201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:31.746089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.746588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.747031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.747738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.748203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.748634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.861479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:31.862200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:31.869849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.870345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.870796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.871500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:31.871971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:31.872421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:31.880701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:31.889284 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5f69f031-da46-477b-ac5d-1424731167cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.154559 Sep 03 20:53:31.890028 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 649/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:31 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:32.002677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.011322 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a636d12-1608-4c1b-9bd3-76e43dd2167e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1378 microversion: 2.1 time: 0.153744 Sep 03 20:53:32.011894 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 644/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:31 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1378 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:32.045443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.046061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.052701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.053227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.053669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.054377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.055393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.055825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.105615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afbf6307-ac9e-4614-bb73-b8fd27c36e34 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b88e040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.177335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afbf6307-ac9e-4614-bb73-b8fd27c36e34 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.077577 Sep 03 20:53:32.178644 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:32.202783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.207516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.223721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.224762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.225444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.227022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.227702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.228317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.406094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.416370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.423231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.426857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.429183 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f559123d-438c-4a61-8b35-92f2b8ffa9d2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.387589 Sep 03 20:53:32.430115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:32.432484 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d3b13628-5b1d-454b-ab11-d031bef9e041 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.240086 Sep 03 20:53:32.444918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 646/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:32.445121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.445121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.445121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.445121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.445441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.445441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.445441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.445441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.449859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.452468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.459649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.460097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.461368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.462040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.462754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.465562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.613028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:32.621547 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d346a96-80d5-473f-b03f-8eee874b01a6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1308 microversion: 2.1 time: 0.186819 Sep 03 20:53:32.622136 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 647/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:32.675920 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6348f580-c991-4938-a970-b1c5abe9ff74 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1856 microversion: 2.1 time: 0.244673 Sep 03 20:53:32.676599 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 651/1298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1856 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:32.698946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:32.701500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.707373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.707868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.708313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.709038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.709499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.709929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.734694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lazy-loading 'flavor' on Instance uuid b584970a-cead-49b8-9437-4b62c236be34 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:53:32.746356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Going to try to live migrate instance to nch1-master-1 {{(pid=140520) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:53:32.757224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:32.779392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-unplugged", "status": "completed", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}, {"server_uuid": "09369a26-88c7-46c3-8ac5-99681094633f", "name": "network-vif-plugged", "status": "completed", "tag": "cfd78dac-842a-47de-bd7f-bbb44dd7945c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:32.789805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.790288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.790732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.803899 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Creating event network-vif-unplugged:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:53:32.804457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] Creating event network-vif-plugged:cfd78dac-842a-47de-bd7f-bbb44dd7945c for instance 09369a26-88c7-46c3-8ac5-99681094633f on nch1-master-1 Sep 03 20:53:32.814331 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-849ad5a2-e5b3-450b-819c-cf46bfcace5f req-98555961-5c2b-4e19-80af-3c753ce20dc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038456 Sep 03 20:53:32.815106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 652/1299] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:53:32.911992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:32.912694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:32.919038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.919531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.919971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:32.920667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:32.921342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:32.921769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.105621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.114097 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f77aa4b-7d71-4aec-98fe-a202bfbb37cf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.206245 Sep 03 20:53:33.114690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 653/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:32 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:33.120782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:33.121483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:33.128076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.128706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.129189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.130015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.130911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.131404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.287352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.295267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e1a6160d-90d9-4241-8e3f-c9fe49537b33 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1528 microversion: 2.1 time: 0.179591 Sep 03 20:53:33.295844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 654/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:33 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1528 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:33.320646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fab6c1cc-0358-4f50-bf50-8b01ccb9aa75 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6710f9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:33.371960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:33.381397 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fab6c1cc-0358-4f50-bf50-8b01ccb9aa75 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.071034 Sep 03 20:53:33.381995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 655/1302] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:33 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:33.388616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:33.389715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:33.396467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.397361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.397503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:33.398539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.399680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.400482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.401305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.673604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.682173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-604daaa2-cc1c-44aa-b050-38105af96ffe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1528 microversion: 2.1 time: 0.299153 Sep 03 20:53:33.682973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 656/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:33 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1528 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:33.687659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:33.688295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:33.694110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.694831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.695494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.696193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.696647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.697307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.751447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:33.829142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.837285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.838737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.839846 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f258bb28-6b1c-4a1c-9314-09b577813c28 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.155881 Sep 03 20:53:33.840397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 657/1304] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:33 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:33.845433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:33.846048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:33.852691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.853172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.853613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.854317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:33.854784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:33.855214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:33.988755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:33.996798 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c571acf1-6c17-4e2c-81bc-7c5702f509e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.155398 Sep 03 20:53:34.009558 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 658/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:33 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.018854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.019994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:34.026904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.027708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.028378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.029347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.030209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.030904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.273778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:34.283777 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e34250f-1d38-4742-a4b2-c34649f3b447 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1489 microversion: 2.1 time: 0.272194 Sep 03 20:53:34.285228 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 659/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:34 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1489 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.302324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a7642be6-ff70-4f4d-aa30-755928ddf28d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.322195 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a7642be6-ff70-4f4d-aa30-755928ddf28d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/ad1e8442-2fd1-4252-b901-5f34d89af62d" status: 202 len: 0 microversion: 2.1 time: 0.035448 Sep 03 20:53:34.323215 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 660/1307] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:34 2022] DELETE /compute/v2.1/flavors/ad1e8442-2fd1-4252-b901-5f34d89af62d => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:34.329971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.330594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:34.337394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.337894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.338343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.339062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.339523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.339956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.345254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:34.515866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:34.527048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-478b05cf-46a7-44fa-8d9f-93728e61eafe tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1317 microversion: 2.1 time: 0.200984 Sep 03 20:53:34.527974 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 661/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:34 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.532826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:34.544062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.544609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.545160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.610357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Going to try to stop instance {{(pid=140519) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 20:53:34.666339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9fd032fc-6d43-4430-b860-1f3d1433f08e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd/action" status: 202 len: 0 microversion: 2.1 time: 0.136134 Sep 03 20:53:34.667315 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 662/1309] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:34 2022] POST /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:34.677461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b1b27dc-aa0a-4b67-a8fd-8c0cc02dfc3d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.712320 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b1b27dc-aa0a-4b67-a8fd-8c0cc02dfc3d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039955 Sep 03 20:53:34.712941 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 663/1310] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:53:34 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.717831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c0c0614-e6cd-4dd2-8e89-a355f1b6be51 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae66dc8dc0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.787761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c0c0614-e6cd-4dd2-8e89-a355f1b6be51 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.073761 Sep 03 20:53:34.795685 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 664/1311] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:34 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.795685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:34.797374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:34.806773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.807342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.807824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.808530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.809156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.809615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.973604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:34.982321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a54a692b-0b24-4064-adf4-3d76425a7d89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.192079 Sep 03 20:53:34.983106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 665/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:34 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:34.987990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:34.990518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:34.997493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:34.998358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:34.999028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:34.999979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.000548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.001086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.032731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.039979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Old instance type tempest-test_resize_flavor_-247784661, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 20:53:35.049659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:53:35.050792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:53:35.051367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:53:35.052364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:53:35.052880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:53:35.158063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-39a38f43-a728-4953-8920-f9c1aab78a2c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380/action" status: 202 len: 0 microversion: 2.1 time: 0.173567 Sep 03 20:53:35.158689 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 666/1313] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:34 2022] POST /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:35.163601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-plugged", "status": "completed", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:35.174078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.174550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.174980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.188887 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] Creating event network-vif-plugged:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:53:35.194968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c7b3c634-1da5-47a3-a671-0efd803e728b req-6bbe962e-406b-4206-89a3-f1f89ebf906e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 Sep 03 20:53:35.196173 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 667/1314] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:35.202403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:35.203185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:35.211752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.212834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.213684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.214409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.214875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.215308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.473141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.483231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.484678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.486020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-802b1c53-686f-46a8-9525-ba6634dd15a3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.288945 Sep 03 20:53:35.509576 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 668/1315] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:35 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:35.516304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:35.517114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:35.525953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.526448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.527075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.527911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.528444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.529720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.733681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.744926 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-890842de-5c58-4959-bed4-295facd68338 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.234071 Sep 03 20:53:35.754126 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 669/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:35 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:35.754126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:35.754126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:35.762180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.762180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.762180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.762180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:35.762779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:35.762779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:35.957810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:35.971007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-752e9da7-9a9f-40c1-82f8-09a90064157c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1537 microversion: 2.1 time: 0.223785 Sep 03 20:53:35.985819 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 670/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:35 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:35.993555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:35.994442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:36.001599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.002405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.003066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:36.004055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.004714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.006427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:36.178199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:36.196352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7b13594-5b27-4d5c-a21a-892a0627aede tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 200 len: 1506 microversion: 2.1 time: 0.209041 Sep 03 20:53:36.197532 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 671/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:35 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:36.203071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2764cb9a-bb79-47e6-bd29-79b25b2d545a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6718b430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:36.262874 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2764cb9a-bb79-47e6-bd29-79b25b2d545a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.063913 Sep 03 20:53:36.264072 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 672/1319] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:36 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:36.269122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:36.270260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:36.278634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.279381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.279958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:36.280817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.281582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.282015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:36.589118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:36.603569 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41d8647e-c06b-4b50-812d-fcd764ddae8b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.337893 Sep 03 20:53:36.604296 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 673/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:36 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:36.609182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:36.609797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:36.616606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.628889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.629420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:36.630217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:36.632076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:36.633402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.043234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.052227 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd88beaf-11d7-4530-a3f0-ad6315eb6aa1 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1317 microversion: 2.1 time: 0.446854 Sep 03 20:53:37.053570 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 674/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:36 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:37.058973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.059844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:37.072988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.073627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.074329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.075428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.076118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.076806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.379520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.390129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.391863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.393302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d7368567-dc5c-452d-b72a-4c829e6db560 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.338458 Sep 03 20:53:37.412138 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 675/1322] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:37.422774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.423432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:37.448676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.453489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.454159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.456459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.461077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.461680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.462399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cc662109-9c16-44d9-ba2e-35cf35b4e275 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/action" status: 202 len: 0 microversion: 2.1 time: 4.767185 Sep 03 20:53:37.463574 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 648/1323] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:32 2022] POST /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/action => generated 0 bytes in 4769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:37.470102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.470740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:37.492797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.493342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.499283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.504001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.504544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.505031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.791702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.799792 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c91d79d-2aae-4c50-a715-ce809452e919 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1537 microversion: 2.1 time: 0.334962 Sep 03 20:53:37.804376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 649/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:37.809118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "name": "network-vif-plugged", "status": "completed", "tag": "a7600aef-f597-4126-9418-5db497d829db"}, {"server_uuid": "868e0374-e87b-47bb-b1c6-454b021cb0c7", "name": "network-vif-plugged", "status": "completed", "tag": "6fdb39ff-6197-4b7f-b337-ca2c08b9dbab"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:37.828847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.829831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.830454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.846539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Creating event network-vif-plugged:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch2-master-1 Sep 03 20:53:37.847352 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] Creating event network-vif-plugged:6fdb39ff-6197-4b7f-b337-ca2c08b9dbab for instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 on nch1-master-1 Sep 03 20:53:37.853361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:37.865808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f8c9eaa6-d3c7-4c58-bb16-96a6a897aae0 req-f84bdff0-6c1c-42a2-95ba-18d6e37edb15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060057 Sep 03 20:53:37.866631 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60b8910d-bac6-40ff-bbb7-b1487f7ac56c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.446819 Sep 03 20:53:37.867132 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 650/1325] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:37.878804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e17eda6-5af8-497c-aa00-17e18066444f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b8118b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.886604 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 676/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:37.923396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.924031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:37.950778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.959030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.962206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.963037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:37.963693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:37.965724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:37.969073 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e17eda6-5af8-497c-aa00-17e18066444f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.100345 Sep 03 20:53:37.978928 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 651/1327] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:37.986381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:37.987391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.005941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.008819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.011886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.012986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.013686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.017459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.280399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.290939 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b940d36c-cc3d-4ee1-bc0d-d79004f4c3c0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.308915 Sep 03 20:53:38.292272 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 652/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:38.302561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:38.303441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.317951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.318748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.321152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.322238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.323107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.325221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.361260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.387131 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5263a37b-7433-425a-bf30-b8dbdedf26fc tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.499348 Sep 03 20:53:38.390733 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 677/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:37 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:38.424418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:38.425350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.435050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.435834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.441166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.442367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.443340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.443946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.544139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.552810 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ca89857-4206-4fb7-b7e3-e5ea801fb25c tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1505 microversion: 2.1 time: 0.257535 Sep 03 20:53:38.564213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 653/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:38 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:38.581141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:38.581811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.589395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.590132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.590694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.591504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.592088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.598313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.631305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.640736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.642422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:38.643902 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25e46230-f061-4ce4-b23f-410d15f1471a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.223997 Sep 03 20:53:38.660947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:38.661300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:38.662901 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 678/1331] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:38 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:38.793549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f2fd34e-b13e-4a9a-988b-b27b0cfe67a8 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 204 len: 0 microversion: 2.1 time: 0.216019 Sep 03 20:53:38.794395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 654/1332] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:38 2022] DELETE /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:38.803763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:38.804617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.812560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.813423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.813952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.814773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.815299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.817482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.822984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:38.830312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:38.831213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:38.847804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.849164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.849620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.850351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:38.850815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:38.851772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:38.874393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:38.999879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc82534d-a6b1-4d1b-ab89-48c9f440e69b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 204 len: 0 microversion: 2.1 time: 0.200539 Sep 03 20:53:39.001196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 679/1333] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:38 2022] DELETE /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:39.008391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.009645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:39.019280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.020016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.020534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.021375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.022061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.022600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.053541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.062458 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26b1e943-ce8f-4b77-8f95-4a6f4e00440a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.242775 Sep 03 20:53:39.077473 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 655/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:38 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:39.084243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1fc8e692-4a2d-40ad-b79a-a8593536d77c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b84ca60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.132950 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1fc8e692-4a2d-40ad-b79a-a8593536d77c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.053996 Sep 03 20:53:39.133999 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 656/1335] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:39.139367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.140152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:39.146687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.147426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.148583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.149498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.150130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.150725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.212759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.221646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd39a198-7603-4caf-859f-ec0e33e3ce34 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.218988 Sep 03 20:53:39.222953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 680/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:39.304940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.313778 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2c33968f-c263-4ea4-9d83-996091cb7fe0 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1511 microversion: 2.1 time: 0.178524 Sep 03 20:53:39.314520 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 657/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:39.315031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.315821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:39.323524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.324752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.325473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.326465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.327082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.327671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.417417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.418050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:39.434789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.438375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.438883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.439597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.440073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.440515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.520867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.530770 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e7a76d4-01ee-438a-bcfa-6383568108a7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.220234 Sep 03 20:53:39.532073 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 681/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:39.645931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.655353 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a7a1278a-a144-4217-9b58-d081bd1ed1da tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.242516 Sep 03 20:53:39.656124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 658/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:39.671654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:39.672286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:39.675406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:39.687034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.687535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.687986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.688719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:39.689224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:39.689694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:39.850087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.862186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.863918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:39.865112 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-197504ca-dd98-49a1-a450-d124eabe60d1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1411 microversion: 2.25 time: 0.197817 Sep 03 20:53:39.868952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 682/1340] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:39 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:53:40.088872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.090705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.100469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.101905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.102542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.103351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.103970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.104566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.151413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-845dddee-b62d-47fa-bead-287c2a51a53f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae67147af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.221630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-845dddee-b62d-47fa-bead-287c2a51a53f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.075582 Sep 03 20:53:40.225132 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 683/1341] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:40.250751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.251790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.259453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.259955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.260399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.261157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.261621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.262052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.288940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:40.297049 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d11d8dd8-5ec7-48d4-b0a1-d3e4cc97f27b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.213166 Sep 03 20:53:40.297987 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 659/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:40.341393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.342467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.349483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.350410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.350995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.351986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.352614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.353370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.465565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:40.475311 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-82c15c87-edd5-4766-9da8-1706a197465d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.230378 Sep 03 20:53:40.476404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 684/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:40.555796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:40.561833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.562619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.567206 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12883118-848a-4314-94c5-a75db912d5e5 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1511 microversion: 2.1 time: 0.233119 Sep 03 20:53:40.568288 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 660/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:40.570602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.571268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.571881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.572740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.573402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.573958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.683629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.684624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.692132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.694183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.694183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.694518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.695366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.696798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.736055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:40.747972 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9034ba04-0f15-469b-a2f2-a9f81a0df756 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.196452 Sep 03 20:53:40.760954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 685/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:40.866649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:40.876308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c33c233f-6776-4f6d-a365-5e861f5015d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.196919 Sep 03 20:53:40.888232 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 661/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:40.900426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.901126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:40.901287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.902143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:40.909436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.909888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.910133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.910932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.911676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.912063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.912667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.913376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.914512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.915397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:40.915986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:40.916530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:40.944511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:41.069391 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f2b373e-aed0-4fce-83de-12c4dcdc1758 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 204 len: 0 microversion: 2.1 time: 0.172868 Sep 03 20:53:41.071625 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 686/1347] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:40 2022] DELETE /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:41.091683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.092427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.103363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.103882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.104324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.107894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.108478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.108940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.136440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.152704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.154675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.157236 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26c0c8ff-bb59-4f2b-919b-035dbc087b6c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1608 microversion: 2.25 time: 0.260833 Sep 03 20:53:41.158434 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 662/1348] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:53:40 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1608 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:53:41.187639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.188140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.197055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.197995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.198672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.199392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.199931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.200841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.299097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-483f636f-76ae-4a37-a124-a70045b30df6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.115802 Sep 03 20:53:41.309477 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 663/1349] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:53:41.314792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9cf1feb-7ae7-4c64-a51f-cadb4e501449 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b870c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.358202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.368133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a850860d-9671-4d29-9163-e34a257e812e tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1710 microversion: 2.1 time: 0.285122 Sep 03 20:53:41.374620 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 687/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1710 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:41.379631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.382585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.394812 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9cf1feb-7ae7-4c64-a51f-cadb4e501449 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.063016 Sep 03 20:53:41.404446 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 664/1351] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:41.407014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.407790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.408479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.409512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.410212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.410875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.506356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.507724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.518578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.520229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.521250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.522279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.523865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.524498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.605806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.615442 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3cba6954-9332-4e1b-a5bd-56e79adf79f6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.238554 Sep 03 20:53:41.625508 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 688/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:41.637984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.637984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.645495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.646009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.646482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.647725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.647725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.648619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.820688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.831782 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-236f84cc-d39e-41bd-a1ca-733733d1f01a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1317 microversion: 2.1 time: 0.331559 Sep 03 20:53:41.836460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 665/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:41.852120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.852749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.861737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:41.868154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.868823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.869406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.869836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.870291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.870710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.871779 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4b17b726-1d4a-4461-9126-9f56e358e339 tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1511 microversion: 2.1 time: 0.245040 Sep 03 20:53:41.872581 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 689/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:41.903534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:41.904218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:41.911161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.911792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.912245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:41.913090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:41.913619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:41.914055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.085822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:42.098032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4499c8d3-3b99-4f1a-9674-3c88c788e9d2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.199952 Sep 03 20:53:42.099002 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 690/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:42.402608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:42.403498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:42.413150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.414062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.414705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.415614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.416236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.417135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.511386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:42.527278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-03c0dd56-7f5c-4d2d-bcab-555779a70d62 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.687496 Sep 03 20:53:42.528703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 666/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:41 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:42.541885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f43c161f-f5c4-4a99-9f25-84e062fa97c3 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b88eca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:42.625437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f43c161f-f5c4-4a99-9f25-84e062fa97c3 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.095184 Sep 03 20:53:42.636268 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 667/1357] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:42 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:42.643062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:42.650938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:42.651836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:42.658871 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bcf10027-6f76-4a08-bd60-9bd20dfbc5ed tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1710 microversion: 2.1 time: 0.260987 Sep 03 20:53:42.659472 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 691/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:42 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1710 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:42.662899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.664136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.664760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.665675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.666436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.667036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.865895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:42.867415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:42.874268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.875014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.875641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:42.876537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:42.877185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:42.877776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.073469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:43.086318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-285e8be3-8371-4c04-9417-b36df9c244b9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.439043 Sep 03 20:53:43.086886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 668/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:42 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:43.116409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:43.117485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:43.141717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.142413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.143103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.143982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.144589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.145190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.294863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:43.310800 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fa02fbb5-c133-4c23-99b0-31f7b8f4c9ea tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1467 microversion: 2.1 time: 0.450452 Sep 03 20:53:43.311401 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 692/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:42 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1467 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:43.315918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:43.316537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:43.337915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.347492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.348015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.348786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.349293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.349734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.389362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:43.596150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:43.609184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7602ccec-c7bd-4525-a55a-2de30353641d tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1511 microversion: 2.1 time: 0.504833 Sep 03 20:53:43.611821 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 669/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:43 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:43.624415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:43.626201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:43.641059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.644720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.645410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.662019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:43.662912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:43.664874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:43.970240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:43.979590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4eaffc16-48fd-40c8-b938-6a917c983145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.667146 Sep 03 20:53:43.988549 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 693/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:43 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:43.989088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:43.994884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:43.998228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:44.002656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23ac49aa-fd62-4823-9052-a98d2f9765af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1466 microversion: 2.1 time: 0.389459 Sep 03 20:53:44.004686 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 670/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:43 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:44.010402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.013029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.013648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.014562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.016097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a647b73-08de-4f33-bcb7-6b4bf7acad7a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b8894c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:44.016776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.017406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.086174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a647b73-08de-4f33-bcb7-6b4bf7acad7a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.079768 Sep 03 20:53:44.102043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 671/1364] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:44 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:44.111496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:44.114374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:44.153912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.156241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.160225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.163098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.164329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.165001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.621691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:44.633671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b604e0c-a78f-4745-b100-d1827d78ceeb tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1710 microversion: 2.1 time: 0.530224 Sep 03 20:53:44.636137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 672/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:44 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1710 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:44.641601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-601944314"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:44.644284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:44.660236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.661506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.662189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.663221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.664355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.665049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.903445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:44.916173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-985cabb6-f0a4-4ce9-a108-60c34b955981 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.925381 Sep 03 20:53:44.916847 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 694/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:43 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:44.937035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:44.938870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:44.950081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.954546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.955217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:44.958763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:44.962153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:44.963009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.007708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:45.152284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-927ae914-d0e2-436d-9ec9-0ea88c55a031 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "POST /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f/action" status: 202 len: 0 microversion: 2.1 time: 0.513494 Sep 03 20:53:45.154200 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 673/1367] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:53:44 2022] POST /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:53:45.199173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "tag": "a7600aef-f597-4126-9418-5db497d829db"}, {"server_uuid": "f21abe17-0f3a-4cea-bd5c-437fc2a7394d", "name": "network-vif-deleted", "tag": "d93c3119-2656-48a4-9f21-6856e826e455"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:45.265617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:45.266154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:45.266625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.330711 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Creating event network-changed:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch2-master-1 Sep 03 20:53:45.343092 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] Creating event network-vif-deleted:d93c3119-2656-48a4-9f21-6856e826e455 for instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d on nch1-master-1 Sep 03 20:53:45.367305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-642604be-6207-4df3-a565-2b1bc33f5d5e req-93f652b8-10ad-40bc-a462-7d6c0707b912 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.198599 Sep 03 20:53:45.368676 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 674/1368] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:45.385380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:45.386475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:45.402466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:45.402965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:45.403415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.404144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:45.404608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:45.405078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.611882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:45.626454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2178619e-98d2-4995-a2b6-82a3512bbf8f tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1469 microversion: 2.1 time: 0.253386 Sep 03 20:53:45.651594 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 675/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:45 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:45.664603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:45.665268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:45.675923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:45.676435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:45.676886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.677681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:45.679159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:45.684521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:45.989144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:46.001399 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a66e153f-cbe3-4687-8db5-3f8d1253b766 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 1.079607 Sep 03 20:53:46.004534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 695/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:44 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.028228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a1de379-c630-47df-8f71-3039981584c2 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae674c9a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:46.122464 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a1de379-c630-47df-8f71-3039981584c2 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1426 microversion: 2.1 time: 0.116277 Sep 03 20:53:46.123389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 696/1371] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:46 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.130212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77b1c3c8-d06e-4d43-a5dd-1fc96d912cfb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67146310>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:46.160367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:46.175756 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21438598-a202-4323-aa96-5c94edf37423 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.518958 Sep 03 20:53:46.176977 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 676/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:45 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.187570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:46.188539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:46.207863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.208380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.208828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.212137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.212620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.213148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.251543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77b1c3c8-d06e-4d43-a5dd-1fc96d912cfb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.126239 Sep 03 20:53:46.252450 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 697/1373] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:46 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.277899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:46.280075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:46.292336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.293042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.294858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.295798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.297198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.297817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.363505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:46.376752 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83a950d4-967d-4d56-8f39-56e2af21eff2 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1643 microversion: 2.1 time: 0.198436 Sep 03 20:53:46.377769 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 677/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:46 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1643 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.425739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09369a26-88c7-46c3-8ac5-99681094633f", "name": "network-vif-deleted", "tag": "cfd78dac-842a-47de-bd7f-bbb44dd7945c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:46.482907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.483397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.483835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.497140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] Creating event network-vif-deleted:cfd78dac-842a-47de-bd7f-bbb44dd7945c for instance 09369a26-88c7-46c3-8ac5-99681094633f on nch1-master-1 Sep 03 20:53:46.509743 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-dd68078b-9621-4760-913c-439e30e56746 req-223ece43-a02f-4af9-97b5-49810b30b6d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104387 Sep 03 20:53:46.510408 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 678/1375] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:46.596813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:46.617436 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb636006-5af0-4082-937d-0f552ec621fa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.361976 Sep 03 20:53:46.618898 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 698/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:46 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:46.651888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:46.652610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:46.664628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.665915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.665915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.666364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.666811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.667251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.777582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:46.778088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:46.781053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:46.782069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lazy-loading 'fault' on Instance uuid 09369a26-88c7-46c3-8ac5-99681094633f {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:53:46.873753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86035889fc474973bc31a97989ec26fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55700f621564ad5a52056d7a7854e20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:46.888465 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-18d6f3e2-f409-4e76-ae30-c39ca1821b8b tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 200 len: 1307 microversion: 2.1 time: 0.241915 Sep 03 20:53:46.894319 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 679/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:46 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.029640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.030170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.037597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.038353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.039542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.040736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.041375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.041963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.139311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-299c1322-6f1b-48ee-b955-87e76a690229 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b838280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.539993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:47.544343 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-299c1322-6f1b-48ee-b955-87e76a690229 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1435 microversion: 2.1 time: 0.408548 Sep 03 20:53:47.544924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 680/1378] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1435 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.548390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c7d7f2b-09fe-4f76-a26c-780eb2894711 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.522833 Sep 03 20:53:47.561245 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 699/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.561446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.561446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.561613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1388ea4-9405-4d62-af09-f92c6ecd3d1c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae674c9a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.572381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.572886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.573368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.574184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.574567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.575376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.643156 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a1388ea4-9405-4d62-af09-f92c6ecd3d1c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.090360 Sep 03 20:53:47.643737 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 700/1380] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.654175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.654807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.661450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.661951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.662400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.663116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.663620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.664060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.710532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.711369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.711871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.712540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lazy-loading 'fault' on Instance uuid 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:53:47.723915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:47.733309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c3c90bb2-9376-45c6-9e6e-acdc4da68474 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.177132 Sep 03 20:53:47.734134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 681/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.738923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64fe49d3-7330-4764-9a6f-d00d39772c1c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b9220d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.766569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee0fdf107484448d862ac3216df0d9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cdc132e95244478bf01490de3e0941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:47.775879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-35477f6d-b1d5-48e9-a715-311266bc7601 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 200 len: 1352 microversion: 2.1 time: 0.129978 Sep 03 20:53:47.776460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 701/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.781228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.782271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.789260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.789924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.790519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.791385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.792005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.792433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.794255 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-64fe49d3-7330-4764-9a6f-d00d39772c1c tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 200 len: 1435 microversion: 2.1 time: 0.058894 Sep 03 20:53:47.794992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 682/1383] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 1435 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.809437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.810340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.817407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.818256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.818977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.819936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.820459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.820843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.957654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:47.966956 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0108c5bd-a6eb-48ff-bd1a-c841ddf20730 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.189391 Sep 03 20:53:47.981279 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 702/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:47.987182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:47.988618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: 09369a26-88c7-46c3-8ac5-99681094633f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:47.995374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:47.996360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.996889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.997353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:47.998069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:47.998529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:47.998978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.013758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] HTTP exception thrown: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Request method failure captured: Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f HTTP/1.1 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE76PVi_M9Xd8263brBTwjoCebsVq83Zb1039hZqQQd6iM0Hv6sq-YmTs73ZmPVvNwxHAmEUhppM87P3THGiwONX5DjNyFooMwVJFi2uyjJWa2GMjFB6KamfBbblGSQFT00siZ_yiMVHedldN-FZ2WwwIhqDySdcieKglA-TpZjOEn-I Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: c55700f621564ad5a52056d7a7854e20 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:53:48.015703 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c55700f621564ad5a52056d7a7854e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: c55700f621564ad5a52056d7a7854e20 Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-MultipleCreateTestJSON-2021139544-project Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 86035889fc474973bc31a97989ec26fd Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-MultipleCreateTestJSON-2021139544-project Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. Sep 03 20:53:48.017398 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '09369a26-88c7-46c3-8ac5-99681094633f'} Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:48.018288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. Sep 03 20:53:48.019929 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.021444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ba63987-232b-4a8c-b8e8-a9a51cb7b9bb tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1478 microversion: 2.1 time: 0.212546 Sep 03 20:53:48.021444 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 683/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1478 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:48.022906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Returning 404 to user: Instance 09369a26-88c7-46c3-8ac5-99681094633f could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:48.023774 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8e4acff-0000-4b16-86c2-7de96ed807bf tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f" status: 404 len: 111 microversion: 2.1 time: 0.041021 Sep 03 20:53:48.024507 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 703/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:47 2022] GET /compute/v2.1/servers/09369a26-88c7-46c3-8ac5-99681094633f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:48.034320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.035048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] [instance: f21abe17-0f3a-4cea-bd5c-437fc2a7394d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.042436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.042950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.043469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.044298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.045028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.045763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.063859 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] HTTP exception thrown: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Request method failure captured: Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d HTTP/1.1 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE76PVi_M9Xd8263brBTwjoCebsVq83Zb1039hZqQQd6iM0Hv6sq-YmTs73ZmPVvNwxHAmEUhppM87P3THGiwONX5DjNyFooMwVJFi2uyjJWa2GMjFB6KamfBbblGSQFT00siZ_yiMVHedldN-FZ2WwwIhqDySdcieKglA-TpZjOEn-I Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: c55700f621564ad5a52056d7a7854e20 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:48.065576 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c55700f621564ad5a52056d7a7854e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c55700f621564ad5a52056d7a7854e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: c55700f621564ad5a52056d7a7854e20 Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2021139544 Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MultipleCreateTestJSON-2021139544-project Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 86035889fc474973bc31a97989ec26fd Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MultipleCreateTestJSON-2021139544-project Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. Sep 03 20:53:48.067106 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f21abe17-0f3a-4cea-bd5c-437fc2a7394d'} Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:48.068047 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. Sep 03 20:53:48.069317 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.071212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] Returning 404 to user: Instance f21abe17-0f3a-4cea-bd5c-437fc2a7394d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:48.071212 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c8cdcee-b78a-4178-9c17-4bbfdac2909a tempest-MultipleCreateTestJSON-2021139544 tempest-MultipleCreateTestJSON-2021139544-project] 10.222.0.16 "GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d" status: 404 len: 111 microversion: 2.1 time: 0.036738 Sep 03 20:53:48.072863 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 684/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/f21abe17-0f3a-4cea-bd5c-437fc2a7394d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:48.571687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c", "name": "network-vif-deleted", "tag": "6fb307ff-e272-4c6b-a010-76e4ba966dde"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:48.574598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.575025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.581590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.581919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.582130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.582378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.582612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.583099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.583413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.583609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.583996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.596940 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] Creating event network-vif-deleted:6fb307ff-e272-4c6b-a010-76e4ba966dde for instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c on nch2-master-1 Sep 03 20:53:48.602854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-23a59e06-f20a-4044-a343-25718b501dec req-76dddb76-1e5a-41f9-8e9a-f9de9f0ae134 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035489 Sep 03 20:53:48.603704 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 704/1388] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:48.660283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c044c6a-f115-4614-8e78-1cf010dc8f03 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67147ee0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.719553 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c044c6a-f115-4614-8e78-1cf010dc8f03 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.058305 Sep 03 20:53:48.720358 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 705/1389] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:48.735303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:48.743558 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d88f853-398c-4482-912b-f455691a723f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.174210 Sep 03 20:53:48.744436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 685/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:48.761986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.762732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.769874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.770650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.771094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.771991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.772456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.773645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.799123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.799742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.806679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.807411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.808058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.808988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.809613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.810222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.828100 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c HTTP/1.1 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:48.829687 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:48.831317 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c'} Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:48.832255 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:48.833716 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.836311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:48.837208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9412a02a-876f-4353-af4e-f429c5c050f0 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 404 len: 111 microversion: 2.1 time: 0.041929 Sep 03 20:53:48.837777 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 686/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:53:48.849450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.849450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.854686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.855177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.855623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.856332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.856984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.857622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.872534 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf HTTP/1.1 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:48.875335 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.877101 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '80b96611-6298-451a-9356-63a43f50dbbf'} Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:48.877954 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.879166 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.881364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:48.881364 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b5c4bce-a827-4a54-83a0-09c8930d0b4a tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 404 len: 111 microversion: 2.1 time: 0.035831 Sep 03 20:53:48.885222 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 687/1392] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:48 2022] DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:48.889789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.890409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.896430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.896933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.897384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.898113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:48.898566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:48.898998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:48.914533 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf HTTP/1.1 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:48.916060 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.917695 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '80b96611-6298-451a-9356-63a43f50dbbf'} Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:48.918605 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:48.920079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:48.922437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:48.922437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1bb2e1b-e35d-4924-b428-3b9aada82a14 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 404 len: 111 microversion: 2.1 time: 0.031389 Sep 03 20:53:48.922437 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 688/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:48.926238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-77c377ed-bfa8-4eaa-a360-c0697c72f513 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '.version_select at 0x7fae6b82f940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.946697 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-77c377ed-bfa8-4eaa-a360-c0697c72f513 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425500010" status: 202 len: 0 microversion: 2.1 time: 0.023912 Sep 03 20:53:48.947375 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 689/1394] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 20:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425500010 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:48.992059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:48.992984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:48.993238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:49.001486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.002079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.002763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.003699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.004523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.005270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.009338 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-718a3885-b144-448c-9072-b94b029655d6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.253050 Sep 03 20:53:49.010668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 706/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:49.041899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:49.042843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:49.049758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.050509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.051057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.051874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.052544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.053129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.220241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:49.229038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df964005-40b6-4eac-b380-c279d96ad348 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.241463 Sep 03 20:53:49.230076 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 690/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:48 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:49.345102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:49.365126 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa51a4de-55b6-4e39-95fd-5ebdab79524a tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1465 microversion: 2.1 time: 0.325566 Sep 03 20:53:49.366236 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 707/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:49 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1465 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:49.390528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d784146a-eb62-4902-a56e-4a9a7e33fd10 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b82b310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:49.736454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c698a921-980e-4d26-86fc-1b57c1a618f7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6724faf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:49.825669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c698a921-980e-4d26-86fc-1b57c1a618f7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.092445 Sep 03 20:53:49.827149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 708/1398] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:49 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:49.832401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:49.833278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:49.840747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.841522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.843315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.844229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:49.845066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:49.845660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:49.980335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d784146a-eb62-4902-a56e-4a9a7e33fd10 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "DELETE /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f" status: 204 len: 0 microversion: 2.1 time: 0.594157 Sep 03 20:53:49.984274 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 691/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:49 2022] DELETE /compute/v2.1/images/a466ddd5-6c09-4ffd-8672-2a0fef14747f => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:49.989332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a630703e-806f-4bbb-b38a-37cc9409f1ce tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.013005 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a630703e-806f-4bbb-b38a-37cc9409f1ce tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2054595935" status: 202 len: 0 microversion: 2.1 time: 0.027162 Sep 03 20:53:50.014489 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 692/1400] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:53:49 2022] DELETE /compute/v2.1/flavors/2054595935 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:50.020176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbda0594-2329-4424-ac79-33f86ca5c09f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '.version_select at 0x7fae6b7d0040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.084943 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-fbda0594-2329-4424-ac79-33f86ca5c09f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] HTTP exception thrown: Image not found. Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbda0594-2329-4424-ac79-33f86ca5c09f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Request method failure captured: Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 HTTP/1.1 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE76WVVYpy3aI7nUXrxkTxlZvomHg04cAYhF7WnRsCuoqDdKTjRG7PCKtPuMKCApLn7t6-qE4O5NY_mMFe1P_ih0yr3irUpf3HmtZ6dwrrQSq9M2vEnU_eNytUKNKMXHhIv_OYYw-i5pFbbg89qZvpWVbJCvlzOYl4IGnNx-7JtjT8f0 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:50.088179 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_44e122acac834fc2843f725beb5daeff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/44e122acac834fc2843f725beb5daeff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ddb7b29dc8464329abda9836b09b907f Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b589c08a-0026-4766-bbd2-cf3200a87343'} Sep 03 20:53:50.089973 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b589c08a-0026-4766-bbd2-cf3200a87343 to delete Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.090955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b589c08a-0026-4766-bbd2-cf3200a87343 could not be found. Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:50.094472 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbda0594-2329-4424-ac79-33f86ca5c09f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:50.095689 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fbda0594-2329-4424-ac79-33f86ca5c09f tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "DELETE /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343" status: 404 len: 62 microversion: 2.1 time: 0.076694 Sep 03 20:53:50.097782 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 693/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] DELETE /compute/v2.1/images/b589c08a-0026-4766-bbd2-cf3200a87343 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:53:50.105867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db95e85f-2551-434b-81ce-241918b68113 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.144218 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db95e85f-2551-434b-81ce-241918b68113 tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.045946 Sep 03 20:53:50.144817 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 694/1402] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.146844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:50.167279 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6885b87-9b20-4823-b145-c5023b7c650c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.338801 Sep 03 20:53:50.168006 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 709/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:49 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.170872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.171503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.174886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.175699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.185540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.186371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.186973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.188536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.189183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.190015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.190183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.190528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.192377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.193165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.194925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.197210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.228079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:53:50.341558 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f5fb586-92b4-46c9-9fe9-2cc738e78999 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 204 len: 0 microversion: 2.1 time: 0.171556 Sep 03 20:53:50.344937 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 710/1404] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:50 2022] DELETE /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:53:50.354906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8512baa1-1583-48fd-b133-96f797575efc tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.385050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8512baa1-1583-48fd-b133-96f797575efc tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1260316751" status: 202 len: 0 microversion: 2.1 time: 0.038039 Sep 03 20:53:50.388837 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 711/1405] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:53:50 2022] DELETE /compute/v2.1/flavors/1260316751 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:53:50.404436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.407446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.421387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.422608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.423167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.423467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:50.424123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.424714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.425329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.434666 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aaf8bc55-425c-4d6e-9e15-82cfe60b1115 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.268956 Sep 03 20:53:50.435447 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 695/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.440415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.441068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.447160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.447660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.448106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.449001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.449526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.449966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.610023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:50.622577 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d18c40df-cb5c-407e-86d1-8efca8964ace tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1471 microversion: 2.1 time: 0.185542 Sep 03 20:53:50.636192 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 696/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.647037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e92be9a-dcd8-4f32-88c3-779dd2cf11af tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.669993 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e92be9a-dcd8-4f32-88c3-779dd2cf11af tempest-ServersWithSpecificFlavorTestJSON-1976101342 tempest-ServersWithSpecificFlavorTestJSON-1976101342-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032370 Sep 03 20:53:50.683886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 697/1408] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.698831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.699354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.706394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.706901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.707348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.708066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.708525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.708976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.736388 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c HTTP/1.1 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:50.738389 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.740051 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c'} Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:50.740966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.742467 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.744041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:50.744041 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b7f19de-3ab3-4b3f-982d-59d392a62fe3 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 404 len: 111 microversion: 2.1 time: 0.048084 Sep 03 20:53:50.744041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 698/1409] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:50 2022] DELETE /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:53:50.754642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.755387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.760736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:50.768114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.768737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.769308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.770419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.770982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.771508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.792687 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c HTTP/1.1 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:50.794475 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.796123 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c'} Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:50.797059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. Sep 03 20:53:50.798863 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.801638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:50.802149 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39de94a2-575c-418e-8259-3540c21e6a22 tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c" status: 404 len: 111 microversion: 2.1 time: 0.055969 Sep 03 20:53:50.803013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 699/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/servers/2f6c8e9d-3dc1-4492-88c7-1b0fcea4641c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:50.818711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:50.829535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ef63fd59-a86f-4dc3-b7ac-922c79b27ef0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.439068 Sep 03 20:53:50.831590 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 712/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.854120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91486006-dd22-48ab-8498-2ea50ae9b3e0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66e27040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.864675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.865470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.874336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.877459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.877941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.878720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.880552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.881029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.901463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf HTTP/1.1 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:50.903320 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.904883 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '80b96611-6298-451a-9356-63a43f50dbbf'} Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:50.905689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.907300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.916492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:50.917582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0ba73b1-17b2-4e75-82c1-b9b0a084d4ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 404 len: 111 microversion: 2.1 time: 0.071621 Sep 03 20:53:50.921472 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 700/1412] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:53:50 2022] DELETE /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:50.935850 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91486006-dd22-48ab-8498-2ea50ae9b3e0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.088439 Sep 03 20:53:50.937120 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 713/1413] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:50.937377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:50.938388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] [instance: 80b96611-6298-451a-9356-63a43f50dbbf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:50.949694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.950197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.950850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.951572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:50.952030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:50.952587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:50.970563 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] HTTP exception thrown: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Request method failure captured: Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf HTTP/1.1 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74CFqdA7Cr7ruJqq4k0NO7Qy6wt6_Mnq4KKYLTE7ZlQHxB9GPw5StLDNUoaaWcOD-FuA__O9GhPqtiStxSzwwO3I--E8m4Y-gCNKMNyzv_6esm-9LgbdNQ8lGWBtGxO2QD7aiK4gqbzCDLjY9TZSJztkEmTbrwCYSkIu_GJ5Vbwrj0 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:50.972178 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_68cdc132e95244478bf01490de3e0941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/68cdc132e95244478bf01490de3e0941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/68cdc132e95244478bf01490de3e0941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 68cdc132e95244478bf01490de3e0941 Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604 Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ee0fdf107484448d862ac3216df0d9dc Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1300489604-project Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.973897 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '80b96611-6298-451a-9356-63a43f50dbbf'} Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:50.974776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. Sep 03 20:53:50.976421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:50.977802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] Returning 404 to user: Instance 80b96611-6298-451a-9356-63a43f50dbbf could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:50.977802 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c64abd7-ea48-4631-b7c5-db770ef0d5ba tempest-ServersWithSpecificFlavorTestJSON-1300489604 tempest-ServersWithSpecificFlavorTestJSON-1300489604-project] 10.222.0.16 "GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf" status: 404 len: 111 microversion: 2.1 time: 0.050909 Sep 03 20:53:50.978473 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 701/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:50 2022] GET /compute/v2.1/servers/80b96611-6298-451a-9356-63a43f50dbbf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:53:51.196434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:51.197324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:51.208553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.211052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.212685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.215971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.218890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.219455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.463350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:51.464203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:51.473554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.476498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.477109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.477947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.480954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.481476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.523930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:51.534170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d274c01-d3e0-40bb-addb-fadf4e598ba5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.344296 Sep 03 20:53:51.537720 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 714/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:51 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:51.647742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:51.650179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:51.676494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.677213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.677681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.678441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.686257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.687770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.755352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:51.768583 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fdbdb94e-9286-45c6-9ac6-b5b15f0fbcf4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.308996 Sep 03 20:53:51.773355 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 702/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:51 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:51.794520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-plugged", "status": "completed", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:51.835850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.839049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.849206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.895290 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] Creating event network-vif-plugged:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:53:51.907808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-085b4a51-a86f-4c52-82c1-662104259aee req-c0b6a783-28af-42f5-9b7e-b10441f4c193 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122493 Sep 03 20:53:51.910950 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 703/1417] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:53:51.924622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "name": "network-vif-unplugged", "status": "completed", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:51.956059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:51.956852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:51.957519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:51.983454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] Creating event network-vif-unplugged:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch2-master-1 Sep 03 20:53:51.992132 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1491fd12-7391-4851-bbe5-f480e57a5aff req-cb54122d-c9df-42cb-90c5-d10f8ad4a1a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079717 Sep 03 20:53:51.995464 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 704/1418] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:52.009150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:52.010121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:52.024644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:52.029460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:52.037192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:52.038345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:52.039739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:52.040435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:52.046404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:52.993974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:53.002629 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e4a4363-7502-4880-ac32-e8fe1a170c9e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 1.004004 Sep 03 20:53:53.006467 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 705/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:51 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:53.016453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e57c759c-f257-44df-acf2-2b33e00d6ce5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d0940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:53.097338 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e57c759c-f257-44df-acf2-2b33e00d6ce5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.088905 Sep 03 20:53:53.098199 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 706/1420] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:53 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:53.103966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:53.104786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:53.137302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:53.138304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:53.138304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:53.138955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:53.139421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:53.139855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:53.204638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:53.218146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-266cbb8d-0124-4d1e-8fa6-c1fa901d3b31 tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1471 microversion: 2.1 time: 1.569978 Sep 03 20:53:53.228965 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 715/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:51 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1471 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:53.228965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:53.229414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:53.249807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:53.250308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:53.250748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:53.251460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:53.251914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:53.252339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:53.305668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:53.666369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:53.682756 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a921a9fb-12d3-416a-ba11-8e240a3d27e4 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.459832 Sep 03 20:53:53.684587 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 716/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:53 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:53.691183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:53.694061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-deleted", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:53.703038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fce2b470-666d-4c5a-a7db-bcf5cd8c57b2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.600515 Sep 03 20:53:53.706597 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 707/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:53 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:53.734108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:53.734604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:53.735046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:53.753195 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] Creating event network-vif-deleted:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:53:53.763393 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fe08ce5e-ed48-4aae-8103-175c189f070c req-8d447520-da9c-42d5-967d-959158dc3a51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072269 Sep 03 20:53:53.764823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 717/1424] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:53.995299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea77c7d-0f6a-4ef1-af7e-a209234bf444", "name": "network-vif-unplugged", "status": "completed", "tag": "e43980f9-7a73-4920-bb08-9b8a7c52a291"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:54.024181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.024664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.034471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:54.035183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:54.043842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.045335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.047491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.052777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.053490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.055618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.057455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.146728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] Creating event network-vif-unplugged:e43980f9-7a73-4920-bb08-9b8a7c52a291 for instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 on nch2-master-1 Sep 03 20:53:54.156658 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4a5f0743-f969-410a-82f9-bcfb9bae2f80 req-6f01eda2-6a2b-4642-9182-d20bae9ebe41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167199 Sep 03 20:53:54.157763 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 708/1425] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:54.165924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:54.218121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.231144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.238513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.262022 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] Creating event network-changed:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch2-master-1 Sep 03 20:53:54.274447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a78b1ae1-d2fc-4ac7-afa3-0ded50034695 req-ff0b0a25-7872-495c-9296-88952bc2c343 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112772 Sep 03 20:53:54.279670 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 709/1426] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:53:54.286957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34d96c81-e4a6-483e-903a-0f38828e3dd7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7a53a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:54.430334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:54.440753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-34d96c81-e4a6-483e-903a-0f38828e3dd7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.159291 Sep 03 20:53:54.441486 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 710/1427] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:54 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:54.443680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4ab66468-e08b-4d8e-a56c-42f967fd720f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.414118 Sep 03 20:53:54.452791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:54.461361 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 718/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:54 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:54.465889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:54.477256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.477762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.478209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.478931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.486692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.488293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.584923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.586305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.586938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.587558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lazy-loading 'fault' on Instance uuid cea77c7d-0f6a-4ef1-af7e-a209234bf444 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:53:54.712588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:54.713586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:54.724492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.731627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.733700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.735066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.735520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.737369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.790228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb7b29dc8464329abda9836b09b907f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e122acac834fc2843f725beb5daeff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:54.802276 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f0e159f-4a0a-4ece-a387-ce14f5d82d8e tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 200 len: 1306 microversion: 2.1 time: 0.359832 Sep 03 20:53:54.803478 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 711/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:54 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 1306 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:54.808436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:54.809326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:54.816991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.818014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.818962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.820504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:54.821531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:54.822256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:54.939419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:54.965211 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9185c79f-b9db-4b4d-8fe7-ea5dce35ef4b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.257244 Sep 03 20:53:54.973612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 719/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:54 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:55.332140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:55.352642 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-176606ac-b6f0-41ae-8f6d-ec6f2363ebcc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.545581 Sep 03 20:53:55.353757 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 712/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:54 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:55.458826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18441293-22ee-490c-99dc-3db6bcc4927a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67147700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:55.468032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:55.468719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:55.478843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:55.492978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:55.493550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:55.494326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:55.494809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:55.495242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:55.552143 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18441293-22ee-490c-99dc-3db6bcc4927a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.099082 Sep 03 20:53:55.553064 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 720/1432] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:55 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:55.830012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:55.831434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] [instance: cea77c7d-0f6a-4ef1-af7e-a209234bf444] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:55.846038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:55.846901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:55.849220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:55.850177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:55.851069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:55.852610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:55.899802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] HTTP exception thrown: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Request method failure captured: Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 HTTP/1.1 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE76WVVYpy3aI7nUXrxkTxlZvomHg04cAYhF7WnRsCuoqDdKTjRG7PCKtPuMKCApLn7t6-qE4O5NY_mMFe1P_ih0yr3irUpf3HmtZ6dwrrQSq9M2vEnU_eNytUKNKMXHhIv_OYYw-i5pFbbg89qZvpWVbJCvlzOYl4IGnNx-7JtjT8f0 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:53:55.901611 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_44e122acac834fc2843f725beb5daeff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/44e122acac834fc2843f725beb5daeff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/44e122acac834fc2843f725beb5daeff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 44e122acac834fc2843f725beb5daeff Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-780282386 Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ddb7b29dc8464329abda9836b09b907f Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerTestJSON-780282386-project Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. Sep 03 20:53:55.903110 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'cea77c7d-0f6a-4ef1-af7e-a209234bf444'} Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:55.903948 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. Sep 03 20:53:55.905355 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:55.906453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] Returning 404 to user: Instance cea77c7d-0f6a-4ef1-af7e-a209234bf444 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:55.906453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aef80c4d-c8ae-4295-8376-2c2753fbfbbd tempest-ImagesOneServerTestJSON-780282386 tempest-ImagesOneServerTestJSON-780282386-project] 10.222.0.16 "GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444" status: 404 len: 111 microversion: 2.1 time: 0.077800 Sep 03 20:53:55.906601 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 721/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:55 2022] GET /compute/v2.1/servers/cea77c7d-0f6a-4ef1-af7e-a209234bf444 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:53:55.925585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:55.937251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d7c6438-44e3-4669-8ffc-bd77a3c84a70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.473671 Sep 03 20:53:55.942554 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 713/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:55 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:56.002177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:56.002821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:56.016708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.017655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.020359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.022306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.024784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.027780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.378352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:56.381401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:56.390231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.391069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.391755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.392694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.393397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.394088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.673664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:56.690490 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bfb41fe-2df7-49d9-9d81-9561634c49dd tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.315853 Sep 03 20:53:56.691663 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 714/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:56 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:56.744733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:56.759198 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6917b45-def4-4697-98a7-08ace353751d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.762764 Sep 03 20:53:56.763169 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 722/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:55 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:56.769775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5555d5f6-8828-4e59-8d6a-8f5f0ff2fa80 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae672955e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:56.858826 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5555d5f6-8828-4e59-8d6a-8f5f0ff2fa80 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.093750 Sep 03 20:53:56.859690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 723/1437] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:56 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:56.967308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:56.968197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:56.975271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.975839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.976450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.977680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:56.978377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:56.979068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:56.995632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc314dd2-2c97-40c3-bb9c-cdcc582eabbe tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1561734232", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:57.028553 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-dc314dd2-2c97-40c3-bb9c-cdcc582eabbe tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] HTTP exception thrown: min_count must be <= max_count Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc314dd2-2c97-40c3-bb9c-cdcc582eabbe tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Request method failure captured: Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 184 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE77kqNtt9R732_FLqHiRwfgHwtm6Wn7Mk70j4BGpEY3zIjuxdq8Vfw_pqHFwZ1bn256TyR4_Cl-4sRC4DxE95OPwX4Bj9hpSyIRCsArks5XG3sX4OtZwYJlzBsquaScJBeP6URCYl6G63PbnCzZkpDY6l1oINAIzeP3nSQd7NojNVwQ Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:57.036926 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 761d28842ab9456fb877864cac93fbbc Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:53:57.038764 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1561734232", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: exception: min_count must be <= max_count Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1561734232', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:53:57.040044 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 03 20:53:57.041300 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.046600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc314dd2-2c97-40c3-bb9c-cdcc582eabbe tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Returning 400 to user: min_count must be <= max_count {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:57.047661 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc314dd2-2c97-40c3-bb9c-cdcc582eabbe tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.355062 Sep 03 20:53:57.058972 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 715/1438] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:56 2022] POST /compute/v2.1/servers => generated 74 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:53:57.210279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59e7d1a7-c933-4c42-9e0d-0c486c2d3b7f tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-968233679", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "max_count": 0}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59e7d1a7-c933-4c42-9e0d-0c486c2d3b7f tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Request method failure captured: Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 167 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE77kqNtt9R732_FLqHiRwfgHwtm6Wn7Mk70j4BGpEY3zIjuxdq8Vfw_pqHFwZ1bn256TyR4_Cl-4sRC4DxE95OPwX4Bj9hpSyIRCsArks5XG3sX4OtZwYJlzBsquaScJBeP6URCYl6G63PbnCzZkpDY6l1oINAIzeP3nSQd7NojNVwQ Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:57.234720 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 761d28842ab9456fb877864cac93fbbc Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:53:57.236202 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-968233679", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "max_count": 0}} Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-968233679', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'max_count': 0}}} Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 0 Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.236940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.238425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.239616 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.248887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59e7d1a7-c933-4c42-9e0d-0c486c2d3b7f tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:57.249820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59e7d1a7-c933-4c42-9e0d-0c486c2d3b7f tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.045038 Sep 03 20:53:57.250402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 716/1439] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:53:57.516945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c13f0555-2acb-47a1-bc2f-a69cf6f4f090 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2042653100", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "max_count": 2.5}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c13f0555-2acb-47a1-bc2f-a69cf6f4f090 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Request method failure captured: Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 170 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE77kqNtt9R732_FLqHiRwfgHwtm6Wn7Mk70j4BGpEY3zIjuxdq8Vfw_pqHFwZ1bn256TyR4_Cl-4sRC4DxE95OPwX4Bj9hpSyIRCsArks5XG3sX4OtZwYJlzBsquaScJBeP6URCYl6G63PbnCzZkpDY6l1oINAIzeP3nSQd7NojNVwQ Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:57.521658 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 761d28842ab9456fb877864cac93fbbc Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:53:57.523082 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2042653100", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "max_count": 2.5}} Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2042653100', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'max_count': 2.5}}} Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 2.5 Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.523780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.525280 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.526438 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.528834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c13f0555-2acb-47a1-bc2f-a69cf6f4f090 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:57.530000 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c13f0555-2acb-47a1-bc2f-a69cf6f4f090 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018435 Sep 03 20:53:57.531067 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 717/1440] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 20:53:57.580878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:57.589976 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80b6b30d-83e6-4f8c-848b-cd166641c6ee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.626534 Sep 03 20:53:57.595523 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 724/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:56 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:57.638855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee24a32c-7faf-415a-a54f-023cd3587d89 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1274472963", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 0}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee24a32c-7faf-415a-a54f-023cd3587d89 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Request method failure captured: Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 168 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE77kqNtt9R732_FLqHiRwfgHwtm6Wn7Mk70j4BGpEY3zIjuxdq8Vfw_pqHFwZ1bn256TyR4_Cl-4sRC4DxE95OPwX4Bj9hpSyIRCsArks5XG3sX4OtZwYJlzBsquaScJBeP6URCYl6G63PbnCzZkpDY6l1oINAIzeP3nSQd7NojNVwQ Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:53:57.643919 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 761d28842ab9456fb877864cac93fbbc Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:53:57.645359 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1274472963", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 0}} Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1274472963', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'min_count': 0}}} Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 0 Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.646060 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.647526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 03 20:53:57.648763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.652493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee24a32c-7faf-415a-a54f-023cd3587d89 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:57.654497 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ee24a32c-7faf-415a-a54f-023cd3587d89 tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.042065 Sep 03 20:53:57.655581 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 718/1442] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:53:57.720595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f027f41f-8488-47f0-800f-af969e00adcb tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-485938145", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 2.5}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:53:57.723897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:57.727837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f027f41f-8488-47f0-800f-af969e00adcb tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Request method failure captured: Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 169 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE77kqNtt9R732_FLqHiRwfgHwtm6Wn7Mk70j4BGpEY3zIjuxdq8Vfw_pqHFwZ1bn256TyR4_Cl-4sRC4DxE95OPwX4Bj9hpSyIRCsArks5XG3sX4OtZwYJlzBsquaScJBeP6URCYl6G63PbnCzZkpDY6l1oINAIzeP3nSQd7NojNVwQ Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:53:57.740368 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b635bf0f5f24567b72a5f02ea6a57a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5b635bf0f5f24567b72a5f02ea6a57a8 Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2079202900 Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 761d28842ab9456fb877864cac93fbbc Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2079202900-project Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:53:57.742350 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-485938145", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 2.5}} Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-485938145', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'min_count': 2.5}}} Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 2.5 Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.743051 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.744441 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f027f41f-8488-47f0-800f-af969e00adcb tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f027f41f-8488-47f0-800f-af969e00adcb tempest-MultipleCreateNegativeTestJSON-2079202900 tempest-MultipleCreateNegativeTestJSON-2079202900-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035239 Sep 03 20:53:57.750002 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 725/1443] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:53:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:53:57.760218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:57.761653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:57.762330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:57.764635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:57.765549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:57.766231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:57.794781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:57.794977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:57.813925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:57.814967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:57.821805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:57.824168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:57.824923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:57.828567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:58.233530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:58.254653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72ce8d2a-1457-42f6-a046-014d7174ddce tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.542515 Sep 03 20:53:58.262495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 719/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:57 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:58.276086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f99cffe2-0c6a-4454-aed4-c3ebec0509a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b73da60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:58.405271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f99cffe2-0c6a-4454-aed4-c3ebec0509a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.141330 Sep 03 20:53:58.406369 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 720/1445] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:58 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:58.527137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:58.544287 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-19af34f3-76b2-4a2c-808d-a8187ef33c99 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.757738 Sep 03 20:53:58.547107 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 726/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:57 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:53:58.620468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:58.621179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:58.648120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:58.648728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:58.649215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:58.650041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:58.650475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:58.650873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:59.059213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:59.081510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5622b73-51ea-44e9-9cf0-917af0cc5bd6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.467595 Sep 03 20:53:59.103467 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 721/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:58 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:59.281909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:59.283270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:59.298209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:59.303220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:59.307254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:59.308262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:59.311138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:59.313920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:59.421963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a7e0e831-ea01-4501-9e06-691289fbdd99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b73daf0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:59.510140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a7e0e831-ea01-4501-9e06-691289fbdd99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.092774 Sep 03 20:53:59.521255 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 722/1448] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:53:59 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:59.576543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:53:59.579439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:53:59.590168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:59.592099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:59.593511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:59.594468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:53:59.595154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:53:59.595804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:53:59.733434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:59.744720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ac97a94-4676-4947-a826-9a417da2a597 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.466746 Sep 03 20:53:59.745870 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 727/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:59 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:53:59.869674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:53:59.886264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-27d896d5-af7b-41f1-bbbc-9876f429b727 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.319059 Sep 03 20:53:59.901504 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 723/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:53:59 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:00.114746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:00.115782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:00.148984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.150978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.151709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:00.153400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.154271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.155451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:00.368198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:00.377826 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a6997924-e05a-4264-8dd5-b6115c2663f6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.271123 Sep 03 20:54:00.379240 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 728/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:00 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:00.526101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d721fbc5-1a3b-45aa-b66f-9958d69cabd3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b73d430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:00.601185 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d721fbc5-1a3b-45aa-b66f-9958d69cabd3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.079422 Sep 03 20:54:00.602322 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 724/1452] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:00 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:00.767644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:00.768559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:00.784115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.785575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.786234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:00.787130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.787765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.788886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:00.915345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:00.916702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:00.924845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.932060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.932795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:00.933818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:00.937758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:00.938533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:01.053533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:01.068119 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1961f64-717a-4ca1-9bf3-0d02119f9ab8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.304301 Sep 03 20:54:01.069377 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 729/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:00 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:01.402112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:01.403521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:01.412760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:01.419271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:01.420086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:01.421102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:01.421815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:01.422488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:01.769521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:01.797402 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3509e529-fd51-4662-afe8-b6be9ca1b574 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.398680 Sep 03 20:54:01.800958 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 730/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:01 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:01.813102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40497e6a-e1d7-4dd1-8af1-8121717ba3dd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae673434c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:01.914048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40497e6a-e1d7-4dd1-8af1-8121717ba3dd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.110482 Sep 03 20:54:01.915379 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 731/1455] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:01 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:01.920063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:01.935924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e825469d-c1c2-44ff-98ba-93fc54dde2eb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 1.023634 Sep 03 20:54:01.937959 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 725/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:00 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:02.116484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:02.120525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:02.135970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:02.136806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:02.139013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:02.139938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:02.142260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:02.150634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:02.824208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:02.825127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:02.843168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:02.852780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:02.856800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:02.859385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:02.859726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:02.867029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:02.992257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:03.009440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-33c8285f-7f43-4cbe-b2a9-5d9eb4061828 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.900816 Sep 03 20:54:03.014647 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 732/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:02 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:03.023279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-061d8aee-0c1e-4ece-9574-24d2f2602f79 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67222d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:03.153022 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-061d8aee-0c1e-4ece-9574-24d2f2602f79 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.131395 Sep 03 20:54:03.154375 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 733/1458] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:03 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:03.170858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:03.172389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:03.190570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:03.192424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:03.199813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:03.201048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:03.204276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:03.205003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:03.566074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:03.595613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df687329-2247-434d-bc11-9ec1568285ed tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.775653 Sep 03 20:54:03.598542 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 726/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:02 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:04.044346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:04.045365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:04.057279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:04.058331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:04.061950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:04.062832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:04.063415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:04.063956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:04.648284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:04.664729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-19604589-648a-468e-bc4b-a9793d106482 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 1.505390 Sep 03 20:54:04.667494 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 734/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:03 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:04.677676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bf0ca9b-69cc-48e5-a6a2-0227eb4ce1c8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae676a9310>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:04.797453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7bf0ca9b-69cc-48e5-a6a2-0227eb4ce1c8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.123458 Sep 03 20:54:04.798317 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 735/1461] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:04 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:04.810865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:04.826845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:04.837564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:04.875472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:04.876120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:04.876572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:04.880379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:04.884202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:04.887381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:04.952249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:04.975683 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d58c77f-e1db-476f-9b49-cc118e61073f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.935769 Sep 03 20:54:04.978670 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 727/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:04 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:05.607120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:05.615945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81dffd82-33e8-47a9-8b9d-8334babf3ff9 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.816447 Sep 03 20:54:05.622793 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 736/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:04 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:05.696647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:05.697330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:05.713577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:05.714605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:05.715261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:05.716199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:05.717432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:05.720455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:05.817828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e9d1c9a-b4e7-440c-9417-ed3c215cd191 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae678edee0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:05.915581 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e9d1c9a-b4e7-440c-9417-ed3c215cd191 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.104853 Sep 03 20:54:05.929860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 737/1464] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:05 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:05.999702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:06.000644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:06.014064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:06.017121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:06.019014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:06.019954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:06.022263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:06.029900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:06.524824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:06.542070 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5ba40d09-be27-4c52-9da5-f3c576827dd4 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.546315 Sep 03 20:54:06.564363 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 738/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:05 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:06.654470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:06.655101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:06.703932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:06.719069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:06.719870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:06.723525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:06.734817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:06.735452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:07.117595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:07.153225 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-405d50d2-10ed-4a48-a86f-bd45c7a67fa2 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 1.449640 Sep 03 20:54:07.156099 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 728/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:05 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:07.181556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d5b1a27-1b3e-4080-8cac-caf6fa602aaa tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d0940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:07.269587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d5b1a27-1b3e-4080-8cac-caf6fa602aaa tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.109261 Sep 03 20:54:07.281620 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 729/1467] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:07 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:07.491014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:07.501558 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7bccef2-8e83-4aa5-b85e-cdfd5ee60a77 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1499 microversion: 2.1 time: 0.855639 Sep 03 20:54:07.525995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 739/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:06 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1499 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:07.572213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:07.573416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:07.601779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:07.603050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:07.604183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:07.608389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:07.609345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:07.613161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:08.182558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:08.183357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:08.197874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:08.198408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:08.198880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:08.199717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:08.200209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:08.200678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:08.204482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:08.219949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae63d0a8-aa0e-446a-8e52-81e29b4039ba tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.651554 Sep 03 20:54:08.223362 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 730/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:07 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:08.290052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afe0daf3-1008-4e9b-b8a6-ca0215d78288 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b751160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:08.388215 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afe0daf3-1008-4e9b-b8a6-ca0215d78288 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.102906 Sep 03 20:54:08.397871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 731/1470] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:08 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:08.541698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:08.542264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:08.559117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:08.560988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:08.561684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:08.562603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:08.563281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:08.565090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:08.704278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:08.713408 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88b5f596-155f-4a1e-979c-69ed8dbe2643 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.535240 Sep 03 20:54:08.729273 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 740/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:08 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:09.222834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:09.237610 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-620c2719-1ede-4b22-84fb-5077120bfca6 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 200 len: 1476 microversion: 2.1 time: 0.700474 Sep 03 20:54:09.252043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 732/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:08 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 1476 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:09.267252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:09.268845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:09.273994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1033607415"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:09.280241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:09.287547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.288566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.290727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.291407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.292323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:09.293307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.294291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.295085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:09.297958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:09.298900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.301468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.304520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:09.349601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:09.359458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:09.695720 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bcb01a93-d127-4057-a462-43419c8f3429 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd/action" status: 202 len: 0 microversion: 2.1 time: 0.432722 Sep 03 20:54:09.704398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 733/1473] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:09 2022] POST /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:54:09.716966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38c04833-313f-4830-b175-430a36a7dcdb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d04c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:09.803916 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38c04833-313f-4830-b175-430a36a7dcdb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.097410 Sep 03 20:54:09.806494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 734/1474] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:09 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:09.818110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9916e51a-f900-475d-a9ba-d28b3a25ae4b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b88e0d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:09.905242 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9916e51a-f900-475d-a9ba-d28b3a25ae4b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.097692 Sep 03 20:54:09.914112 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 735/1475] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:09 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:09.919565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:09.920367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:09.927858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.928416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.929436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:09.930170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:09.930717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:09.931095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:10.272127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:10.284500 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9fa89305-67c2-4491-a2ca-ce767c977b49 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 1.021430 Sep 03 20:54:10.312377 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 741/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:09 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:10.536568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:10.569523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d11372f-3fb4-48fc-ab63-3cb1bdb8d854 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.651298 Sep 03 20:54:10.574353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 736/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:09 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:10.823600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd2bfe62-6545-4495-9256-9e3517b2c365 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6707d8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:10.923428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d2fbefd-dd57-4360-bb65-0ba54778b7da tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7d01f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:10.923923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd2bfe62-6545-4495-9256-9e3517b2c365 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.105764 Sep 03 20:54:10.924805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 742/1478] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:10 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:11.014715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d2fbefd-dd57-4360-bb65-0ba54778b7da tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.096611 Sep 03 20:54:11.018463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 737/1479] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:10 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:11.322585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:11.323961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:11.349619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:11.353607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:11.355085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:11.361644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:11.362462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:11.370650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:11.595106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:11.595792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:11.627451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:11.632768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:11.636619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:11.640442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:11.640879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:11.641364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:11.974865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:11.984419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e0e9c3a-47d8-417f-b720-87e9168cdc39 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1542 microversion: 2.1 time: 0.668380 Sep 03 20:54:12.008035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 743/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:11 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1542 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:12.014497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-355af00c-a02d-47d4-90da-b17437f7cefa tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67147f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:12.090954 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-355af00c-a02d-47d4-90da-b17437f7cefa tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1452 microversion: 2.1 time: 0.078583 Sep 03 20:54:12.104773 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 744/1481] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:12 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:12.110700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-61f718ed-d871-4dc7-95e4-e2ef75881d49 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66e6fd30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:12.209150 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-61f718ed-d871-4dc7-95e4-e2ef75881d49 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.102856 Sep 03 20:54:12.212174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 745/1482] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:12 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:12.352587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:12.368737 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b71e430-de3f-429e-86a2-3b460bd95f7c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1715 microversion: 2.1 time: 0.777412 Sep 03 20:54:12.371023 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 738/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:11 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1715 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:13.014906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:13.017423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:13.028583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:13.033452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:13.034598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:13.035544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:13.036178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:13.038507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:13.246575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-686227707", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "6233c6b9-6d19-495f-97e8-118b2a607de6"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:13.333706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] validate_networks() for [('6233c6b9-6d19-495f-97e8-118b2a607de6', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:54:14.581468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:14.593911 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4093e11d-0347-4817-adf7-60c0805dfd59 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1541 microversion: 2.1 time: 1.582767 Sep 03 20:54:14.609735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 739/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:13 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1541 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:14.623137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98135321-0797-4257-a791-a85b458b336d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d0280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:14.638177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:54:14.638639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:54:14.639424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:54:14.639889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:54:14.640338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:54:14.666504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:14.667331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:14.667945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:14.668980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:14.669641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:14.670264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:14.705531 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98135321-0797-4257-a791-a85b458b336d tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1461 microversion: 2.1 time: 0.091277 Sep 03 20:54:14.706066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:14.718305 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 740/1485] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:14 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1461 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:14.718305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f8ce627-a6b4-4239-afc8-7769b38c14d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7a5b80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:14.730665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for user 27be6827d30e48acac9a59786021f7bb and project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:14.749130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:54:14.764753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:54:14.844988 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f8ce627-a6b4-4239-afc8-7769b38c14d2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.135162 Sep 03 20:54:14.861065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 741/1486] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:14 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:14.878813 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e25f03ca-5126-4abe-9b31-c8c49eed617d tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.962949 Sep 03 20:54:14.886096 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 746/1487] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:54:14.891670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:14.896106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:14.910925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:14.912945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:14.914823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:14.915636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:14.916121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:14.916563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.063618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-unplugged", "status": "completed", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:15.111011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:15.126419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:15.127144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.170823 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Creating event network-vif-unplugged:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch2-master-1 Sep 03 20:54:15.201443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:54:15.226970 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2098be33-b369-4280-af0f-0ba517b21d63 req-4e389252-011b-4ea2-bd93-276d600f1891 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.364309 Sep 03 20:54:15.231766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 742/1488] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:15.293828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:15.306399 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9aed67c0-1999-4740-b98d-c2cfe790bdcd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1705 microversion: 2.1 time: 0.423489 Sep 03 20:54:15.321705 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 747/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:14 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1705 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:15.330358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b03c126-8956-4090-995d-53ea35b3dd47 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67026700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:15.385003 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b03c126-8956-4090-995d-53ea35b3dd47 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 200 len: 1461 microversion: 2.1 time: 0.061909 Sep 03 20:54:15.386298 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 748/1490] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:15 2022] GET /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 1461 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:15.391408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db73ad1b-cd7f-486d-a67c-07661e4c8367 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:15.392221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-db73ad1b-cd7f-486d-a67c-07661e4c8367 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:15.486197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-db73ad1b-cd7f-486d-a67c-07661e4c8367 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:15.494958 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-db73ad1b-cd7f-486d-a67c-07661e4c8367 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1224 microversion: 2.1 time: 0.107398 Sep 03 20:54:15.498138 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 749/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:15 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:15.527346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c9788691-1659-4bcf-814a-7ef0445b4292 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '.version_select at 0x7fae6734b670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:15.535500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9788691-1659-4bcf-814a-7ef0445b4292 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:15.536015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9788691-1659-4bcf-814a-7ef0445b4292 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:15.536483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9788691-1659-4bcf-814a-7ef0445b4292 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.573620 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c9788691-1659-4bcf-814a-7ef0445b4292 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3120 microversion: 2.1 time: 0.059515 Sep 03 20:54:15.585514 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 750/1492] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:54:15 2022] GET /compute/v2.1/os-migrations => generated 3120 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:15.585514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:15.585514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:15.598817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:15.599455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:15.599769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.600544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:15.604145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:15.604636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.809375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: .version_select at 0x7fae6b751040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1548936412", "policies": ["affinity"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:15.866672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:15.877067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:15.937505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:15.956676 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-85f2d44d-cd73-43f0-b474-419ee2dfadc3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1466 microversion: 2.1 time: 0.379591 Sep 03 20:54:15.960042 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 751/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:15 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1466 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:15.972353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:15.975954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:15.995135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:15.995769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:15.996522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:15.997252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:15.999870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.001962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.002683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.010842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:16.048164 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5da4e78-0c45-4d99-b0af-5f77b5b72875 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.813580 Sep 03 20:54:16.049537 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 743/1494] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Sep 3 20:54:15 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:16.064546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:16.065699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:16.081918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.082985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.084393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.086934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.092686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.094286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.313141 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32ba3237-463c-4eb4-810f-181db5dd33d6 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1856 microversion: 2.1 time: 0.350311 Sep 03 20:54:16.316149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 752/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:15 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1856 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:16.328175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1d2e7ee-6c4a-4324-bbcc-e49d0d1ea39c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae67026a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:16.384019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:16.401253 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0f98c6ab-34a7-4722-8e46-56e3393ceaad tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1541 microversion: 2.1 time: 0.350154 Sep 03 20:54:16.402307 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 744/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:16 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1541 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:16.415416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-467255657"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:16.418023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:16.423896 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1d2e7ee-6c4a-4324-bbcc-e49d0d1ea39c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.103526 Sep 03 20:54:16.425658 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 753/1497] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:16 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:16.425843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.426562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.427174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.428051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.429259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.429840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.444540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: .version_select at 0x7fae67222040>, body: {"server_group": {"name": "tempest-server-group-2044409716", "policies": ["affinity"]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:16.487712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:16.496963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:16.573837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:16.599071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:16.618256 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8502016-c5d6-44a7-806f-6508e3a1b40f tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.188431 Sep 03 20:54:16.619177 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 754/1498] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 20:54:16 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:16.635906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:16.638119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:16.646351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.647573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.648291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.650749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.651233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.651996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.787765 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-31898a59-d137-4b9f-b1e2-0b336aff7092 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "POST /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7/action" status: 202 len: 0 microversion: 2.1 time: 0.382996 Sep 03 20:54:16.792525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 745/1499] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:16 2022] POST /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:54:16.800645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:16.801402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:16.810436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.811649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.812668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.814106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:16.816844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:16.817540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:16.905536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd928dbd-1bca-48d7-9766-ecf01b4c4e64 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1856 microversion: 2.1 time: 0.284827 Sep 03 20:54:16.907735 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 755/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:16 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1856 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:16.912610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: .version_select at 0x7fae67222ca0>, body: {"server_group": {"name": "tempest-server-group-2044409716", "policies": ["affinity"]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:16.945180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:16.957105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:16.967098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:16.990689 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5025469e-f049-42b8-b4a1-6f96b22e2f4f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1228 microversion: 2.1 time: 0.196123 Sep 03 20:54:16.992238 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 746/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:16 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1228 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:16.997913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b300ba69-4bce-4f86-a203-62980312026b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b976280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.087148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b300ba69-4bce-4f86-a203-62980312026b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.092921 Sep 03 20:54:17.088781 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 747/1502] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:16 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:17.090382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:17.095739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.096533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:17.104878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:17.107514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.109145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.109843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.111126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.112755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.113673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.145816 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-36d8937d-d7ec-4055-8ad0-505d67053ba2 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.236950 Sep 03 20:54:17.152406 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 756/1503] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 20:54:16 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:17.165189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5f166e7e-466e-4421-b115-0712a4fc56d5 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.218141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:17.239280 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5f166e7e-466e-4421-b115-0712a4fc56d5 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fa21e706-515c-4702-bcb1-800bf69da4c8" status: 204 len: 0 microversion: 2.1 time: 0.085675 Sep 03 20:54:17.243425 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 757/1504] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:17 2022] DELETE /compute/v2.1/os-server-groups/fa21e706-515c-4702-bcb1-800bf69da4c8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:17.249403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0c6a9cf-40e4-42ba-97f0-abbc63848c5c tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.279525 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0c6a9cf-40e4-42ba-97f0-abbc63848c5c tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.034796 Sep 03 20:54:17.280111 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 758/1505] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:17 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:54:17.290827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:17.300155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lazy-loading 'services' on Instance uuid b584970a-cead-49b8-9437-4b62c236be34 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:54:17.302030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.302687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.311622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.333777 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Creating event network-changed:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch2-master-1 Sep 03 20:54:17.346336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:54:17.363332 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-000bc271-e6bf-4a61-bddf-1bc73ca160ff req-09e65d40-a58b-445a-9c27-ef9772dacef8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081742 Sep 03 20:54:17.372374 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 759/1506] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:17.379636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82fe5eca-1a03-4ff1-ab10-7c219e1f9bf5 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.416968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-82fe5eca-1a03-4ff1-ab10-7c219e1f9bf5 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/062df827-e967-4fa6-915b-39253843a209" status: 204 len: 0 microversion: 2.1 time: 0.042811 Sep 03 20:54:17.417877 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 760/1507] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:17 2022] DELETE /compute/v2.1/os-server-groups/062df827-e967-4fa6-915b-39253843a209 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:17.428154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.429085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:17.439536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.440303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.440755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.441569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.442087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.442565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.494157 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a0fd721a-4b3b-410f-88be-e90c73b125dd tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments/80e6d713-e5fc-4d1b-ae13-80868b12d778" status: 202 len: 0 microversion: 2.1 time: 0.397808 Sep 03 20:54:17.495280 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 748/1508] 10.222.0.16 () {58 vars in 1416 bytes} [Sat Sep 3 20:54:17 2022] DELETE /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments/80e6d713-e5fc-4d1b-ae13-80868b12d778 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:54:17.518388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b55b7599-339b-4a8e-93c9-2b92d213fadb tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.560769 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b55b7599-339b-4a8e-93c9-2b92d213fadb tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.056852 Sep 03 20:54:17.566530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 749/1509] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:17.582220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca23d925-c315-46d8-aa1c-263db01444ef tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b922ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.649924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca23d925-c315-46d8-aa1c-263db01444ef tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.081780 Sep 03 20:54:17.650610 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 750/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:17 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:17.668522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:17.671044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:17.684755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.684755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.685082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.685634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.686294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.687070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.725794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce4e460e-02ec-4318-bdfc-896f038aa12f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071368 Sep 03 20:54:17.730909 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 751/1511] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 3 20:54:17 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:17.738078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: .version_select at 0x7fae6b976670>, body: {"server_group": {"name": "tempest-server-group-407501667", "policies": ["affinity"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:17.768180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:17.770703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:17.781590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c8e5526-0294-4a25-8b7b-6e628d6996af tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1473 microversion: 2.1 time: 0.357315 Sep 03 20:54:17.782372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 761/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:17 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:17.794056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd", "name": "network-vif-plugged", "status": "completed", "tag": "9d132a32-0a12-45a3-bb6a-b25d42badeeb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:17.804151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:17.832537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:17.834365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:17.843025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:17.843965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:17.864171 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] Creating event network-vif-plugged:9d132a32-0a12-45a3-bb6a-b25d42badeeb for instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd on nch1-master-1 Sep 03 20:54:17.870171 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6b9d9f1e-1f3b-403a-a7d0-28da19e6adfa req-52deb30f-fbf0-4839-b959-9ef5bbc930fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083620 Sep 03 20:54:17.871080 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 762/1513] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:17.942439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:17.951935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:17.978318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1af2480c-21c4-4310-ad92-3be92cdf25f3 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.245753 Sep 03 20:54:17.998569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 752/1514] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 20:54:17 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:18.008734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1c5583be-7734-4e8a-a5a5-77b26303620e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.104612 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1c5583be-7734-4e8a-a5a5-77b26303620e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e761ba77-3c94-43b8-b8f3-48b86399efb7" status: 204 len: 0 microversion: 2.1 time: 0.103667 Sep 03 20:54:18.105461 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 753/1515] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:17 2022] DELETE /compute/v2.1/os-server-groups/e761ba77-3c94-43b8-b8f3-48b86399efb7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:18.115127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.116408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:18.124136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.125333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.125333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:18.126101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.126763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.127254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:18.183520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-487910a4-c8b9-4746-b2a3-9aadbdee1bd5 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1331136983", "id": 1980412834, "os-flavor-access:is_public": "False"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:18.213305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-487910a4-c8b9-4746-b2a3-9aadbdee1bd5 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.233416 Sep 03 20:54:18.214585 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 763/1516] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:17 2022] POST /compute/v2.1/flavors => generated 431 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:54:18.230978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc3989c6-50a6-48d6-bea1-3b3d64b41354 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67296550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.295105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:18.308067 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-123b835c-5ec7-430b-93e5-36ea4d8add57 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1276 microversion: 2.1 time: 0.198184 Sep 03 20:54:18.308655 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 754/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:18.316868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8ef36cc-1e1f-4b5d-be71-206c58fa5e95 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.317093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc3989c6-50a6-48d6-bea1-3b3d64b41354 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.100767 Sep 03 20:54:18.323307 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 764/1518] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:18.338111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbafbedc-258d-4e2d-8c08-63462a3483c3 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ecfb9a5fe42a4c99a294e05cad3e03a3"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:18.344514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8ef36cc-1e1f-4b5d-be71-206c58fa5e95 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031162 Sep 03 20:54:18.345331 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 755/1519] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:18.360558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: .version_select at 0x7fae6b976040>, body: {"server_group": {"name": "tempest-server-group-5636042", "policies": ["anti-affinity"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:18.404353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:18.413813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:18.479949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:18.489004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:18.507611 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbafbedc-258d-4e2d-8c08-63462a3483c3 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1980412834/action" status: 200 len: 97 microversion: 2.1 time: 0.181875 Sep 03 20:54:18.508481 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 765/1520] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:54:18 2022] POST /compute/v2.1/flavors/1980412834/action => generated 97 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:54:18.520352 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0b925b7-5e0c-4766-978c-d8af69dc8d42 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 166 microversion: 2.1 time: 0.164792 Sep 03 20:54:18.521125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 756/1521] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 20:54:18 2022] POST /compute/v2.1/os-server-groups => generated 166 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:54:18.534640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-557dd311-1ce1-4c23-ada3-4c7dca693180 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.571733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-557dd311-1ce1-4c23-ada3-4c7dca693180 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/84a1340d-26ec-4d67-9f3a-e46be3d12098" status: 204 len: 0 microversion: 2.1 time: 0.040813 Sep 03 20:54:18.577034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 757/1522] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:18 2022] DELETE /compute/v2.1/os-server-groups/84a1340d-26ec-4d67-9f3a-e46be3d12098 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:18.584030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2fe53558-e16b-4187-b6c5-1da2fcab7bd9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.598535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2fe53558-e16b-4187-b6c5-1da2fcab7bd9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020069 Sep 03 20:54:18.599622 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 758/1523] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:18.668689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e344f954-4581-442d-b4f5-5e5afe7cb341 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7a5e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.677797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0afc0228-aca3-4c2e-8e53-757f33c74660 tempest-FlavorsAccessTestJSON-1567386696 tempest-FlavorsAccessTestJSON-1567386696-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.702463 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0afc0228-aca3-4c2e-8e53-757f33c74660 tempest-FlavorsAccessTestJSON-1567386696 tempest-FlavorsAccessTestJSON-1567386696-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.186472 Sep 03 20:54:18.713841 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 766/1524] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:18.729143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fcb219a1-e078-4477-b1ee-2c8edfc031cc tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ecfb9a5fe42a4c99a294e05cad3e03a3"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:18.739496 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e344f954-4581-442d-b4f5-5e5afe7cb341 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.077168 Sep 03 20:54:18.745788 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 759/1525] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:18.745969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-290607773", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "38b7006f-a296-40b2-bddd-3273836b59a7"}]}, "os:scheduler_hints": {"group": "83010238-2801-4521-811b-079b97fabc4e"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:18.817746 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fcb219a1-e078-4477-b1ee-2c8edfc031cc tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1980412834/action" status: 200 len: 21 microversion: 2.1 time: 0.096434 Sep 03 20:54:18.818730 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 767/1526] 10.222.0.16 () {60 vars in 1200 bytes} [Sat Sep 3 20:54:18 2022] POST /compute/v2.1/flavors/1980412834/action => generated 21 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:54:18.829164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.832389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:18.834365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] validate_networks() for [('38b7006f-a296-40b2-bddd-3273836b59a7', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:54:18.841307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.841805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.842348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:18.843318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.843837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.844392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:18.900692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac47531b-43de-485d-9c84-507f9a7daab8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080670 Sep 03 20:54:18.901424 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 768/1527] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:18.913505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:18.914206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:18.921054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.921545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.922061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:18.922778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:18.923240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:18.923669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.482908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:19.498814 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b133c186-cd2a-4dcc-b618-fca24f3cc130 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1470 microversion: 2.1 time: 0.590212 Sep 03 20:54:19.502427 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 769/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:18 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:19.508234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b812e3ac-a9ec-4f42-b20d-2ab3f25fe9a1 tempest-FlavorsAccessTestJSON-1567386696 tempest-FlavorsAccessTestJSON-1567386696-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:19.565988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:54:19.566603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:54:19.566884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:54:19.567927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:54:19.568353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:54:19.569844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b812e3ac-a9ec-4f42-b20d-2ab3f25fe9a1 tempest-FlavorsAccessTestJSON-1567386696 tempest-FlavorsAccessTestJSON-1567386696-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059387 Sep 03 20:54:19.570688 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 770/1529] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:19.583137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5baffba7-0ed8-45e0-98b1-4cbae629d969 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66e6fd30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:19.598332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.598835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.599551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.600993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.602381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.603289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.630689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:19.648256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:19.666090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5baffba7-0ed8-45e0-98b1-4cbae629d969 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.091405 Sep 03 20:54:19.673945 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 771/1530] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:19 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:19.673945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:19.673945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:19.677667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:54:19.680437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:54:19.680682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.681329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.681878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.682718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.683403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.684232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.743328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140520) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 03 20:54:19.774120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:19.781118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:19.785589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:19.809213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:19.832784 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-001592e8-b7fd-44a2-b0c7-dc4dd4b8460b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1282 microversion: 2.1 time: 0.164279 Sep 03 20:54:19.834326 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 772/1531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:19 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:19.863635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:19.864852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:19.880575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.882880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.883463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.884622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:19.887273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:19.888252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:19.896523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:19.903736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Getting quotas for user 18b23f4ce1d44682b0c187e8aac1a7df and project 5e1442bbd96148d196c957d881a7449e. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:19.943061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4142c1cd-bbe8-40ae-b290-89809e3d275e tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200761 Sep 03 20:54:19.944836 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 760/1532] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:54:19.949994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-289a8531-4f96-4585-82e1-86fe7a4f6844 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:19.994948 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-289a8531-4f96-4585-82e1-86fe7a4f6844 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1980412834" status: 202 len: 0 microversion: 2.1 time: 0.047709 Sep 03 20:54:20.001880 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 761/1533] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:54:19 2022] DELETE /compute/v2.1/flavors/1980412834 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:54:20.005196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.011572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.012159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.013125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.016362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.019223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.029108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:20.030347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:20.039169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.039688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.040141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.040874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.042089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.042567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.103080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:20.109097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:20.365847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:54:20.400934 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72e81bc1-b348-4c7f-bd3a-1964d969c3e6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 2344 microversion: 2.25 time: 0.389846 Sep 03 20:54:20.401677 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 762/1534] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 2344 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:20.415450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06987618-5daa-48f0-9029-d5ba3ca5371b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b90a430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:20.467597 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-403d3e81-0061-43c1-acd7-dca81dd37de1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380/action" status: 202 len: 0 microversion: 2.1 time: 0.631223 Sep 03 20:54:20.469232 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 773/1535] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:19 2022] POST /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:54:20.485819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:20.494371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:20.507984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.509430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.510222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.511333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.514981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.518724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.528085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06987618-5daa-48f0-9029-d5ba3ca5371b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.123433 Sep 03 20:54:20.528818 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 763/1536] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:20.548082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a7ed534d-79d7-4b68-9367-7d8780c44248 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:20.548707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a7ed534d-79d7-4b68-9367-7d8780c44248 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:20.596678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb3a6048-2cdf-49b5-8577-bf4c3be0ca06 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124282 Sep 03 20:54:20.598919 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 774/1537] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:54:20.606227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c9800be-e526-423d-a95a-282e0810be4e tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:20.627950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c9800be-e526-423d-a95a-282e0810be4e tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027593 Sep 03 20:54:20.640516 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 775/1538] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:20.885889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-unplugged", "status": "completed", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:20.900498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:20.901023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:20.901499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:20.955986 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] Creating event network-vif-unplugged:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:54:20.977535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5caa9380-af8e-4258-8d8e-1fe8740f1eef req-06105996-e5f8-42cd-9150-191a6247b0eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.335070 Sep 03 20:54:20.980122 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 776/1539] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:21.003685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:21.017393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.018421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.019009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:21.019939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.033535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.034191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:21.061795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a7ed534d-79d7-4b68-9367-7d8780c44248 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:21.062368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:21.097458 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a7ed534d-79d7-4b68-9367-7d8780c44248 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1212 microversion: 2.1 time: 0.553817 Sep 03 20:54:21.100395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 764/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1212 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:21.116548 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63704e28-669f-43e4-a653-741fbe522cc6 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.133508 Sep 03 20:54:21.116732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:21.125827 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 777/1541] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Sep 3 20:54:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:54:21.129816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:21.130607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3fc787ce-101c-4e05-b5cf-142709dbf315 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-419752114", "id": 1766855636, "os-flavor-access:is_public": "False"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:21.148022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.152951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.154304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:21.156032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.159829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.160436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:21.185495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3fc787ce-101c-4e05-b5cf-142709dbf315 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.058434 Sep 03 20:54:21.186325 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 778/1542] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:21.207207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-837e98fb-1e3d-4e46-a197-47bf7145c848 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66e6f9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:21.362299 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-837e98fb-1e3d-4e46-a197-47bf7145c848 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.175072 Sep 03 20:54:21.380368 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 779/1543] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:21 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:21.395859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:21.396756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:21.448473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.449008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.449458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:21.450199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:21.450661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:21.459128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:22.105921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:22.113915 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5799f644-f392-4022-8d8d-0132fe2b0c6f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1469 microversion: 2.1 time: 1.011566 Sep 03 20:54:22.114383 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 765/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:21 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1469 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:22.147686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d3d8d618-19e2-4bd1-9338-8bc474989867 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.210911 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d3d8d618-19e2-4bd1-9338-8bc474989867 tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1766855636/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.087730 Sep 03 20:54:22.211817 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 766/1545] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 20:54:22 2022] GET /compute/v2.1/flavors/1766855636/os-flavor-access => generated 21 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:54:22.219693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad2d433b-b22f-4032-bd98-f8fce4f80b88 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b90a670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.289340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:22.306251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67698da4-4be1-4f69-9678-e363aac24400 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1324 microversion: 2.1 time: 0.924583 Sep 03 20:54:22.313135 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 780/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:21 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1324 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:22.335118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.335749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:22.349623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:22.350899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:22.355296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:22.364266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:22.364926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:22.365456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:22.373386 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad2d433b-b22f-4032-bd98-f8fce4f80b88 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1414 microversion: 2.1 time: 0.157226 Sep 03 20:54:22.378991 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 767/1547] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:22 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:22.411912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a270d2a4-fa99-4448-983b-04499c96a01a tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.508728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a270d2a4-fa99-4448-983b-04499c96a01a tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1766855636" status: 202 len: 0 microversion: 2.1 time: 0.122011 Sep 03 20:54:22.509377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 768/1548] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 20:54:22 2022] DELETE /compute/v2.1/flavors/1766855636 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:54:22.530205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0d931440-b168-4c21-ba54-a0b7c1502ea7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b88ec10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.627502 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0d931440-b168-4c21-ba54-a0b7c1502ea7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.116956 Sep 03 20:54:22.628219 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 769/1549] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:22 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:22.640051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfa5c459-077d-4a6b-a8e1-1094259d842f tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:22.696572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:22.699470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfa5c459-077d-4a6b-a8e1-1094259d842f tempest-FlavorsAccessTestJSON-1409941766 tempest-FlavorsAccessTestJSON-1409941766-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052792 Sep 03 20:54:22.708417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 770/1550] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:22.718478 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc38e319-d394-4e8f-b718-2900988becbe tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1264 microversion: 2.1 time: 0.402286 Sep 03 20:54:22.734954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 781/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:22 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1264 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:23.159092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:23.159914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:23.181885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:23.186230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:23.187074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:23.188053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:23.193136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:23.196474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:23.335660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:23.338135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:23.353693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:23.356112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:23.357983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:23.362798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:23.363520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:23.365060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:23.771764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:23.776131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:23.795336 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b20ab3d-2c1d-4c6f-9f9b-cdbbf91d0d18 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1469 microversion: 2.1 time: 0.654490 Sep 03 20:54:23.803758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 771/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:23 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:23.839335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-670d1746-b6d8-418f-b910-4201c044d125 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b997430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:24.271920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:24.285893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7680e505-7d22-42e9-8961-25cb8479de16 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1324 microversion: 2.1 time: 0.956378 Sep 03 20:54:24.286996 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 782/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:23 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1324 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:24.300717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6380569-23f5-4a95-a3fa-baf811899845 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b9bbdc0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:27.140329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=24 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:29.616814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:31.049864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=7 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:31.069785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=40 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:33.185693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:DELETE=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:33.354143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:34.277847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=18 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:35.055575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-670d1746-b6d8-418f-b910-4201c044d125 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1423 microversion: 2.1 time: 11.250024 Sep 03 20:54:35.067385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6380569-23f5-4a95-a3fa-baf811899845 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 10.773896 Sep 03 20:54:35.067385 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 783/1554] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:24 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 10775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:35.068617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d6b5527-60b3-46e7-b592-f5108171cc0c", "device": "/dev/xvdb"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:35.069709 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 772/1555] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:23 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1423 bytes in 11265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:35.072356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:35.074832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:35.075458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:35.079547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.080130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.080814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.081795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.082253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.082560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.082933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.083040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.083480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.084223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.084683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.085160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.260582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:35.271880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26e6ed78-16a8-4c90-a9d7-4c2e99293fe8 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1312 microversion: 2.1 time: 0.200427 Sep 03 20:54:35.273351 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 773/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:35 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:35.278896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-plugged", "status": "completed", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:35.294413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.295165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.295857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.314341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] Creating event network-vif-plugged:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:54:35.322853 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-15a6dfb9-aa14-4326-8936-64d9fabe82e3 req-bdbcac42-9fca-44be-a303-7ca87a915d09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047599 Sep 03 20:54:35.323903 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 774/1557] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:35.445090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6524c721-4323-4efa-9ef6-77bf848fec5e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.380855 Sep 03 20:54:35.445990 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 784/1558] 10.222.0.16 () {62 vars in 1364 bytes} [Sat Sep 3 20:54:35 2022] POST /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:54:35.464442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:35.465417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:35.477726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.478586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.480037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.481140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.481798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.482462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.570987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b73e36a8-4981-4140-a12e-274a9bd217a7", "tag": "6d0ff3ac-69da-425c-ab25-ecfde26f9d56"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:35.582291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.582772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.583207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.626800 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] Creating event network-changed:6d0ff3ac-69da-425c-ab25-ecfde26f9d56 for instance b73e36a8-4981-4140-a12e-274a9bd217a7 on nch2-master-1 Sep 03 20:54:35.634505 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b4a3717a-c37d-453f-989a-f2ebab1350e1 req-384e7fff-1b11-4bc5-a241-bbdf4d8c6674 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308314 Sep 03 20:54:35.636243 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 775/1559] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:35.659518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:35.660296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:35.671869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.676465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.685003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.686938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:35.688238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:35.689563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:35.771208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:35.786549 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1528 microversion: 2.1 time: 0.336493 Sep 03 20:54:35.789921 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 785/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:35 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1528 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:35.791125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:35.793291 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dec1686-200e-47da-b0da-0f39a1c238c6 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001333 Sep 03 20:54:35.794950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 786/1561] 10.222.0.16 () {56 vars in 886 bytes} [Sat Sep 3 20:54:35 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 03 20:54:35.807345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c00e55ec-d5ab-4bf1-9155-64d8b70fc20c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b979f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:36.014946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:36.024639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f69ea942-674d-4ed8-ac8b-43d6e5ea6fa0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1324 microversion: 2.1 time: 0.381508 Sep 03 20:54:36.026965 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 776/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:35 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:36.032416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:36.033070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:36.041213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:36.041773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:36.042376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:36.043102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:36.043565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:36.043997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:36.510827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:36.529572 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa145ace-2cc8-4ebe-af73-cfc1eabdc4fb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1528 microversion: 2.1 time: 0.500066 Sep 03 20:54:36.531054 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 777/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:36 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:36.538015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e258350f-36bc-4aaf-b149-79abb31e8157 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7651f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:39.687577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c00e55ec-d5ab-4bf1-9155-64d8b70fc20c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 200 len: 1423 microversion: 2.1 time: 3.891411 Sep 03 20:54:39.688869 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 787/1564] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:35 2022] GET /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 1423 bytes in 3893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:39.699629 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e258350f-36bc-4aaf-b149-79abb31e8157 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 3.163906 Sep 03 20:54:39.700222 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 778/1565] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:36 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 3168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:39.708711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:39.710282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:39.715275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d77b870b-a7f7-40f4-bea3-f0ad2f380090 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:39.717062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:39.717564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:39.718444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:39.719346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:39.719979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:39.720575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:39.731280 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d77b870b-a7f7-40f4-bea3-f0ad2f380090 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] HTTP exception thrown: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d77b870b-a7f7-40f4-bea3-f0ad2f380090 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Request method failure captured: Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/flavors/ad1e8442-2fd1-4252-b901-5f34d89af62d HTTP/1.1 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74IlHeK0Mv8ghHU1WldWzitdZYIIhHoVty_qcwReNTm1eH_2iOQOGSGTufQu5NUNx4yF8McVOA0sBZRpb2tcBrcHQyzy9ooIFtIRVnEZ6Iz77wrj-dYwiwIb3UteueDej5QTUNVMMUs-sLCcvGD6bt6223-Z8T15VSujlbPOFSaaE0 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: baf7e7f35c3f42b0a853dc2a0c196753 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MigrationsAdminTest-711416503 Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 20:54:39.737845 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/baf7e7f35c3f42b0a853dc2a0c196753"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_baf7e7f35c3f42b0a853dc2a0c196753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/baf7e7f35c3f42b0a853dc2a0c196753"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/baf7e7f35c3f42b0a853dc2a0c196753"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MigrationsAdminTest-711416503 Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: baf7e7f35c3f42b0a853dc2a0c196753 Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MigrationsAdminTest-711416503 Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MigrationsAdminTest-711416503-project-admin Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2f91eb6e45a14d1e8c18c9b94ae1567e Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MigrationsAdminTest-711416503-project-admin Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. Sep 03 20:54:39.739589 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ad1e8442-2fd1-4252-b901-5f34d89af62d'} Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:39.740653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. Sep 03 20:54:39.747093 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:39.748501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d77b870b-a7f7-40f4-bea3-f0ad2f380090 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Returning 404 to user: Flavor ad1e8442-2fd1-4252-b901-5f34d89af62d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:39.748501 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d77b870b-a7f7-40f4-bea3-f0ad2f380090 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/ad1e8442-2fd1-4252-b901-5f34d89af62d" status: 404 len: 109 microversion: 2.1 time: 0.039625 Sep 03 20:54:39.748501 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 779/1566] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:54:39 2022] DELETE /compute/v2.1/flavors/ad1e8442-2fd1-4252-b901-5f34d89af62d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:39.759481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:39.760930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:39.794062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:39.797932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:39.798607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:39.799532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:39.801407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:39.802042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:39.978464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:39.996388 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5967ad1c-4495-46cd-b860-ab09a7a7af29 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1312 microversion: 2.1 time: 0.306146 Sep 03 20:54:39.997318 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 788/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:39 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1312 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:40.004167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868e0374-e87b-47bb-b1c6-454b021cb0c7", "name": "network-vif-plugged", "status": "completed", "tag": "6fdb39ff-6197-4b7f-b337-ca2c08b9dbab"}, {"server_uuid": "b73e36a8-4981-4140-a12e-274a9bd217a7", "name": "network-vif-plugged", "status": "completed", "tag": "6d0ff3ac-69da-425c-ab25-ecfde26f9d56"}, {"server_uuid": "c56c3605-f6bb-4c09-af20-07fbc05f2448", "name": "network-vif-plugged", "status": "completed", "tag": "dc36b6ba-3cbe-45a7-bbf1-4adde50178ef"}, {"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-plugged", "status": "completed", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:40.034024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:40.034522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:40.040745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:40.102676 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Creating event network-vif-plugged:6fdb39ff-6197-4b7f-b337-ca2c08b9dbab for instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 on nch1-master-1 Sep 03 20:54:40.103194 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Creating event network-vif-plugged:6d0ff3ac-69da-425c-ab25-ecfde26f9d56 for instance b73e36a8-4981-4140-a12e-274a9bd217a7 on nch2-master-1 Sep 03 20:54:40.103704 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Creating event network-vif-plugged:dc36b6ba-3cbe-45a7-bbf1-4adde50178ef for instance c56c3605-f6bb-4c09-af20-07fbc05f2448 on nch2-master-1 Sep 03 20:54:40.104208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] Creating event network-vif-plugged:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:54:40.111942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:40.123265 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91a1a3f7-8442-486e-acf1-b4ab9e91b38e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1324 microversion: 2.1 time: 0.378654 Sep 03 20:54:40.124305 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 780/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:39 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:40.130064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56c3605-f6bb-4c09-af20-07fbc05f2448", "tag": "dc36b6ba-3cbe-45a7-bbf1-4adde50178ef"}, {"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-unplugged", "status": "completed", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}, {"name": "network-changed", "server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:40.143822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:40.144663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:40.145678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:40.161524 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0631cae2-4789-4285-a2ff-f51531165011 req-7a10ede0-7a06-43ba-a575-09b26096163b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.162691 Sep 03 20:54:40.162666 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 789/1569] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:40.167160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Creating event network-changed:dc36b6ba-3cbe-45a7-bbf1-4adde50178ef for instance c56c3605-f6bb-4c09-af20-07fbc05f2448 on nch2-master-1 Sep 03 20:54:40.167863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Creating event network-vif-unplugged:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:54:40.168541 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] Creating event network-changed:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:54:40.169205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a67bf13-a992-473c-b2be-08c25c0c1d50 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66e6fca0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:40.186380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a8c39665-dedb-4859-8ad7-c4d9e8e82be3 req-7028e69a-517a-465e-a78b-111547147cc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.058832 Sep 03 20:54:40.187760 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 781/1570] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:40.195949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-176154616", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:41.543786 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a67bf13-a992-473c-b2be-08c25c0c1d50 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 204 len: 0 microversion: 2.1 time: 1.379423 Sep 03 20:54:41.544719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 790/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:40 2022] DELETE /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:41.550567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:41.551500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:41.575401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:41.576196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:41.576867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:41.582647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:41.584032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:41.588205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:41.601124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:54:41.923570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:54:41.941006 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce5f9554-a4a4-4dbd-8112-edd2002a7877 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 2422 microversion: 2.25 time: 0.395149 Sep 03 20:54:41.941957 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 791/1572] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:41 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 2422 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:41.959344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea08a7c6-27d2-40c6-b4b9-d6db2d08f403 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b97cc10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:41.970121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:54:41.970663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:54:41.971197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:54:41.971650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:54:41.972172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:54:41.984884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:41.985630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:41.986303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:41.987288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:41.987909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:41.988499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.029845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:42.038482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Getting quotas for user 2e11c33c786746e5b3effedd32674582 and project e96ec8c49f384e7d81244fd2476d0496. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:42.046197 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea08a7c6-27d2-40c6-b4b9-d6db2d08f403 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.102614 Sep 03 20:54:42.047747 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 792/1573] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:41 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:42.067403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:54:42.069632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:54:42.191217 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-30622792-eb18-42d6-be20-245465afc4c7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001776 Sep 03 20:54:42.191882 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 782/1574] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:54:42.201780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:42.213171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:42.233448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.233953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.234449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.235209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.235561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.235990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.391273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b915b80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:42.393900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.394730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.395765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.445602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.449489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.451413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.507416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.508182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.510762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.526818 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fa242e8-dd03-41e8-8f44-0cf95a10aacf tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.477464 Sep 03 20:54:42.527586 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 793/1575] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:42.537420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:42.538253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:42.544819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.545952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.546593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.547482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.548102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.549197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.581832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:42.595354 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15f00ad4-6ef0-4bde-83bb-1ec7802f65a1 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1497 microversion: 2.1 time: 0.395673 Sep 03 20:54:42.606435 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 783/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:42 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:42.618187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:42.619665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:42.633209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.633707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.637623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.638671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.641111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.644700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.706406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:54:42.835390 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-803d9d55-c2d2-4ca0-8dc2-73b414cb652f tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 204 len: 0 microversion: 2.1 time: 0.226679 Sep 03 20:54:42.838209 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 784/1577] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:54:42 2022] DELETE /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:42.848935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:42.860126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:42.873923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.874547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.875006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.875726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:42.876243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:42.877238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:42.908357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'flavor' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:54:42.941016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Going to try to live migrate instance to nch1-master-1 {{(pid=140520) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:54:43.106086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:43.121472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7781624e-96ed-4432-8709-7529f0451b9c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.591964 Sep 03 20:54:43.122820 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 794/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:42 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:43.149565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:43.150300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:43.162827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.163440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.164112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.165275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.166034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.166764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.294713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:43.317174 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cbbbdd7-5632-4c94-bf86-3152136125fa tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1216 microversion: 2.1 time: 0.181603 Sep 03 20:54:43.322177 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 795/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:43 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:43.339488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "9d132a32-0a12-45a3-bb6a-b25d42badeeb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:43.355753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.356243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.356686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.368741 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] Creating event network-vif-unplugged:9d132a32-0a12-45a3-bb6a-b25d42badeeb for instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd on nch1-master-1 Sep 03 20:54:43.378988 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-cee5294a-669b-4240-a16c-03c9c8f20274 req-4ed8c0cd-8fc4-41cf-91ba-9d159f91168d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054556 Sep 03 20:54:43.380182 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 796/1580] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:43.398758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b8c7d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:43.402701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.404001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.405122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.428457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.430086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.430687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.451097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.451722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.452168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.461554 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7685800f-55eb-4d33-839c-82960a645767 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.069474 Sep 03 20:54:43.472986 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 797/1581] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 3 20:54:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:43.477977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:43.494837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_groups [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Querying cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) for 1 instances {{(pid=140519) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 03 20:54:43.495586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:43.496060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:43.496505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:43.525454 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bb8c7c24-03d4-459c-a521-d8fcf0e35126 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e" status: 200 len: 222 microversion: 2.1 time: 0.054515 Sep 03 20:54:43.526027 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 798/1582] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:54:43 2022] GET /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:43.530570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65803ae7-ff97-4f88-bdd1-9b0246676fca tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b927dc0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:43.607196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65803ae7-ff97-4f88-bdd1-9b0246676fca tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.079877 Sep 03 20:54:43.615943 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 799/1583] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:43 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:43.622355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1991372829", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:43.721931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] validate_networks() for [('6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:54:44.184593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:54:44.189022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:54:44.189602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:54:44.190089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:54:44.190586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:54:44.202253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.203074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.203741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.204725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.205610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.206356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.226714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:54:44.233148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for user d9688dca94a841cfa29420ad780562cd and project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:54:44.249540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:54:44.252373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:54:44.317407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11a3b24c-48db-4d4b-be3d-c6297372def7 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706450 Sep 03 20:54:44.321214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 800/1584] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:54:44.329845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:44.332179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:44.341127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.341663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.342116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.342839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.343559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.343995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.527821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:44.556290 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-70e8367c-f2a4-465a-9e27-d646633d5285 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.233642 Sep 03 20:54:44.576196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 801/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:44 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:44.576196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b8c78b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:44.580485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.580485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.580485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.623987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.637204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.637891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.668876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.669646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.670356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.693541 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6fbbe536-1b98-4a58-98db-c8b79f2640de tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.134689 Sep 03 20:54:44.702783 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 802/1586] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:44.713519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:44.714116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:44.720644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.721281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.721952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.722982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:44.723567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:44.724102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:44.755932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:54:44.993276 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ddbbfe6-9387-4492-91c5-0bf0926a0c8d tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 204 len: 0 microversion: 2.1 time: 0.285218 Sep 03 20:54:45.002938 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 803/1587] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:54:44 2022] DELETE /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:45.022721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c448e09e-1153-4757-99a8-3aecfff4bfd8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:45.026372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c448e09e-1153-4757-99a8-3aecfff4bfd8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:45.314850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c448e09e-1153-4757-99a8-3aecfff4bfd8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:45.324846 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c448e09e-1153-4757-99a8-3aecfff4bfd8 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1208 microversion: 2.1 time: 0.319407 Sep 03 20:54:45.325835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 804/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:45 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1208 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:45.331438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:45.332809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:45.369788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.370320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.370895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:45.371694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.372153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.372577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:45.446094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:45.539888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:45.559678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd582057-c2d5-482d-9ca7-fa188fbf647d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1264 microversion: 2.1 time: 0.232661 Sep 03 20:54:45.560259 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 805/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:45 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:45.579856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72d60c7f-fd7f-4cc2-8020-1c449552f923 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1846745469", "metadata": {"": ""}}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72d60c7f-fd7f-4cc2-8020-1c449552f923 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action HTTP/1.1 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 107 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:54:45.595359 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1846745469", "metadata": {"": ""}}} Sep 03 20:54:45.597142 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1846745469', 'metadata': {'': ''}}}} Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'': ''} Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:45.598517 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.601179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72d60c7f-fd7f-4cc2-8020-1c449552f923 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:45.602955 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-72d60c7f-fd7f-4cc2-8020-1c449552f923 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action" status: 400 len: 170 microversion: 2.1 time: 0.030999 Sep 03 20:54:45.605093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 806/1590] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Sep 3 20:54:45 2022] POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action => generated 170 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:54:45.624642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d6a031c-0f1c-4bfd-b4ba-7dcac16ece1e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b9274c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:45.718783 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d6a031c-0f1c-4bfd-b4ba-7dcac16ece1e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.112725 Sep 03 20:54:45.719357 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 807/1591] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:45 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:45.726757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae66e6f550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:45.726757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.727278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.727713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:45.771008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.772534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.773137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:45.782242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ded25f59-c22d-4f6e-91a1-ae50035002ca tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.061684 Sep 03 20:54:45.792966 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 808/1592] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:45.792966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:45.792966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:45.798961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.799624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.800142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:45.800942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:45.801545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:45.802040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.074746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:46.085772 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42d9c0ea-7a27-49a4-b854-a87ae21291c7 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1503 microversion: 2.1 time: 0.301358 Sep 03 20:54:46.093173 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 809/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:45 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:46.093173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:46.093173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:46.100285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.100780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.101264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.102029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.102491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.103053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.374604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:46.391835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5f985306-6942-4271-b28c-bf807ca2d229 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.302950 Sep 03 20:54:46.394428 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 810/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:46 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:46.407836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ead9ead-68f2-4466-91c0-e02eda205850 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b96f940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:46.412666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ead9ead-68f2-4466-91c0-e02eda205850 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.413917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ead9ead-68f2-4466-91c0-e02eda205850 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.415624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ead9ead-68f2-4466-91c0-e02eda205850 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.462237 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ead9ead-68f2-4466-91c0-e02eda205850 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.066667 Sep 03 20:54:46.463520 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 811/1595] 10.222.0.16 () {58 vars in 1179 bytes} [Sat Sep 3 20:54:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:46.472798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd", "name": "network-vif-deleted", "tag": "9d132a32-0a12-45a3-bb6a-b25d42badeeb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:46.520049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.522403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.523498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.580438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] Creating event network-vif-deleted:9d132a32-0a12-45a3-bb6a-b25d42badeeb for instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd on nch1-master-1 Sep 03 20:54:46.600252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3749b490-88a2-4cb6-a774-f26352632870 req-a7517625-95ef-4f1b-8257-43ece394f972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131050 Sep 03 20:54:46.601550 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 812/1596] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:46.612105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:46.613352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:46.643889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.645053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.647938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.649328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.650096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.650728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.886268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:46.896010 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac5f005c-4444-467b-81e0-86085a670f89 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1260 microversion: 2.1 time: 0.291427 Sep 03 20:54:46.901808 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 813/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:46 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:46.916374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:46.916601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:46.928065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.928065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.928065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:46.928065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:46.928533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:46.928533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.057210 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11a93b25-f8bb-45f3-a022-531cb334f58d tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/action" status: 202 len: 0 microversion: 2.25 time: 4.216471 Sep 03 20:54:47.060705 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 785/1598] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:54:42 2022] POST /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/action => generated 0 bytes in 4222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:47.067379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae677b44c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.071028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.071953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.072646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.133455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.134498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.135249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.171371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.172379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.173092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.215083 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14737500-1f55-4a3b-b882-87890444c6c5 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.152463 Sep 03 20:54:47.216107 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 786/1599] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:47.226111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.228485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:47.237642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.238395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.239017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.240660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.241470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.242693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.400677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:47.414922 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-723b3d8d-8fe8-44c8-b565-bf9fdd001028 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1270 microversion: 2.1 time: 0.195730 Sep 03 20:54:47.431220 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 787/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:47.436388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2a70518-3ee2-47f5-879f-15df6aadf561 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66fd5160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.518104 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2a70518-3ee2-47f5-879f-15df6aadf561 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.085298 Sep 03 20:54:47.521757 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 788/1601] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:47.529090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.530437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:47.541907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.543805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.544521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.545542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.546231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.546906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.716815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:47.736988 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-496de774-5f89-4fc4-aa57-d19ddd92d355 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.834049 Sep 03 20:54:47.746015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 814/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:46 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:47.758573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.759193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:47.782368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.784604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.785336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.786440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.786563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:47.787309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.788049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.795951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:47.797453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:47.798644 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e752276b-5257-4d43-afb5-bd5fd4aa1dc8 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.274949 Sep 03 20:54:47.826710 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 789/1603] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:47.840871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b976040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.843375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.844054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.844671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.866269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.867722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.868882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.876516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e1a1c14-5ff0-46f5-9902-3bff84ae2678 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.048687 Sep 03 20:54:47.877992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 790/1604] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:47.884325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76315d5d-71e1-4200-9b11-3ef0bfb3d497 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1568796229", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76315d5d-71e1-4200-9b11-3ef0bfb3d497 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action HTTP/1.1 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 619 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:47.894297 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:47.895790 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:54:47.897024 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1568796229", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 03 20:54:47.897024 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:47.897024 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1568796229', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 03 20:54:47.897294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:47.898052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.901062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:54:47.902992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:47.917657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76315d5d-71e1-4200-9b11-3ef0bfb3d497 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:47.920106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-76315d5d-71e1-4200-9b11-3ef0bfb3d497 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action" status: 400 len: 938 microversion: 2.1 time: 0.040871 Sep 03 20:54:47.921556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 791/1605] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Sep 3 20:54:47 2022] POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action => generated 938 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:54:47.932703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae6b93e790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:47.938838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.940508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.941310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.972933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:47.973789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:47.974254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:47.989803 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d8fd351-47ed-4ed0-8019-a0b413271d89 tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.059403 Sep 03 20:54:48.005099 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 792/1606] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:48.011423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:48.012338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:48.022266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.023159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.023835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.026516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.027232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.027907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.056721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:48.305070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:48.335890 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91ca67ee-8130-4b3a-8f48-584041f6b427 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1266 microversion: 2.1 time: 0.327755 Sep 03 20:54:48.352575 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 793/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:48 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:48.378054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:48.381010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:48.398751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.399568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.400301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.402073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.403028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.404317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.622475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b23f4ce1d44682b0c187e8aac1a7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1442bbd96148d196c957d881a7449e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:48.634778 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e39a8e45-d402-4081-b4d8-ec8675f27efa tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 200 len: 1503 microversion: 2.1 time: 0.887334 Sep 03 20:54:48.658123 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 815/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:47 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 1503 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:48.667236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Calling method '.version_select at 0x7fae66e6f8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:48.676847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.679831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.680492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.715847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.716863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.718820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.747142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.758906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.763325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.813537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bbd705b6-8a5a-4fa5-b51f-66a7a5b95c9e tempest-HypervisorAdminTestJSON-501826886 tempest-HypervisorAdminTestJSON-501826886-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.153698 Sep 03 20:54:48.821907 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 816/1609] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Sep 3 20:54:48 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:48.871481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:48.876933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:48.924180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.932569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.934211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:48.938765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:48.942940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:48.946531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:49.217224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:49.232571 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bcd06eb7-965f-4af2-80ce-778ed7786f0a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.870161 Sep 03 20:54:49.234580 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 794/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:48 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:49.244685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa5d5a80-26c7-4b85-b5fa-d088d8b6d682 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d0160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:49.318486 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa5d5a80-26c7-4b85-b5fa-d088d8b6d682 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.080308 Sep 03 20:54:49.319931 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 795/1611] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:49 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:49.349282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:49.356062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:49.385627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:49.400668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:49.401171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:49.407867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:49.415988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:49.416526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:49.705478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:49.727685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0bd9a11b-9d14-4bea-930d-dd36ef584db8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.900568 Sep 03 20:54:49.757654 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 817/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:48 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:49.768638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56c3605-f6bb-4c09-af20-07fbc05f2448", "name": "network-vif-deleted", "tag": "dc36b6ba-3cbe-45a7-bbf1-4adde50178ef"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:49.809593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:49.810950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:49.812658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:49.833321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] Creating event network-vif-deleted:dc36b6ba-3cbe-45a7-bbf1-4adde50178ef for instance c56c3605-f6bb-4c09-af20-07fbc05f2448 on nch2-master-1 Sep 03 20:54:49.840795 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1e7a7304-3b87-440a-8266-ba4f6287c737 req-963418af-4e5e-4088-9ca3-43710bdf1058 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079553 Sep 03 20:54:49.842043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 818/1613] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:49.849194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:49.850655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:49.858587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:49.859369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:49.859988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:49.860876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:49.861612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:49.862501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.035614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:50.051312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:50.056139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:50.057679 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-335d2ea6-1e7f-4d15-91c4-81659b468998 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.729214 Sep 03 20:54:50.060396 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 796/1614] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:49 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:50.071966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.073527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.089348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.091401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.092215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.095273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.096600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.097449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.231402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:50.244618 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90fd2abd-660b-4a2a-9078-802baf8a0ba3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1266 microversion: 2.1 time: 0.181611 Sep 03 20:54:50.251831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 797/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:50.258106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.262268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.278054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.281133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.281926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.283963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.285125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.290102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.319712 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 HTTP/1.1 Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:50.324634 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.326112 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c56c3605-f6bb-4c09-af20-07fbc05f2448'} Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:50.326940 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.328205 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.334831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:50.339116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dbc8740f-582a-4fb2-8ee4-deb9387c07b4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 404 len: 111 microversion: 2.1 time: 0.085709 Sep 03 20:54:50.339953 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 798/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:50.348616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1dfc1c8b-892e-41ae-a2aa-2f45c92f97e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b88e820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.353140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:50.378617 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90b5c2bc-f4c7-4177-bc36-98b392952dd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.533818 Sep 03 20:54:50.380021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 819/1617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:49 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:50.418628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.461699 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1dfc1c8b-892e-41ae-a2aa-2f45c92f97e5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.120303 Sep 03 20:54:50.464705 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 799/1618] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:50.475419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_groups [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Querying cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) for 1 instances {{(pid=140519) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 03 20:54:50.476432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.479496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.480391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.484076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d24e36e-fddc-4c17-ba61-a102d91dd2b1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d24e36e-fddc-4c17-ba61-a102d91dd2b1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action HTTP/1.1 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 285 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:50.500061 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:54:50.502180 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:54:50.503011 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:54:50.503776 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:54:50.505318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:54:50.506553 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 20:54:50.506553 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.508012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d24e36e-fddc-4c17-ba61-a102d91dd2b1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:50.509787 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d24e36e-fddc-4c17-ba61-a102d91dd2b1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action" status: 400 len: 619 microversion: 2.1 time: 0.043937 Sep 03 20:54:50.512112 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 800/1619] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Sep 3 20:54:50 2022] POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:54:50.520222 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c2b220b2-4c06-48f0-9264-0501b81b50e9 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.120382 Sep 03 20:54:50.533844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 820/1620] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:50.538029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.539298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.541569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.575479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.576061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.576573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.577511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.578048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.578548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.593384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_groups [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Querying cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) for 1 instances {{(pid=140519) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 03 20:54:50.597918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.600859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.604130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.633846 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bfbef52a-1e04-4a95-8688-e1f48d219e49 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e" status: 200 len: 184 microversion: 2.1 time: 0.096285 Sep 03 20:54:50.634819 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 821/1621] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e => generated 184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:50.648775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.664251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.671066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.679945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.680712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.681719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.682373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.684804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.711567 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 HTTP/1.1 Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:54:50.713705 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.715191 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c56c3605-f6bb-4c09-af20-07fbc05f2448'} Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:50.716029 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.717389 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.722620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:50.724084 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-295754f5-01a1-452f-9d19-8fe7db4c66ba tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 404 len: 111 microversion: 2.1 time: 0.080154 Sep 03 20:54:50.726341 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 822/1622] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:54:50 2022] DELETE /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:50.739193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.740613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] [instance: c56c3605-f6bb-4c09-af20-07fbc05f2448] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.748135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:50.751302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.752489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.753266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.754230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.755394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.756641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.816764 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 HTTP/1.1 Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:54:50.825520 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.826978 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c56c3605-f6bb-4c09-af20-07fbc05f2448'} Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:50.827758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. Sep 03 20:54:50.829153 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:50.835403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance c56c3605-f6bb-4c09-af20-07fbc05f2448 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:50.854327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e5a2eeb-d40a-43e0-a876-8e2fc6c5156a tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448" status: 404 len: 111 microversion: 2.1 time: 0.108789 Sep 03 20:54:50.858700 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 823/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/servers/c56c3605-f6bb-4c09-af20-07fbc05f2448 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:50.872098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:50.878255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:50.894951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.899437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.901433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:50.904877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:50.906279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:50.909957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.223772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:51.241123 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a62bef40-19a8-498b-8741-2ed5fa7e6bbd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.720307 Sep 03 20:54:51.248378 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 801/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:51.256150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5dc5a298-33af-4b8a-b099-503e6cbc0485 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:51.275210 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-5dc5a298-33af-4b8a-b099-503e6cbc0485 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5dc5a298-33af-4b8a-b099-503e6cbc0485 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-server-groups/84a1340d-26ec-4d67-9f3a-e46be3d12098 HTTP/1.1 Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:51.277332 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. Sep 03 20:54:51.279129 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '84a1340d-26ec-4d67-9f3a-e46be3d12098'} Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:51.283968 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. Sep 03 20:54:51.285285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:51.286336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5dc5a298-33af-4b8a-b099-503e6cbc0485 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance group 84a1340d-26ec-4d67-9f3a-e46be3d12098 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:51.286336 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5dc5a298-33af-4b8a-b099-503e6cbc0485 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/84a1340d-26ec-4d67-9f3a-e46be3d12098" status: 404 len: 117 microversion: 2.1 time: 0.026807 Sep 03 20:54:51.286336 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 802/1625] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:51 2022] DELETE /compute/v2.1/os-server-groups/84a1340d-26ec-4d67-9f3a-e46be3d12098 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:51.286336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:51.286336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:51.293357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.293850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.294292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.295720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.296362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.296997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.507004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:51.521206 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-275ccf95-fa38-4808-bb1e-e65e685c0374 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.660037 Sep 03 20:54:51.522298 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 824/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:50 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:51.539260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:51.543864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:51.563080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.564031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.565453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.573131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.573872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.574479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.795525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:51.807715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:51.814802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:51.816386 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40a42bcd-9806-40b6-bc92-b885ac6bcc59 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.535663 Sep 03 20:54:51.819408 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 803/1627] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:51 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:51.836390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:51.839259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:51.871368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.872135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.872826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:51.873889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:51.874832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:51.875497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:52.016237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:52.061380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:52.256927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:52.275188 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13d3ac74-a7ad-493b-a4ec-d2d146f9954b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.735917 Sep 03 20:54:52.277000 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 825/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:51 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:52.312605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d537348-2d8e-45b3-ae40-580e427c3c56 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:52.324876 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-6d537348-2d8e-45b3-ae40-580e427c3c56 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d537348-2d8e-45b3-ae40-580e427c3c56 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-server-groups/e761ba77-3c94-43b8-b8f3-48b86399efb7 HTTP/1.1 Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:54:52.327420 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. Sep 03 20:54:52.328849 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e761ba77-3c94-43b8-b8f3-48b86399efb7'} Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:52.329702 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. Sep 03 20:54:52.333076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.337116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d537348-2d8e-45b3-ae40-580e427c3c56 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance group e761ba77-3c94-43b8-b8f3-48b86399efb7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:52.340759 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d537348-2d8e-45b3-ae40-580e427c3c56 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e761ba77-3c94-43b8-b8f3-48b86399efb7" status: 404 len: 117 microversion: 2.1 time: 0.047664 Sep 03 20:54:52.341891 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 826/1629] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:52 2022] DELETE /compute/v2.1/os-server-groups/e761ba77-3c94-43b8-b8f3-48b86399efb7 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:52.361900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0dee631d-59c4-4901-9047-3d8a4b53c9cb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b893af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:52.531351 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0dee631d-59c4-4901-9047-3d8a4b53c9cb tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.187895 Sep 03 20:54:52.531953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 827/1630] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:52 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:52.536636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:52.547633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:52.548524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:52.549175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:52.566164 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] Creating event network-changed:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:54:52.590032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-14431091-595d-4333-ae34-c6b6f7d60630 req-55f80516-4b5c-4cdd-bf51-3ef9b3a99b52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056736 Sep 03 20:54:52.597542 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 828/1631] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:52.632462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-779856517"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:52.643676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:52.686984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:52.687522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:52.688036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:52.688809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:52.689316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:52.689757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:52.851600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:52.896886 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5aed2255-e41d-4f39-8760-bbfc880a7565 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 1.075931 Sep 03 20:54:52.913001 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 804/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:51 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:52.937071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9efcc09-3e1b-49f7-a866-427ca5421e57 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:52.954733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d9efcc09-3e1b-49f7-a866-427ca5421e57 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9efcc09-3e1b-49f7-a866-427ca5421e57 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-server-groups/062df827-e967-4fa6-915b-39253843a209 HTTP/1.1 Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:52.963421 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. Sep 03 20:54:52.965000 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '062df827-e967-4fa6-915b-39253843a209'} Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:52.965792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. Sep 03 20:54:52.967551 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:52.970854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9efcc09-3e1b-49f7-a866-427ca5421e57 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance group 062df827-e967-4fa6-915b-39253843a209 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:52.970854 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9efcc09-3e1b-49f7-a866-427ca5421e57 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/062df827-e967-4fa6-915b-39253843a209" status: 404 len: 117 microversion: 2.1 time: 0.050588 Sep 03 20:54:52.972584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 805/1633] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:52 2022] DELETE /compute/v2.1/os-server-groups/062df827-e967-4fa6-915b-39253843a209 => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:52.982670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:52.982847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:52.998415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.004250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.005222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.006317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.008088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.010597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.495917 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b7e5e912-998d-41a6-bff5-f783b795410a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action" status: 202 len: 0 microversion: 2.1 time: 0.890126 Sep 03 20:54:53.497572 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 829/1634] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:52 2022] POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:54:53.512481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:53.514090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:53.525228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.525755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.526207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.527530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.528466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.528466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.576924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:53.811163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:53.824598 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21222b4c-12ed-469b-a5be-0159ea89ed76 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.849558 Sep 03 20:54:53.826461 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 806/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:52 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:53.832054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c3d4992-1ffc-4b6a-a811-b76c41f61269 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:53.860349 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8c3d4992-1ffc-4b6a-a811-b76c41f61269 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] HTTP exception thrown: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c3d4992-1ffc-4b6a-a811-b76c41f61269 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Request method failure captured: Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-server-groups/fa21e706-515c-4702-bcb1-800bf69da4c8 HTTP/1.1 Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7723yPSoU97o3FhLipaE88JwWHm23q5gO7x6bd-o-AdM8JF3QGkyCpOTC7A4VXPPscJhZhP7vWWGOl2ojix8OBKBDIATlXWGo4i2m1DhCR3rrMD2JGq6zuI_msrr8qapEM-36Esgxp9nbpMVe-lTRBJ-oE2YsnTicA5tvwvDiP2nhI Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:53.872866 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5e1442bbd96148d196c957d881a7449e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5e1442bbd96148d196c957d881a7449e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5e1442bbd96148d196c957d881a7449e Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerGroupTestJSON-1953155465 Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 18b23f4ce1d44682b0c187e8aac1a7df Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerGroupTestJSON-1953155465-project Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. Sep 03 20:54:53.874835 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'fa21e706-515c-4702-bcb1-800bf69da4c8'} Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:53.875917 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. Sep 03 20:54:53.877500 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.881958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c3d4992-1ffc-4b6a-a811-b76c41f61269 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Returning 404 to user: Instance group fa21e706-515c-4702-bcb1-800bf69da4c8 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:53.885239 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c3d4992-1ffc-4b6a-a811-b76c41f61269 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fa21e706-515c-4702-bcb1-800bf69da4c8" status: 404 len: 117 microversion: 2.1 time: 0.057226 Sep 03 20:54:53.888928 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 807/1636] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:53 2022] DELETE /compute/v2.1/os-server-groups/fa21e706-515c-4702-bcb1-800bf69da4c8 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:54:53.894434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-766782005"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:53.903038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:53.923785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.926071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.926952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.928115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:53.932581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:53.934920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:53.977649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:53.987106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Cannot 'createImage' instance b73e36a8-4981-4140-a12e-274a9bd217a7 while it is in task_state image_snapshot Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action HTTP/1.1 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 84 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:54:53.990314 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-766782005"}} Sep 03 20:54:53.992063 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'createImage' instance b73e36a8-4981-4140-a12e-274a9bd217a7 while it is in task_state image_snapshot Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-766782005'}}} Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:54:53.992946 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance b73e36a8-4981-4140-a12e-274a9bd217a7 while it is in task_state image_snapshot Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance b73e36a8-4981-4140-a12e-274a9bd217a7 while it is in task_state image_snapshot Sep 03 20:54:53.994347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:54:53.997352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 409 to user: Cannot 'createImage' instance b73e36a8-4981-4140-a12e-274a9bd217a7 while it is in task_state image_snapshot {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:54:53.998978 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-02699922-f85d-44b2-b74b-f88d669ed404 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action" status: 409 len: 159 microversion: 2.1 time: 0.108127 Sep 03 20:54:53.999378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:53.999956 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 808/1637] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:53 2022] POST /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7/action => generated 159 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:54:54.004279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:54.007118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12916401-09b5-44c3-867c-57c41bb15cf3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b97e4c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.013090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f2e6ca8-dff2-4a7f-a38e-39d87a38fa3a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.511357 Sep 03 20:54:54.016538 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 830/1638] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:53 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:54.030117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-175179fb-0e38-4647-aadf-cff81f50abf4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.072873 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12916401-09b5-44c3-867c-57c41bb15cf3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.071544 Sep 03 20:54:54.074531 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 809/1639] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:54 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:54.079833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.080674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:54.089672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.090837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.091679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.092771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.093735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.094549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.099340 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-175179fb-0e38-4647-aadf-cff81f50abf4 tempest-ServerGroupTestJSON-1953155465 tempest-ServerGroupTestJSON-1953155465-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e" status: 204 len: 0 microversion: 2.1 time: 0.077998 Sep 03 20:54:54.105251 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 831/1640] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 20:54:54 2022] DELETE /compute/v2.1/os-server-groups/83010238-2801-4521-811b-079b97fabc4e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:54.135087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be9d083-663e-4b1d-b5ac-a180071ebc7b", "tag": "6b2cf02c-42d5-461b-bff2-0398711802ff"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:54.173201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.173960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.176937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.219967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:54.232285 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] Creating event network-changed:6b2cf02c-42d5-461b-bff2-0398711802ff for instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b on nch1-master-1 Sep 03 20:54:54.258530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3c3c34a9-5bbc-4a99-a983-09595295c8ab req-f2b376cf-a585-4175-a777-9fc2d42222b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147045 Sep 03 20:54:54.263019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 832/1641] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:54:54.274908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b6a14b2-a44b-4ae6-872c-0356c09840a2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae67026a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.433604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:54.446401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a459d3a-b51e-4e7a-a428-7b728ec251f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.370197 Sep 03 20:54:54.463674 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 810/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:54 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:54.604241 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b6a14b2-a44b-4ae6-872c-0356c09840a2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/images/38b512aa-b9ba-4820-bfde-2ba0a7b9e847" status: 204 len: 0 microversion: 2.1 time: 0.338079 Sep 03 20:54:54.605154 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 833/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:54 2022] DELETE /compute/v2.1/images/38b512aa-b9ba-4820-bfde-2ba0a7b9e847 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:54.613315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.614198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:54.626514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.627487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.628255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.629187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.629811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.632994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.853264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:54.853911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:54.891774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.892328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.896337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.898675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:54.900027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:54.903727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:54.986906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:55.003761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e7f7642-e6fb-4bd3-b76d-524f5c195a64 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1533 microversion: 2.1 time: 0.387596 Sep 03 20:54:55.005480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 811/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:54 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1533 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:55.042506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:55.045650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:55.058954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:55.060657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:55.062833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:55.066601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:55.067290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:55.067913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:55.324758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:55.602993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:55.621780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:55.623837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:55.638130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-325f070c-941f-4c41-9934-89074e40d659 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.586586 Sep 03 20:54:55.639116 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 812/1645] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:55 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:54:55.644778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1039fbef-eeb3-4066-87bc-cf361dc2f30a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b93e4c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:55.719098 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1039fbef-eeb3-4066-87bc-cf361dc2f30a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1452 microversion: 2.1 time: 0.078555 Sep 03 20:54:55.728162 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 813/1646] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:55 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:55.739446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:55.743565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:55.783499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:55.784314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:55.784957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:55.785890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:55.786696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:55.787313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:55.836055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:55.846632 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-532d6274-8c4e-44d4-a7f5-638f3d3c098c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.997354 Sep 03 20:54:55.865737 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 834/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:54 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:54:56.030281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:56.043020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8eac315e-7a2b-467b-a32b-0e7307493915 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.313861 Sep 03 20:54:56.043600 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 814/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:55 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:56.060821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.061831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:56.071568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.072186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.072766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.073627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.080718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.081602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.147592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Calling method '.version_select at 0x7fae6b883af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.151825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.154251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.154983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.179955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.180726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.181390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.233576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.234888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.235745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.261424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.262394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.263083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.283214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:56.295314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b15527bf-bc05-479f-a442-e81000d81fd9 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1539 microversion: 2.1 time: 0.246897 Sep 03 20:54:56.310584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 815/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:56.344752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.352392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.352392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.356495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-92603a1f-104b-47bf-ac7e-3593d544fe1c tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2704 microversion: 2.53 time: 0.489190 Sep 03 20:54:56.357406 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 835/1650] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Sep 3 20:54:55 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2704 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:56.382124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Calling method '.version_select at 0x7fae670663a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.386021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.386728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.387372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.413982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.414501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.414956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.451125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.452502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.453006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.463539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:56.467534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.468296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.469218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.507900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.508436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.508885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.515994 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cc73d1a-6dd2-49dd-a5b6-9b3d7799169a tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1397 microversion: 2.53 time: 0.141337 Sep 03 20:54:56.516803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 816/1651] 10.222.0.16 () {60 vars in 1222 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1397 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:56.530361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Calling method '.version_select at 0x7fae67026f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.535446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.535999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.536442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.570764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.571208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.571643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.579145 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a32fe69f-7d09-407b-9dec-f40f0c34d825 tempest-HypervisorAdminV253TestBase-1316435193 tempest-HypervisorAdminV253TestBase-1316435193-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/84888147-675f-4a26-b80e-126fb4156f38" status: 200 len: 792 microversion: 2.53 time: 0.052355 Sep 03 20:54:56.581066 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 836/1652] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/os-hypervisors/84888147-675f-4a26-b80e-126fb4156f38 => generated 792 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:54:56.687782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.688713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:56.705472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.706319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.706861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.707551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.708234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.708718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.714646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:56.736655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-86478be2-77c2-4bf8-ae95-00144462b596 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8934c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.845792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-86478be2-77c2-4bf8-ae95-00144462b596 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1461 microversion: 2.1 time: 0.114481 Sep 03 20:54:56.846805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 837/1653] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:56.860843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc0055bb-5c90-4e37-bb17-765604fe5f19 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8853a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.921962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:56.934653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:56.938251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:56.939594 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df8c4c99-3436-41fa-a9c5-a9423c7f1f18 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.262235 Sep 03 20:54:56.940780 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 817/1654] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:56.945797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.946551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:56.953647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.955665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.956410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.958017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:56.958623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:56.959151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:56.964454 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc0055bb-5c90-4e37-bb17-765604fe5f19 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 200 len: 1461 microversion: 2.1 time: 0.083564 Sep 03 20:54:56.977066 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 838/1655] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:56.987700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:56.988979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:57.004322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.009831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.011935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.013191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.013897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.014539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.151410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:57.160941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c3857646-26d7-4a6d-b595-ecafab5b45c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.218804 Sep 03 20:54:57.161775 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 818/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:57.170869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:57.171892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:57.180056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.181018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.182346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.183381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.184765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.185439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.254517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:57.264146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-abe6cc87-3ba7-46dc-800f-23fbde60d6e7 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1467 microversion: 2.1 time: 0.282495 Sep 03 20:54:57.264655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 839/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:56 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1467 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:57.285527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-298090051"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:54:57.287969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:57.294982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.295834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.296450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.297414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.298035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.308764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.743251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-215dcdac-6d14-47c1-a310-eab1e57a5701 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "POST /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f/action" status: 202 len: 0 microversion: 2.1 time: 0.461277 Sep 03 20:54:57.749377 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 840/1658] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:54:57 2022] POST /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 03 20:54:57.749607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:57.757283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:57.758088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:57.769393 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-44e14a1c-e71d-4e73-b4b8-c8746deabfcc tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.606183 Sep 03 20:54:57.785828 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 819/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:57 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:57.790069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.790914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.791288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.792454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5c71fbc-81cc-45f1-b7e8-e689f7c76c5a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b88ed30>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:57.794065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.794065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:57.794297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:57.923204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5c71fbc-81cc-45f1-b7e8-e689f7c76c5a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.128803 Sep 03 20:54:57.926074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 820/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:57 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:57.970136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:57.970768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:57.994386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:57.995646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:58.002306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:58.007263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:58.008198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:58.008945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:58.252917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:58.278657 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04ef790e-7544-458f-99fb-51955508664e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1521 microversion: 2.1 time: 0.522463 Sep 03 20:54:58.282743 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 841/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:57 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:58.297307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:58.300481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:58.313827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:58.316415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:58.316415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:58.316415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:58.316415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:58.317460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:58.999424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:59.014079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2fd7545-dfa2-4861-88f2-5f95b97bb943 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.728869 Sep 03 20:54:59.029583 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 842/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:58 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:59.042997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:59.044744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:59.062621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.063281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.064013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:59.065389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.066695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.068360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:59.123879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:54:59.283923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:59.297023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:59.300271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:54:59.302051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bc91205a-f64e-4a2a-a972-5817b4c387dc tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 1.337180 Sep 03 20:54:59.303395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 821/1663] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:54:57 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:54:59.323515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:59.324156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:59.343945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.344960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.346512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:59.348025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.348767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.356831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:59.443719 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-140e8e1f-80c9-4c0c-8b28-72313c03f04e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 204 len: 0 microversion: 2.1 time: 0.412242 Sep 03 20:54:59.444420 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 843/1664] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:54:59 2022] DELETE /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:54:59.457806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7077f0b9-52b6-4f26-bc04-95d107c6ea96 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b885280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:59.561328 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7077f0b9-52b6-4f26-bc04-95d107c6ea96 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.115382 Sep 03 20:54:59.562521 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 844/1665] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:59 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:54:59.567990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:54:59.569371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:54:59.581453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.584693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.591650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:54:59.592691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:54:59.601114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:54:59.602066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.242074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:00.257419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b47447ce-dfc7-4d4f-8123-bac7236fe57c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1527 microversion: 2.1 time: 0.691132 Sep 03 20:55:00.260776 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 845/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:59 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1527 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:00.272068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "name": "network-vif-unplugged", "status": "completed", "tag": "a7600aef-f597-4126-9418-5db497d829db"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:00.330804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:00.331669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:00.334104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:00.334557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.344676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b32cec09-6ec4-40a4-b592-efe89354639a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 1.025156 Sep 03 20:55:00.348865 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 822/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:54:59 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:00.355828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:00.372580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:00.373606 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] Creating event network-vif-unplugged:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch2-master-1 Sep 03 20:55:00.399143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:00.399832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d27be68e-869d-4aad-808b-1ba71699a358 req-72427cca-2ae4-4507-83f3-686b86433096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134897 Sep 03 20:55:00.400821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:00.402663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.402839 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 846/1668] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:00.403607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:00.404097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:00.404536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.422596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:00.428431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:00.478984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:00.490835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:00.491571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.492456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:00.493300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:00.494549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:00.885968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:00.899634 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2901ed4d-fca7-48c6-8218-deba1ea508f1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.547814 Sep 03 20:55:00.900765 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 823/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:00 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:00.906822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10ead105-2ecd-407b-ad95-7b1e5a865a2a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b90aca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:00.995246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:01.007152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:01.010111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:01.011940 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d97f8500-7dff-40d4-9ae7-85dd6b84e4a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.603698 Sep 03 20:55:01.021556 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 847/1670] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:00 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:01.056878 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-10ead105-2ecd-407b-ad95-7b1e5a865a2a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.154757 Sep 03 20:55:01.058170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73e36a8-4981-4140-a12e-274a9bd217a7", "name": "network-vif-plugged", "status": "completed", "tag": "6d0ff3ac-69da-425c-ab25-ecfde26f9d56"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:01.058916 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 824/1671] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:00 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:01.099706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:01.100233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:01.102198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:01.164372 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] Creating event network-vif-plugged:6d0ff3ac-69da-425c-ab25-ecfde26f9d56 for instance b73e36a8-4981-4140-a12e-274a9bd217a7 on nch2-master-1 Sep 03 20:55:01.175199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0d1d7120-bafc-4ad2-a91e-fa6d56d8dfe8 req-31f31a6e-db42-485b-a25a-72157dd0d2f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147968 Sep 03 20:55:01.176543 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 848/1672] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:01.290638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:01.291732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:01.320199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:01.324493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:01.327606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:01.339612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:01.340309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:01.340611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:01.385809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:01.386526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:01.420454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:01.421317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:01.426296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:01.440863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:01.449543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:01.450321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.213941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.238901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90f22cf9-2036-4420-8a1c-a0dbd9eac2b2 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1527 microversion: 2.1 time: 0.954952 Sep 03 20:55:02.265327 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 825/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:01 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1527 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:02.286390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.288350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:02.289506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:02.298868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:02.299364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:02.300089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.301272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:02.301766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:02.302597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.307101 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a2d760a-a00f-43cb-92a3-d300c8a2c53e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.932065 Sep 03 20:55:02.308283 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 849/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:01 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:02.316937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:02.321512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:02.334975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:02.336425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:02.337143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.339427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:02.340084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:02.346069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.351438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:02.527545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.536271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c7106776-80bd-4f5a-a406-339b62ff0f89 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.267990 Sep 03 20:55:02.553821 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 826/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:02 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:02.559308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6cd4c6e6-e385-4f75-b983-340a728ce90b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b997430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:02.623174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6cd4c6e6-e385-4f75-b983-340a728ce90b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.067255 Sep 03 20:55:02.624296 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 827/1676] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:02 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:02.629512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "tag": "a7600aef-f597-4126-9418-5db497d829db"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:02.641623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:02.642764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:02.643514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:02.659608 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] Creating event network-changed:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch2-master-1 Sep 03 20:55:02.672991 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4af9f7fe-b582-469e-bb67-d52164f46584 req-37476d6d-9597-44a7-9e69-cf9dba0bfdc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046607 Sep 03 20:55:02.674900 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 828/1677] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:02.820042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.841562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.845405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:02.847402 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b288bf28-5455-48bb-a670-e0582076fdea tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.537592 Sep 03 20:55:02.850177 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 850/1678] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:02 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:03.270494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:03.271599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:03.292647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868e0374-e87b-47bb-b1c6-454b021cb0c7", "name": "network-vif-unplugged", "status": "completed", "tag": "6fdb39ff-6197-4b7f-b337-ca2c08b9dbab"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:03.297712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.304431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.305206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.306116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.306611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.307341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.317207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.317704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.318699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.351373 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] Creating event network-vif-unplugged:6fdb39ff-6197-4b7f-b337-ca2c08b9dbab for instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 on nch1-master-1 Sep 03 20:55:03.368218 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-86ca8265-04a7-40da-9c58-4c33d0748731 req-f0300539-412d-4d18-bd64-fd55038bb875 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082120 Sep 03 20:55:03.370174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 851/1679] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:55:03.387810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:03.388520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:03.395500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.396540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.404825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.406095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.406768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.407420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.480167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:03.489686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-827c2527-bd1c-4d53-967f-9a2c8a0f3ae7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 200 len: 1485 microversion: 2.1 time: 0.223666 Sep 03 20:55:03.492417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 829/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:03 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 1485 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:03.560225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:03.560871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:03.571128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.571871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.572542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.573534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:03.574494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:03.575180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:03.844726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:03.880310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ffad8f1-ed4b-452b-8b6d-05105c7c4311 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.508557 Sep 03 20:55:03.882266 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 852/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:03 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:03.896769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-34547d8c-1e28-465e-8dc5-c27a3d560c13 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b808160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:04.035453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-34547d8c-1e28-465e-8dc5-c27a3d560c13 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.150818 Sep 03 20:55:04.036318 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 853/1682] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:03 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:04.049450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:04.050521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:04.064179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:04.065267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:04.070413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:04.071581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:04.074162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:04.075012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:04.093748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:04.110384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a4756ea-9e98-4000-b53f-4e74b78bd425 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.554663 Sep 03 20:55:04.112213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 830/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:03 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:04.457654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1040502766", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eca47d48-10bc-437f-b0d1-1cf63a3c4084"}], "block_device_mapping_v2": [{"uuid": "3e825662-5770-41ff-ab3b-2e5005a78362", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:04.546567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] validate_networks() for [('eca47d48-10bc-437f-b0d1-1cf63a3c4084', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:05.309436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:05.322874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:05.337811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:05.341970 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f466cb3-9d80-4c39-8761-b979c2255b53 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 1.302994 Sep 03 20:55:05.343335 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 854/1684] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:04 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:05.353339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:05.357026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:05.376517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.377292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.379316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.380370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.382150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.384406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.408199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 HTTP/1.1 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:55:05.410271 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:55:05.411975 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7'} Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:55:05.413373 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:55:05.415974 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:05.420130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:55:05.421316 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea012cc5-6ce7-4813-8ff0-d168b4cfce91 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 404 len: 111 microversion: 2.1 time: 0.074608 Sep 03 20:55:05.422665 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 855/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:05 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:55:05.435215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:05.436225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:05.443358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.444186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.444865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.445848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.446546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.447225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.694882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:05.718945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0dc571af-32d9-40c3-93e9-dd63fec01d22 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.285670 Sep 03 20:55:05.735755 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 856/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:05 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:05.755002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b73e36a8-4981-4140-a12e-274a9bd217a7", "name": "network-vif-deleted", "tag": "6d0ff3ac-69da-425c-ab25-ecfde26f9d56"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:05.783802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.787903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.788619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.822758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] Creating event network-vif-deleted:6d0ff3ac-69da-425c-ab25-ecfde26f9d56 for instance b73e36a8-4981-4140-a12e-274a9bd217a7 on nch2-master-1 Sep 03 20:55:05.838264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c97f3296-14e9-45b9-bd2e-89a09d5e9ac6 req-61a8c228-dffa-475f-b505-390e68e36b23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095425 Sep 03 20:55:05.840822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 857/1687] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:05.851697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93b9a166-5241-4ed4-8a76-3fc59f4233a5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8ade50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:05.934450 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93b9a166-5241-4ed4-8a76-3fc59f4233a5 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.091706 Sep 03 20:55:05.945643 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 858/1688] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:05 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:05.952841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:05.955628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:05.964043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.965782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.966677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.967604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:05.968558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:05.969414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:05.994277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:05.994906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:05.995148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:05.996971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:05.997579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:06.016976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.017647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.017906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.020568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.021972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.023270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.054150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:06.061007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Getting quotas for user 90d7e4c2e577467f949be3dc480cc7a2 and project 6a7e10b9d8594d16a4c1eb63196ea329. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:06.169814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:06.172184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e825662-5770-41ff-ab3b-2e5005a78362',volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:06.217058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:06.242487 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-928fb114-314e-4563-a6c7-784b8b025245 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.291067 Sep 03 20:55:06.243774 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 859/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:05 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:06.264831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2fad32cc-dd4c-4af8-b7fd-6759f67d6259 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'create', calling method: .version_select at 0x7fae6b826dc0>, body: {"keypair": {"name": "tempest-keypair-1629463894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV1uF0DwrT67WA5Am2mdkg4QQKPSR2FVmprO+1VabbUIhYVn7VoCjUJevVsAE2iU7ccB2EB4DsQKf9kFiEuJP5WEqyaPbp0nxezTSpqP8OathIR+gvHe1T4ASiXJvpN+w=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:06.290012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2fad32cc-dd4c-4af8-b7fd-6759f67d6259 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:06.300309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2fad32cc-dd4c-4af8-b7fd-6759f67d6259 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for user 27be6827d30e48acac9a59786021f7bb and project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:06.334863 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2fad32cc-dd4c-4af8-b7fd-6759f67d6259 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087771 Sep 03 20:55:06.343306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 860/1690] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:55:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:06.357125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-plugged", "status": "completed", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:06.380276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.382759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.384181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.399306 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] Creating event network-vif-plugged:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:55:06.405149 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-91f55f68-bdc9-4fdd-947a-fa838b769f45 req-6a0c1683-b132-4c41-9964-e270212a1b16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Sep 03 20:55:06.406407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 861/1691] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:06.412136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:06.413472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:06.421147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.422007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.422781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.424121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.424863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.425573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.631641 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ee263f39-3874-4d66-a146-8cec265857b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.191015 Sep 03 20:55:06.639936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 831/1692] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:06.655680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3cbedff3-0489-4a1c-af4b-622e66f103a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:06.673706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3cbedff3-0489-4a1c-af4b-622e66f103a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:06.847847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:06.861472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:06.867637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:06.870265 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b16dde9-55f0-4767-8f97-a2c8220e83a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.461615 Sep 03 20:55:06.873170 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 862/1693] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:06 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:06.880760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3cbedff3-0489-4a1c-af4b-622e66f103a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:06.888174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3cbedff3-0489-4a1c-af4b-622e66f103a8 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1053 microversion: 2.1 time: 0.241537 Sep 03 20:55:06.903484 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 832/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:06 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1053 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:06.914227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:06.914893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:06.925514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.926866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.927560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.932608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:06.935176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:06.935841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:06.951729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3506d60c-9d5d-4609-a446-b8b743bc6fce tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae671fef70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:07.065311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3506d60c-9d5d-4609-a446-b8b743bc6fce tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.113559 Sep 03 20:55:07.074333 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 833/1695] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:06 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:07.223992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:07.236799 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-933c02ae-85c3-4c45-a8da-ad1668a93bec tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.361267 Sep 03 20:55:07.238473 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 863/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:06 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:07.269991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:07.271570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:07.282067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.282841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.283494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:07.284406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.285082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.285677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:07.582933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:07.603820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22358e8c-2451-412b-bb46-1d79260ee985 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.336693 Sep 03 20:55:07.606515 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 834/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:07 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:07.902903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:07.904235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:07.915128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:07.916004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:07.917136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.921648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.922403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:07.923359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.924024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.924190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.924533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.924994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:07.930166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:07.932770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:07.933288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:07.933735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.146109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.168881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-33f2d426-f5ee-4c09-b48d-045b32660239 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1103 microversion: 2.1 time: 0.257481 Sep 03 20:55:08.190711 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 835/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:07 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1103 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:08.209655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ddbd4e1e-a567-4937-84d0-8cdde8eab132 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6741f700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:08.299743 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ddbd4e1e-a567-4937-84d0-8cdde8eab132 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.105182 Sep 03 20:55:08.303600 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 836/1699] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:08 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:08.315774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:08.316422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:08.333721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:08.337910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:08.338474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.342440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:08.343484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:08.345260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.524756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.540201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.543483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.547690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6052d419-7259-4669-9e4d-4951671e7972 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.650058 Sep 03 20:55:08.549731 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 864/1700] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:07 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:08.565139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-plugged", "status": "completed", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}, {"server_uuid": "0be9d083-663e-4b1d-b5ac-a180071ebc7b", "name": "network-vif-plugged", "status": "completed", "tag": "6b2cf02c-42d5-461b-bff2-0398711802ff"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:08.600243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:08.601221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:08.601918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.634588 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Creating event network-vif-plugged:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:55:08.635110 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] Creating event network-vif-plugged:6b2cf02c-42d5-461b-bff2-0398711802ff for instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b on nch1-master-1 Sep 03 20:55:08.653345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8078bdb7-1d78-439e-a94b-ce04a656b62a req-810d777d-492b-47cf-92d0-1840353dd6b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095743 Sep 03 20:55:08.655291 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 865/1701] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:08.665702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:08.666871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:08.675903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:08.682655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:08.685485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:08.686889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.687940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:08.688622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:08.689280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:08.941390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.952264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffe0fb6e-6045-42bd-bbfa-27431b28a63b tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1312 microversion: 2.1 time: 0.293013 Sep 03 20:55:08.962142 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 866/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:08 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:08.991305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:08.999251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c8ff6365-3ae6-4909-8801-7f6f53d532e1 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.693607 Sep 03 20:55:09.001388 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 837/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:08 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:09.191689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:09.192318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:09.203974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:09.204476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:09.204935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:09.205665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:09.206128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:09.206559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:09.319418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4efdeaed-3e17-49c6-bba0-30e88053b178 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b90aca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:09.407242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:09.409440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4efdeaed-3e17-49c6-bba0-30e88053b178 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.092733 Sep 03 20:55:09.413749 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 838/1704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:09 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:09.415640 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba253a28-e7c8-4ab1-b9c8-f8f9bdbba145 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1169 microversion: 2.1 time: 0.227947 Sep 03 20:55:09.421372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 867/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:09 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:09.581541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:09.581794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:09.599545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:09.600066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:09.614145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:09.617383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:09.621008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:09.621793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:09.988633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:09.990970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:10.007811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:10.009171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:10.011134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:10.014501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:10.015327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:10.016759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:10.453178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:10.467529 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4fdfa85-8969-4550-a6b2-1893dd24bf61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1461 microversion: 2.1 time: 0.486410 Sep 03 20:55:10.470915 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 868/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:09 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1461 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:10.482799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:10.501792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:10.505622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:10.516591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:10.525325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:10.529734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:10.530440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:10.530680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4fee8704-aa69-4992-b327-d28532ac224c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.953976 Sep 03 20:55:10.531413 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 839/1707] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:09 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:10.532048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:10.533004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:10.537532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:10.538976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:10.563643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1242153819", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:10.782869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] validate_networks() for [('6233c6b9-6d19-495f-97e8-118b2a607de6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:11.195144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:11.206565 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b23e9d3-62cb-416d-9968-f200b02a07f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1308 microversion: 2.1 time: 0.734468 Sep 03 20:55:11.211527 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 869/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:10 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1308 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:11.217739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e63c34c0-1eaa-41cb-bd87-aaca953d7340 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b813160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:11.325361 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e63c34c0-1eaa-41cb-bd87-aaca953d7340 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.112225 Sep 03 20:55:11.327528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 870/1709] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:11 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:11.338257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:11.340186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:11.359506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:11.360377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:11.361093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:11.362716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:11.364322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:11.365484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:11.559140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:11.571582 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b054ea45-efa4-4066-8f22-7e56190f7ebe tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1169 microversion: 2.1 time: 0.242753 Sep 03 20:55:11.575924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 871/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:11 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1169 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:11.602826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:11.609696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:11.629596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:11.642299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:11.642607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:11.643366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:11.647174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:11.647640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:11.986077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:11.986644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:11.987067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:11.987498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:11.988032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:12.008985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.013168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.013923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.015009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.017537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.018932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.104979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:12.121642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for user 27be6827d30e48acac9a59786021f7bb and project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:12.177931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:12.180151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:12.295191 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83098f69-5cf5-43e8-9518-7479b0178c30 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.756591 Sep 03 20:55:12.301317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 840/1711] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:12.314303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:12.314926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:12.346667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.347504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.347980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.348709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.349224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.349660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.351680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0bec480-f31b-4012-9c63-e4032d70707d tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1612 microversion: 2.1 time: 0.766069 Sep 03 20:55:12.353733 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 872/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:11 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1612 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:12.390750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:12.391366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:12.401497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.402255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.405093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.406052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:12.408163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:12.408797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:12.732809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:12.750903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:12.752631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:12.756243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1fce8027-90b3-4b1d-8fd3-b8d635333366 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.453228 Sep 03 20:55:12.769317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 841/1713] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:12 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:12.788266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6db05cbf-392a-4992-ae9f-8b7e070e1124 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:12.789171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6db05cbf-392a-4992-ae9f-8b7e070e1124 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:12.819632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:12.845667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-539d1630-c25d-4d75-b429-b3a7a105d598 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1488 microversion: 2.1 time: 0.464738 Sep 03 20:55:12.848372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 873/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:12 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1488 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:12.872568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce4c7720-4136-4486-9735-967972201be8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b855280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:12.989438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce4c7720-4136-4486-9735-967972201be8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.136580 Sep 03 20:55:12.990555 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 874/1715] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:12 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:12.998189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:12.999759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:13.007707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.009057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.009690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.015944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.015944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.015944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.021632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:13.066138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f91eb6e45a14d1e8c18c9b94ae1567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf7e7f35c3f42b0a853dc2a0c196753', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:13.067801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] flavor_id is None. Assuming migration. {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 03 20:55:13.068472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 20:55:13.262235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6db05cbf-392a-4992-ae9f-8b7e070e1124 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:13.275960 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6db05cbf-392a-4992-ae9f-8b7e070e1124 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1225 microversion: 2.1 time: 0.498482 Sep 03 20:55:13.300177 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 842/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:12 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1225 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:13.324857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:13.325953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:13.348697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.349278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.355341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.357107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.361655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.363272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.729183 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24022dfc-1172-4b5d-a182-ab967cbdd507 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013/action" status: 202 len: 0 microversion: 2.1 time: 0.736882 Sep 03 20:55:13.732749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 875/1717] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:12 2022] POST /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:55:13.743634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:13.758334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:13.770918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.771846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.772553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.782536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:13.784384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:13.785914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:13.836577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lazy-loading 'flavor' on Instance uuid 0be9d083-663e-4b1d-b5ac-a180071ebc7b {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:14.018677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e25f973e-4708-45b7-a573-4c890150b6c2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.282395 Sep 03 20:55:14.023412 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 876/1718] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:13 2022] POST /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:55:14.041538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:14.043594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:14.059107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.059936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.060703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.065469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.069238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.070133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.118253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:14.123746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:14.134841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e20c85fd-daaa-4c27-a077-51d30bb8dceb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.832669 Sep 03 20:55:14.135873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 843/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:13 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:14.144793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:14.145779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:14.157340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.158283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.159340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.160437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.161919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.162785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.448291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:14.471193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:14.473489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:14.476556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5323c7c8-303b-46f6-a91a-93cf3c4d6565 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.337934 Sep 03 20:55:14.479334 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 844/1720] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:14 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:14.486201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9cc32211-3b23-4140-b219-13ca6d1e96ff tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b97e3a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:14.591779 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9cc32211-3b23-4140-b219-13ca6d1e96ff tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.109752 Sep 03 20:55:14.592686 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 845/1721] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:14 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:14.607967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:14.612439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:14.638137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.640861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.643086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.644222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.645701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.653001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.670826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:14.694097 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-801a6374-7c6b-4134-98dd-e4f1331c4f30 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1470 microversion: 2.1 time: 0.666309 Sep 03 20:55:14.694668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 877/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:14 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1470 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:14.726656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:14.730843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:14.750269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.754130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.760260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:14.765493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:14.766538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:14.778182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.009560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:15.023269 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a0f4058-b5c7-4350-a583-5c3aa47599ae tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1277 microversion: 2.1 time: 0.316717 Sep 03 20:55:15.029724 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 878/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:14 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:15.053002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:15.069038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c043390c-4692-4b53-bf02-0ddea6805f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1496 microversion: 2.1 time: 0.470491 Sep 03 20:55:15.070503 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 846/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:14 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1496 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:15.162883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:15.163905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:15.182641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.184589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.189117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.193555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.194173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.194696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.289375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef1ba9-973d-4f0b-afa7-3c226090ffda", "tag": "376b5603-e166-4498-98d5-02cc1d5f3246"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:15.303873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.314798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.315763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.337628 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] Creating event network-changed:376b5603-e166-4498-98d5-02cc1d5f3246 for instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda on nch2-master-1 Sep 03 20:55:15.347311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f1324d27-a4e5-4d7c-9da9-db6b1c1662a7 req-de2bbfab-e7ea-4e02-9212-964dfac5eb4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068121 Sep 03 20:55:15.351474 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 847/1725] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:55:15.523851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:15.533386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:15.547743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.554390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.555127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.562338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.563002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.564273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.646516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:15.658261 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-598529d3-2235-40e5-8d7c-86876fa32895 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.497383 Sep 03 20:55:15.666219 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 879/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:15 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:15.673022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5cff5bc6-8ba9-4392-b3da-859cf08f6c5b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b822790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:15.789041 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5cff5bc6-8ba9-4392-b3da-859cf08f6c5b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.118004 Sep 03 20:55:15.790244 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 880/1727] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:15 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:15.810444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:15.812307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:15.843993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.845042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.851428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:15.852628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:15.853305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:15.856922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.309896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:16.325247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:16.339024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:16.343666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:16.347015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3633ad80-bd74-4206-999b-aac6af089f09 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.832654 Sep 03 20:55:16.367969 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 848/1728] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:15 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:55:16.380313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:16.383282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:16.397892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.398827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.399652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.400801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.402141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.403028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.517176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:16.526167 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ee2a0dc-19f0-4c54-9176-8bd8fa5e3b4d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1470 microversion: 2.1 time: 0.734622 Sep 03 20:55:16.526631 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 881/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:15 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1470 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:16.540721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:16.541371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:16.571416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.571918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.572374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.582704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.583251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.583703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.684249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:16.696652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fabada39-d8b7-4b3a-9abc-c10068ffe23e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1283 microversion: 2.1 time: 0.326983 Sep 03 20:55:16.709767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 849/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:16 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1283 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:16.727126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:16.729464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:16.746831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.748447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.749211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:16.751021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:16.752017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:16.752730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:17.461128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:17.482420 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91990a6a-8c91-4241-99f6-3bae7f0e5046 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.771185 Sep 03 20:55:17.483645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 850/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:16 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:17.494341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3c67bbb-db98-42e2-b858-1f6f4ac8d4be tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae670e8af0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:17.614986 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3c67bbb-db98-42e2-b858-1f6f4ac8d4be tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.123346 Sep 03 20:55:17.616659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 851/1732] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:17 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:17.632159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:17.634803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:17.645643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:17.646563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:17.647277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:17.648270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:17.649131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:17.649804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:17.670369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:17.679763 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-635b1e2a-6120-4763-97a0-9dec54fa5e00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 200 len: 1479 microversion: 2.1 time: 1.148620 Sep 03 20:55:17.687694 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 882/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:16 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 1479 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:18.156728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:18.158112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:18.173035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.185288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.186217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:18.190278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.191048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.191852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:18.457395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:18.468412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:18.475830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:18.478257 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6584e206-ec76-4043-9326-6d9ad865c9c0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.860441 Sep 03 20:55:18.481971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 852/1734] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:17 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:18.488688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-499426320"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:18.511629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:18.527461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.530143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.533081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:18.534015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.534639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.538792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:18.899103 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed965464-29a5-477a-b27c-b922aed71169 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b/action" status: 202 len: 0 microversion: 2.1 time: 0.415588 Sep 03 20:55:18.911285 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 853/1735] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:18 2022] POST /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:55:18.918748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:18.920517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:18.928822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.929628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.930310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:18.931190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:18.931886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:18.932472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:19.140026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:19.154112 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53047573-d0f6-4bb3-8feb-54860db51d61 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1470 microversion: 2.1 time: 1.464883 Sep 03 20:55:19.155383 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 883/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:17 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1470 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:19.164191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:19.167212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:19.182052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:19.184027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:19.186714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:19.187739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:19.192033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:19.192911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:19.440515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:19.459463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98d3dc26-0cdb-4aa9-8edd-ea801fb04884 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.545796 Sep 03 20:55:19.461722 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 854/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:18 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:19.471310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-838d30fd-0db3-4260-b7b2-677b6643a542 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b972280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:19.562842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-838d30fd-0db3-4260-b7b2-677b6643a542 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.093070 Sep 03 20:55:19.572590 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 855/1738] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:19 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:19.578317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec8f9557-d949-4360-9a9a-0d3935cfeaaa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b90a8b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:19.662384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec8f9557-d949-4360-9a9a-0d3935cfeaaa tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.088054 Sep 03 20:55:19.666292 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 856/1739] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:19 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:19.672865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:19.673810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:19.683408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:19.684400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:19.685313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:19.686422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:19.688146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:19.688846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:19.822415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:19.830469 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f715440-a390-4df3-b5a3-6ec491fe5f8c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.673696 Sep 03 20:55:19.853111 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 884/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:19 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:20.034611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:20.048981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:20.050453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:20.051662 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5430550c-02a4-48c3-875b-44941d969cee tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1814 microversion: 2.25 time: 0.384102 Sep 03 20:55:20.056260 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 857/1741] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:19 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1814 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:20.110183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097bd701-2414-46b1-bcff-a353121be860", "tag": "f7ab6f88-5107-4422-ad17-d5e4054814b2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:20.157894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.160181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.165851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.181718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:20.182582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:20.195188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.199125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.199611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.200367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.200840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.201306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.220438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] Creating event network-changed:f7ab6f88-5107-4422-ad17-d5e4054814b2 for instance 097bd701-2414-46b1-bcff-a353121be860 on nch2-master-1 Sep 03 20:55:20.230735 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ad711d9e-8960-421d-960a-06d3e51669d7 req-ea0b66e8-ef16-435e-88e1-06e68df9d38b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127340 Sep 03 20:55:20.231852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 885/1742] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:20.451689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:20.462706 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cadc72e6-e930-445a-9ba5-31f4cfeb04c2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1470 microversion: 2.1 time: 0.284781 Sep 03 20:55:20.466661 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 858/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:20 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:20.491021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:20.492091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:20.503579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.505229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.505968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.508298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.509314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.510202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.580818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7aaa0c7b-3020-452d-8a0f-36c1df180e60 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b93e5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:20.644686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7aaa0c7b-3020-452d-8a0f-36c1df180e60 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.068525 Sep 03 20:55:20.645313 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 859/1744] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:20 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:20.682962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ba446b7e-d9b2-4c19-b9b1-fc9c127c1957 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6708f1f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:20.739008 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ba446b7e-d9b2-4c19-b9b1-fc9c127c1957 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.060738 Sep 03 20:55:20.740059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 860/1745] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:20 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:20.856968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:20.857966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:20.861401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:20.874421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.878950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.879445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:20.886621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:20.887707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:20.892373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.178863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:21.193843 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36476f0e-e3a8-4411-8037-45b73d8b6b34 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.340663 Sep 03 20:55:21.195943 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 861/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:20 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:21.202267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:21.204126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:21.221136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:21.222006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:21.222930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.224447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:21.225237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:21.226638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.300875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:21.320765 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e2dc257-ee25-47c9-be74-d0b9af4ecd21 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.829571 Sep 03 20:55:21.357067 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 886/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:20 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:21.492854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:21.493745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:21.508959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:21.518995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:21.525175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.528204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:21.528698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:21.529187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.682933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:21.700731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:21.707472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:21.709169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e85d89bf-f2fc-41c9-ad6d-ce38cb9f9db5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1804 microversion: 2.25 time: 0.511855 Sep 03 20:55:21.710902 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 862/1748] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:21 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1804 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:21.724477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b6997ed-89c5-4928-9a55-d122780ed122 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae670eaf70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:21.825579 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b6997ed-89c5-4928-9a55-d122780ed122 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.111871 Sep 03 20:55:21.826312 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 863/1749] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:21 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:21.845660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c61bc14-7dc0-41d1-a48c-945e2c7ed802 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '.version_select at 0x7fae67180670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:21.850745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c61bc14-7dc0-41d1-a48c-945e2c7ed802 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:21.862171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c61bc14-7dc0-41d1-a48c-945e2c7ed802 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:21.866687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c61bc14-7dc0-41d1-a48c-945e2c7ed802 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:21.906428 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c61bc14-7dc0-41d1-a48c-945e2c7ed802 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4470 microversion: 2.25 time: 0.078912 Sep 03 20:55:21.907329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 864/1750] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Sep 3 20:55:21 2022] GET /compute/v2.1/os-migrations => generated 4470 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:21.918923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-936bf87d-e31c-4dd1-b51b-d6535b618745 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae670eaaf0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:22.024377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-936bf87d-e31c-4dd1-b51b-d6535b618745 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.115836 Sep 03 20:55:22.025000 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 865/1751] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:21 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:22.034741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:22.035387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:22.051902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.052677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.053609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.054521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.056130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.061055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.117752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:22.338497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:22.384550 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8d9507a-3411-4977-ad40-6517375bf8cc tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 2422 microversion: 2.25 time: 0.354202 Sep 03 20:55:22.385566 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 866/1752] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:22 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 2422 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:22.405515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:22.406142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:22.420387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.420988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.422228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.423004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.423472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.423911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.711101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:22.729040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c49fb02-42b5-4d64-bef5-a92a18b0bda1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.342264 Sep 03 20:55:22.730198 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 867/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:22 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:22.735158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:22.735958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:22.742336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.743064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.743814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.744693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:22.745446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:22.746606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:22.752711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:23.113159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:23.127301 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-70248a56-fc23-43cf-9abb-8d6ec8bcc5fc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 1.639394 Sep 03 20:55:23.142273 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 887/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:21 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:23.154846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:23.157429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:23.171516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:23.172068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:23.173257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:23.176481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:23.177783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:23.182568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:23.270639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:23.450698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:23.460260 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c61fe6e4-cc88-4bfb-a0f5-3ef177fbe2da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.728825 Sep 03 20:55:23.461297 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 868/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:22 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:23.467441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6dc50bb1-c976-48f0-b292-f916f1948d1a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67180790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:23.544556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6dc50bb1-c976-48f0-b292-f916f1948d1a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.081667 Sep 03 20:55:23.552282 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 869/1756] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:23 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:23.552282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70f64d9b-106b-4530-b6e3-abd04887fa87 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6708f5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:23.620771 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70f64d9b-106b-4530-b6e3-abd04887fa87 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.073793 Sep 03 20:55:23.621778 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 870/1757] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:23 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:23.756302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:23.757081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:23.774335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:23.776382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:23.776924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:23.777774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:23.780974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:23.781509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:23.806569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:23.877545 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ec70a02-ccca-413a-b057-d769172221be tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 2422 microversion: 2.25 time: 0.726236 Sep 03 20:55:23.879200 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 888/1758] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:23 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 2422 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:24.023423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:24.033972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be9d083-663e-4b1d-b5ac-a180071ebc7b", "name": "network-vif-plugged", "status": "completed", "tag": "6b2cf02c-42d5-461b-bff2-0398711802ff"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:24.049380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-febca91d-5572-4bf5-a988-85146e8e8467 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.295164 Sep 03 20:55:24.050013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 871/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:23 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:24.077584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.082559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.083856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.087496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.088224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:24.105243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.106739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.108372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.110247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.110897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.111907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.115988 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] Creating event network-vif-plugged:6b2cf02c-42d5-461b-bff2-0398711802ff for instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b on nch1-master-1 Sep 03 20:55:24.128351 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c0777add-7bc1-4f45-84d5-0f8851be7622 req-b68c0afa-36b1-4a0a-ae79-6bf33aef2192 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098291 Sep 03 20:55:24.131675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 889/1760] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:55:24.156848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.158255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:24.183045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.183969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.186376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.187309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.189316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.189945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.220958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:24.285132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lazy-loading 'services' on Instance uuid de366e88-7f23-48df-8fa7-a11187537c06 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:24.473977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84c4c8bc-9dbd-4f15-8ff4-f23f60f569eb tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments/7d6b5527-60b3-46e7-b592-f5108171cc0c" status: 202 len: 0 microversion: 2.25 time: 0.397378 Sep 03 20:55:24.480635 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 872/1761] 10.222.0.16 () {60 vars in 1457 bytes} [Sat Sep 3 20:55:24 2022] DELETE /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments/7d6b5527-60b3-46e7-b592-f5108171cc0c => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:24.527337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.528201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:24.539410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.540451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.540927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.541657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.542343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.542786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.729412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:24.743701 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6c6ff44-2a67-4923-a493-bdf8a1ae5119 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.591858 Sep 03 20:55:24.764544 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 890/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:24 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:24.780079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.782848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:24.786990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:24.792500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.793679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.794367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.795331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:24.795997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:24.796638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:24.797732 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57ebb6da-d60f-4b86-b05d-402d08229284 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.310482 Sep 03 20:55:24.798638 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 873/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:24 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:24.804164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09503473-ae28-4511-9c05-45f69db3a322 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b97e4c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.860639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09503473-ae28-4511-9c05-45f69db3a322 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.060912 Sep 03 20:55:24.861449 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 874/1764] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:24 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:24.869114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c4ba2cc5-1d53-4db0-9549-98ee35ef16b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6708f0d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:24.887574 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9d89a0d-3957-4b70-bf08-9587d89ca364 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117335 Sep 03 20:55:24.888288 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 891/1765] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 3 20:55:24 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:55:24.948227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c4ba2cc5-1d53-4db0-9549-98ee35ef16b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.085757 Sep 03 20:55:24.950183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 875/1766] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:24 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:25.076784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:25.077769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:25.086933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:25.087901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:25.090245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:25.093731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:25.094452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:25.095746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:25.434389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:25.448550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0206e40e-1cb5-48c4-97d2-31bcc218b6f0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.376657 Sep 03 20:55:25.451790 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 892/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:25 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:25.777227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:25.778018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:25.788089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:25.791243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:25.791919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:25.792856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:25.793528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:25.794156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:25.821410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1911569132", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:25.947037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] validate_networks() for [('238bcf65-9e8e-49f1-a53b-a322f79ca876', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:26.058545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:26.072712 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d915d6e-f920-4f36-9a16-069e3be6e4dc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.297402 Sep 03 20:55:26.075022 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 893/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:25 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:26.093518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:26.094819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:26.110815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.112842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.113612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.115538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.119200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.119921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.449206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:26.461648 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b46d90b-7b2d-4896-bbf4-cdcd2679a61a tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.384526 Sep 03 20:55:26.482182 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 894/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:26 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:26.487471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-233510b4-6325-4eaa-8bfa-32cf93e9d6ff tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8245e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:26.554495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-233510b4-6325-4eaa-8bfa-32cf93e9d6ff tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.069589 Sep 03 20:55:26.555816 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 895/1770] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:26 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:26.561810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:26.564317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:26.573122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.574000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.575247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.577438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.578156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.578825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.624330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5177b952-2e40-496e-879c-802c075b5c1f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.067134 Sep 03 20:55:26.625311 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 896/1771] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 3 20:55:26 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:26.651675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9daa6a06-cc37-4c49-b7fd-be4c142791f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7e7550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:26.809947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9daa6a06-cc37-4c49-b7fd-be4c142791f2 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.183102 Sep 03 20:55:26.811033 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 897/1772] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:26 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:26.825582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef1ba9-973d-4f0b-afa7-3c226090ffda", "name": "network-vif-plugged", "status": "completed", "tag": "376b5603-e166-4498-98d5-02cc1d5f3246"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:26.866244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.869666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.870371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.920359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] Creating event network-vif-plugged:376b5603-e166-4498-98d5-02cc1d5f3246 for instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda on nch2-master-1 Sep 03 20:55:26.932947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-106b130e-9c5d-42e4-9365-ecb45a312dab req-d198bcd5-b717-4030-8c5c-ba3fe2788315 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119997 Sep 03 20:55:26.935968 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 898/1773] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:26.945377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:26.948106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:26.967200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.974308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.978019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:26.980069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:26.980466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:26.982128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.446686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:27.447228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:27.448482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:27.449944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:27.450539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:27.476994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.477850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.478558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.479569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.480261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.480915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.504050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:27.506033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:27.514235 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de8f5404-8abe-41b7-83c1-d6e81700beb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1199 microversion: 2.1 time: 0.576076 Sep 03 20:55:27.516793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for user db307623f73f4532a96342f551ba011c and project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:27.518424 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 899/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:26 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1199 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:27.532232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:27.533254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:27.546881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.547853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.550571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.553872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.556461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.557246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.571343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:27.575998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:27.756632 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-014618a4-74dc-4292-a35a-00af92209fe3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.059333 Sep 03 20:55:27.763446 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 876/1775] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:27.797271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:27.798036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:27.840124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.841304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.844867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:27.845981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:27.859009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:27.860751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:28.058696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:28.070459 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b00f26df-123b-4676-aa68-b88a2d61cd03 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.543855 Sep 03 20:55:28.071368 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 900/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:27 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:28.080737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b13406b-3e98-41d9-9cec-d81d68c10101 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b824670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:28.321680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:28.335411 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8681785-292a-4dde-9667-c0e5ccadb86b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.570446 Sep 03 20:55:28.363528 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 877/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:27 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:28.376126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81240cc3-39d9-48f5-a2c2-58d46d9dfde0 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:28.381506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81240cc3-39d9-48f5-a2c2-58d46d9dfde0 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:28.557023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b13406b-3e98-41d9-9cec-d81d68c10101 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1452 microversion: 2.1 time: 0.449040 Sep 03 20:55:28.563566 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 901/1778] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:28 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1452 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:28.586224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b50d6ae5-b8b6-444a-97a4-812dd31e5f3d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b822d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:28.747953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81240cc3-39d9-48f5-a2c2-58d46d9dfde0 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:28.759570 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81240cc3-39d9-48f5-a2c2-58d46d9dfde0 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1222 microversion: 2.1 time: 0.394809 Sep 03 20:55:28.766061 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 878/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:28 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1222 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:28.773394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:28.779963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:28.811223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:28.812287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:28.813236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:28.814276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:28.814989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:28.815640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:29.253841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:29.265972 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5864b041-a07d-4d27-b236-3e36538d9174 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1380 microversion: 2.1 time: 0.498416 Sep 03 20:55:29.281017 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 879/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:28 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1380 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:29.281017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1777540664", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:31.218807 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b50d6ae5-b8b6-444a-97a4-812dd31e5f3d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 2.653826 Sep 03 20:55:31.229488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 902/1781] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:28 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:31.233088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] validate_networks() for [('238bcf65-9e8e-49f1-a53b-a322f79ca876', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:31.238115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:31.256275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:31.284247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:31.284916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:31.286762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:31.288145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:31.288626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:31.289106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:31.930394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:31.930828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:31.931372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:31.931792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:31.932223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:31.945539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:31.948319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:31.949011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:31.952320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:31.953257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:31.956440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:31.999460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:32.006954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:32.008078 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c0db179-bc9c-4be9-997f-c8cf74a3cc7f tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.777541 Sep 03 20:55:32.017759 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 903/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:31 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:32.036619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for user db307623f73f4532a96342f551ba011c and project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:32.067779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:32.073195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:32.138186 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04f636af-7c9b-419e-afa0-b93e82bcb871 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.869637 Sep 03 20:55:32.139540 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 880/1783] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:32.149170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:32.150322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:32.160232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:32.161778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:32.162484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:32.163456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:32.164140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:32.165091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:32.369881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:32.370610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:32.390355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:32.395058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:32.396951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:32.397977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:32.403534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:32.406955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:32.518459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:32.527054 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-45a46097-e22e-4739-873a-c3f3bdbac9ea tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.386074 Sep 03 20:55:32.527656 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 881/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:32 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:32.546069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1188d0a-0733-4845-a0f6-ba16df0a0371 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6711b670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:32.666085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f1188d0a-0733-4845-a0f6-ba16df0a0371 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1461 microversion: 2.1 time: 0.128106 Sep 03 20:55:32.667044 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 882/1785] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:32 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1461 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:32.864790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2591c6f4-be40-4075-8243-c4f790d438d3 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1531 microversion: 2.1 time: 0.845755 Sep 03 20:55:32.888575 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 904/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:32 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1531 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:32.897692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097bd701-2414-46b1-bcff-a353121be860", "name": "network-vif-plugged", "status": "completed", "tag": "f7ab6f88-5107-4422-ad17-d5e4054814b2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:32.923151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:32.923649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:32.924103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:32.937508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-354751114", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "2344d3b5-a659-4a36-8ca8-079609faaf44"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:32.953448 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] Creating event network-vif-plugged:f7ab6f88-5107-4422-ad17-d5e4054814b2 for instance 097bd701-2414-46b1-bcff-a353121be860 on nch2-master-1 Sep 03 20:55:32.963313 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-079d3bbf-7e01-4ace-b129-8c287e057438 req-f2c659a6-290f-47d0-b975-79ca8fd28a9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071284 Sep 03 20:55:32.965415 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 905/1787] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:32.979739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f64c59a-2933-4dc9-b60d-bce5199c3a9a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:32.982375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f64c59a-2933-4dc9-b60d-bce5199c3a9a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:33.086912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] validate_networks() for [('2344d3b5-a659-4a36-8ca8-079609faaf44', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:33.435962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f64c59a-2933-4dc9-b60d-bce5199c3a9a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:33.447300 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f64c59a-2933-4dc9-b60d-bce5199c3a9a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1222 microversion: 2.1 time: 0.477484 Sep 03 20:55:33.449803 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 906/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:32 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1222 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:33.474743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94748d90-ba44-4e96-83af-165318575e41 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b82faf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:33.563668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94748d90-ba44-4e96-83af-165318575e41 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.093354 Sep 03 20:55:33.565673 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 907/1789] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:33 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:33.584436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-450919a3-894f-48dc-9d76-55b762e81c67 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7c4c10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:33.687149 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-450919a3-894f-48dc-9d76-55b762e81c67 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 200 len: 1461 microversion: 2.1 time: 0.120154 Sep 03 20:55:33.688406 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 908/1790] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:33 2022] GET /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 1461 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:33.702600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:33.709762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:33.724523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:33.729600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:33.739813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:33.741002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:33.741704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:33.742780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:33.977690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:33.978180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:33.978581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:33.978997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:33.979413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:33.996092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:33.996632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:33.997757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:33.998846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:33.999655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.000282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.023135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Getting quotas for project a9897f3d9893426f9fba83c8db250799. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:34.030182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Getting quotas for user f4d78b7738644ff38eb239daec52d641 and project a9897f3d9893426f9fba83c8db250799. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:34.048732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:34.051369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:34.136316 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fdd9de08-0373-4479-89c8-56d4d1b05de4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459642 Sep 03 20:55:34.143211 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 883/1791] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:34.143211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:34.143211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:34.150621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.151122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.151563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.152359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.152825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.153290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.498931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:34.513652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4dd0260a-d995-4ae9-8ec3-c1bacdac01b1 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.374874 Sep 03 20:55:34.530734 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 884/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:34 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:34.538854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:34.539922 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ddd7848a-f2b0-49d0-8109-921beed99a0f tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1531 microversion: 2.1 time: 0.849181 Sep 03 20:55:34.540877 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 909/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:33 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1531 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:34.541606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:34.556953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.557867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.560387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-683587247", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859"}], "block_device_mapping_v2": [{"uuid": "f6866eae-8b17-4560-881a-3622ae0208ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:34.565756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.568461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.569388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.571759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.774976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] validate_networks() for [('57ae63db-dc8e-4d8f-a6c6-ba3f3b8ad859', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:34.901286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:34.917353 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4bf490f9-e84a-465c-b8e9-fe51d7fbd679 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1325 microversion: 2.1 time: 0.383321 Sep 03 20:55:34.922692 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 885/1794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:34 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:34.933680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:34.934560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:34.948312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.948826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.949465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:34.950310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:34.950773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:34.951219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.245597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:35.259592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49cc552a-326d-4923-981a-a1109aaf08af tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1466 microversion: 2.1 time: 0.335371 Sep 03 20:55:35.284645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 886/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:34 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1466 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:35.292800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:35.293552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:35.300064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.300935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.302159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.302960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.303417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.303852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.413802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:35.424286 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70eb0885-f967-460d-ac41-447e483e8583 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1219 microversion: 2.1 time: 0.135910 Sep 03 20:55:35.425993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 887/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:35.431102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:35.431729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:35.438777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.439282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.439734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.440453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.440930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.441379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.549598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:35.564560 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c69a7489-3cb4-494b-a45e-5e40a9575543 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1280 microversion: 2.1 time: 0.132689 Sep 03 20:55:35.571653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 888/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:35.576622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:35.581284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.581986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.583127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.584088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.586607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.594003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.689335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e6afca58-c692-4af6-94d8-2823f1e1ae1e tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.116226 Sep 03 20:55:35.690933 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 889/1798] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:35.697859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8", "tag": "1af5687c-5172-43ca-838f-d2a3c7563df1"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:35.725886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:35.726630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:35.727555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:35.746434 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] Creating event network-changed:1af5687c-5172-43ca-838f-d2a3c7563df1 for instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 on nch2-master-1 Sep 03 20:55:35.755966 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8825701c-6271-44b5-8a2f-ec96cd45f8bf req-13c1da2c-7f4a-458a-901c-a68dec2d0782 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063473 Sep 03 20:55:35.757550 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 890/1799] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:35.765199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e2df6aaa-ba50-468e-b54a-06102fb9a6f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6741f700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:35.844099 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e2df6aaa-ba50-468e-b54a-06102fb9a6f0 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.085033 Sep 03 20:55:35.859859 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 891/1800] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:35.864841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1ce55ae-db4e-43d2-a6d1-fbee3bd11525 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae676ec790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:35.996613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1ce55ae-db4e-43d2-a6d1-fbee3bd11525 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-09-03T20%3A53%3A05Z" status: 200 len: 1901 microversion: 2.1 time: 0.143428 Sep 03 20:55:36.006887 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 892/1801] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/images?changes-since=2022-09-03T20%3A53%3A05Z => generated 1901 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:36.006887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:36.006887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:36.015672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.016869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.017893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.018560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.019125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.019832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.214638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:36.226766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a853cc11-3e5c-4199-80fb-4791d6d03938 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.227745 Sep 03 20:55:36.230486 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 893/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:35 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:36.249475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:36.255947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:36.278159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.285815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.286448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.287358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.287931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.288485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.345904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lazy-loading 'flavor' on Instance uuid 3aef1ba9-973d-4f0b-afa7-3c226090ffda {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:36.371998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Going to try to live migrate instance to nch1-master-1 {{(pid=140520) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:55:36.423395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:36.445370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:36.446605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:36.447877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:36.448529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:36.449227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:36.488578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.495475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.496592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.497689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:36.500589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:36.501857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:36.598782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:36.616749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Getting quotas for user 778561ee5e474accb31816f357985f44 and project 361f907a187547aabda6cb54eeeb3684. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:36.797783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:36.799959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6866eae-8b17-4560-881a-3622ae0208ea',volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:37.102692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9de2a44f-00eb-4986-a46c-05c5154aaa7a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.550794 Sep 03 20:55:37.104036 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 910/1803] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:55:37.109032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:37.110345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:37.126445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:37.127688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:37.128307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:37.130070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:37.148650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:37.155838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:37.831922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:37.859656 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-435541d2-6eaf-40ab-bcb3-0a71a80c4e1c tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1521 microversion: 2.1 time: 0.754344 Sep 03 20:55:37.876933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 911/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:37 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:37.876933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b7402f5-a8ef-4274-aa7b-10db50b11b43 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d5040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.091349 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b7402f5-a8ef-4274-aa7b-10db50b11b43 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-585733203" status: 200 len: 484 microversion: 2.1 time: 0.222746 Sep 03 20:55:38.092488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 912/1805] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Sep 3 20:55:37 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-585733203 => generated 484 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:38.102345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.103924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:38.111273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.112166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.112885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.114296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.114982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.116519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.287538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:38.298199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74220069-12cf-4798-9ec0-0749fc132a6b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1281 microversion: 2.1 time: 0.203531 Sep 03 20:55:38.299691 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 913/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:38 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:38.322956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.324298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:38.334791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.336811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.341223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.342879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.344075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.344737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.788784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7d37b90-7951-4b9b-91dd-6acdc73caac7 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda/action" status: 202 len: 0 microversion: 2.1 time: 2.552526 Sep 03 20:55:38.789755 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 894/1807] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:36 2022] POST /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda/action => generated 0 bytes in 2556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:55:38.796968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-unplugged", "status": "completed", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:38.810565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.811366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.812063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.845015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] Creating event network-vif-unplugged:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:55:38.857670 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e93d639c-ecd9-4d72-8c84-b8015254ebb3 req-50a8e95b-5edd-444f-8066-e7940651c1ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066459 Sep 03 20:55:38.863357 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 895/1808] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:38.877674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5ebedf2-a28b-4721-b00e-28e231ead685 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae67914ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.882260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:38.914093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1ee88d0-23f4-4508-b650-d546fdbd763c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.613070 Sep 03 20:55:38.914679 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 914/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:38 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:38.936973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.937979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:38.942567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:38.963130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.964468 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5ebedf2-a28b-4721-b00e-28e231ead685 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.096399 Sep 03 20:55:38.965234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.967946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 896/1810] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:38 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:38.969017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.969999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:38.970647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:38.976089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:38.992949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:38.994736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:39.033704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.040488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.041962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.048646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.050167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.054043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.109268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:39.122662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:39.131088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:39.132250 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4110872c-29e8-4d7b-ad09-e08d6e1fada4 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1176 microversion: 2.25 time: 0.207968 Sep 03 20:55:39.133394 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 915/1811] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:38 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1176 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:39.139733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:39.146638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:39.160292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.163152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.163794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.164738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.167769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.168626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.633482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:39.651560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a8bb3c4-20e2-4cc1-b512-d292c637c850 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1521 microversion: 2.1 time: 0.516639 Sep 03 20:55:39.663914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 916/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:39 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:39.681257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88b76838-d384-4ece-a79d-83905a91a102 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8131f0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:39.790798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:39.808776 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38a61a18-c148-44c2-8ee2-535a560ce03a tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.839441 Sep 03 20:55:39.813023 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 897/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:38 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:39.814985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:39.815862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:39.822283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88b76838-d384-4ece-a79d-83905a91a102 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?server=7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 956 microversion: 2.1 time: 0.155220 Sep 03 20:55:39.829805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 917/1814] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 20:55:39 2022] GET /compute/v2.1/images?server=7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 956 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:39.844355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:39.845031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:39.847754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.849943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.850703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.850838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:39.851916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.853419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.854063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.881317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.881834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.882282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.883020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:39.883489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:39.883925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:39.896441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:40.583256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:40.597199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3237069e-9e70-4e93-8479-45fd96e59bc6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.781498 Sep 03 20:55:40.613579 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 898/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:39 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:40.622125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-549506912"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:40.627167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:40.639327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:40.650156 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32cfa52c-bd3b-4174-9df4-a927e0aa2c16 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.819007 Sep 03 20:55:40.673573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 918/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:39 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:40.684019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:40.685021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:40.685750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:40.686916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:40.687622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:40.689418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66c17e71-da38-4e16-b1aa-5afda992904f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7d5ee0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:40.690154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:40.813517 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66c17e71-da38-4e16-b1aa-5afda992904f tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 484 microversion: 2.1 time: 0.138085 Sep 03 20:55:40.814935 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 919/1817] 10.222.0.16 () {58 vars in 1317 bytes} [Sat Sep 3 20:55:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:40.830128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:40.836192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:40.861838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:40.864931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:40.865666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:40.867643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:40.875225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:40.876052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.193045 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-459b1058-fbf5-4a4b-944d-849a280dea68 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860/action" status: 202 len: 0 microversion: 2.1 time: 0.577340 Sep 03 20:55:41.197075 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 899/1818] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:40 2022] POST /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:55:41.214084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7286032c-d9b6-4fff-a4d5-30f704c52a9d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae670ea820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:41.366154 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7286032c-d9b6-4fff-a4d5-30f704c52a9d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.166795 Sep 03 20:55:41.368151 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 900/1819] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:41 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:41.376983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e93e45-2e21-4334-bd61-549f421cfd38", "tag": "3f0a4b9a-1c92-46e5-b5e6-470595279881"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:41.422189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:41.431327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:41.432404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.466664 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] Creating event network-changed:3f0a4b9a-1c92-46e5-b5e6-470595279881 for instance e0e93e45-2e21-4334-bd61-549f421cfd38 on nch1-master-1 Sep 03 20:55:41.478653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-20b78ac6-d896-47f0-919c-cda5039bb545 req-5237fb11-f700-4b7d-8c27-3b9966d2a2db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107556 Sep 03 20:55:41.484027 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 901/1820] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:41.498720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:41.502751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:41.518264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:41.519047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:41.520151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.522158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:41.522887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:41.523503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.631967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:41.652927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:41.660433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:41.664221 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7392c829-9740-499a-8a34-fc84be377614 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1250 microversion: 2.25 time: 0.175823 Sep 03 20:55:41.667081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 902/1821] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:41 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1250 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:41.691136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d70a063-4910-489a-9d6b-a35ac58b1e01 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae670e8430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:41.827305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d70a063-4910-489a-9d6b-a35ac58b1e01 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 484 microversion: 2.1 time: 0.157308 Sep 03 20:55:41.828211 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 903/1822] 10.222.0.16 () {58 vars in 1303 bytes} [Sat Sep 3 20:55:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 484 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:41.844853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:41.850603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:41.874847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:41.876108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:41.877210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.877959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:41.878433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:41.878870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:41.927000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:41.935474 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a763f09-21b7-404f-93df-b53d7fc09e34 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 1.119266 Sep 03 20:55:41.943408 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 920/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:40 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:41.948307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c1c454f-8319-43fd-b117-1e2f1cf38216 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae6b7d5670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:42.195630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c1c454f-8319-43fd-b117-1e2f1cf38216 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c" status: 204 len: 0 microversion: 2.1 time: 0.250836 Sep 03 20:55:42.196316 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 921/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:41 2022] DELETE /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:42.201538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:42.202506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:42.216513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:42.221626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:42.233706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:42.234910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:42.235620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:42.236958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:42.322984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:42.335720 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4ea976c-601b-496c-b2ba-944262d906d0 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1475 microversion: 2.1 time: 0.506277 Sep 03 20:55:42.346138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 904/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:41 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:42.346138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:42.346138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:42.356484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:42.357019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:42.357464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:42.358188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:42.358643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:42.359845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:42.870641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:42.883270 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0d861128-ff83-400b-b0c8-51b44ab774d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.545280 Sep 03 20:55:42.888104 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 905/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:42 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:42.902509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e2be3e87-165d-4d14-883b-3d8f123e69c6 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b997f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.044875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:43.059361 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f9af827e-bbba-45f4-820b-af58579428c0 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.861672 Sep 03 20:55:43.060166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 922/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:42 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:43.086984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82782b0f-7080-42e0-ba1b-1df369c1782f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae6b82faf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.185805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-82782b0f-7080-42e0-ba1b-1df369c1782f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Image not found. Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82782b0f-7080-42e0-ba1b-1df369c1782f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c HTTP/1.1 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:55:43.188116 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'bdf3e28a-4b26-46a2-ae6d-ab897194091c'} Sep 03 20:55:43.189999 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:55:43.194955 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bdf3e28a-4b26-46a2-ae6d-ab897194091c Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:55:43.196440 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bdf3e28a-4b26-46a2-ae6d-ab897194091c could not be found. Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:55:43.198062 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:55:43.199588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82782b0f-7080-42e0-ba1b-1df369c1782f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:55:43.200919 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-82782b0f-7080-42e0-ba1b-1df369c1782f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c" status: 404 len: 62 microversion: 2.1 time: 0.108207 Sep 03 20:55:43.200919 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 923/1828] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:55:43.200919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe8554b6-a9e0-4881-bc6b-014425933d97 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7c4e50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.283652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e2be3e87-165d-4d14-883b-3d8f123e69c6 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.394017 Sep 03 20:55:43.292221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 906/1829] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:55:42 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:43.325875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8", "name": "network-vif-plugged", "status": "completed", "tag": "1af5687c-5172-43ca-838f-d2a3c7563df1"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:43.350760 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe8554b6-a9e0-4881-bc6b-014425933d97 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.158800 Sep 03 20:55:43.351723 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 924/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:43.374890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.380391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:43.385537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.388551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.392747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.402117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.403163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.406260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.407305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.408312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.409460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.425294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] Creating event network-vif-plugged:1af5687c-5172-43ca-838f-d2a3c7563df1 for instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 on nch2-master-1 Sep 03 20:55:43.439135 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2ee9ed12-388b-41db-9116-053163ab02fb req-c8a3957f-b49b-4a65-b89d-5a9dd64238fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140597 Sep 03 20:55:43.442518 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 907/1831] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:43.471837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.478828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:43.498748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.499630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.500647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.501677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.502397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.504033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.924353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:43.926941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:43.935603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:43.936410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3fd99c72-ff19-4190-825e-849a3227f4e7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.490422 Sep 03 20:55:43.940885 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 908/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:43.952133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.953155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:43.954949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:43.963754 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93c76eb7-1e48-4617-bfda-23d5ebe8f24d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.605928 Sep 03 20:55:43.965074 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 925/1833] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:43.965788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.969063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.969802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:43.970815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:43.975920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:43.977268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4435c49b-2974-4286-80ff-6a140e1eafbd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7c4dc0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:43.977717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.042999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=20 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:44.098042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4435c49b-2974-4286-80ff-6a140e1eafbd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.130877 Sep 03 20:55:44.099300 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 926/1834] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:44.112772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:44.113719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:44.127589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.138182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.138898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.139848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.140488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.141122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.292116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:44.322532 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b71eced1-3238-493f-8087-c300491e18da tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1539 microversion: 2.1 time: 0.374668 Sep 03 20:55:44.332957 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 909/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:43 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1539 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:44.332957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:44.396265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.401851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.402904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.436996 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] Creating event network-changed:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:55:44.462349 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-afec3027-4f14-4203-a3dc-d34cd7716b17 req-1346dfa9-701d-4870-9370-b749658d6da7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134897 Sep 03 20:55:44.464350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 910/1836] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:44.481429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:44.482408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:44.498419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.499701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.507502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.513304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.514050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.514815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.559424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:44.569489 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e458dd58-e96a-4115-b0b4-a696cd3197de tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1474 microversion: 2.1 time: 0.460555 Sep 03 20:55:44.578113 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 927/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:44 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1474 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:44.587395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:44.597585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:44.623661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.624554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.625478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.626286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:44.626845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:44.629266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:44.868428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:44.880236 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b69ea570-9074-49a5-b3b8-0a76cc2fcc0c tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.299769 Sep 03 20:55:44.881608 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 928/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:44 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:44.888294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e65dfa53-a2fe-4dd2-b5a8-634942cb2253 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b8831f0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:44.981668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e65dfa53-a2fe-4dd2-b5a8-634942cb2253 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.098641 Sep 03 20:55:44.982546 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 929/1839] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:55:44 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:44.988504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24633088-9ffb-49ae-85f5-f14399a2ae88 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b78a670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.016771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.061010 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24633088-9ffb-49ae-85f5-f14399a2ae88 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.077111 Sep 03 20:55:45.074171 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4854100-056d-4364-adb2-ee00db88e10b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.594346 Sep 03 20:55:45.077459 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 930/1840] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:44 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.092195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.093527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:45.104007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.104811 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 911/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:44 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.105764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.107033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.109279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.110221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5feea52d-9419-45b3-a10d-6e4ce4c515fd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae671800d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.111952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.114735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.276280 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5feea52d-9419-45b3-a10d-6e4ce4c515fd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-09-03T20%3A53%3A00Z" status: 200 len: 6325 microversion: 2.1 time: 0.168029 Sep 03 20:55:45.276280 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 912/1842] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-03T20%3A53%3A00Z => generated 6325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.279802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64032526-9ab3-4528-9b6a-a4a9d0d5f631", "tag": "fb49300a-fe93-40a5-a740-b0e93324b179"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:45.294822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.294822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.294822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.313467 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] Creating event network-changed:fb49300a-fe93-40a5-a740-b0e93324b179 for instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 on nch2-master-1 Sep 03 20:55:45.321934 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b533b26a-0189-4d99-9e63-9d29f5cc8f61 req-b2dff1ca-e872-485d-b26a-c86e710e2fe2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045467 Sep 03 20:55:45.322552 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 913/1843] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:45.328060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.329146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:45.338667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.339937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.340558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.341589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.342336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.343473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.452287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.463410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5322a611-0326-49e6-9dd8-278a804d7641 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.383950 Sep 03 20:55:45.464659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 931/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.469738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8301f056-1738-4ac9-b330-e9258f305006 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7e7c10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.526166 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8301f056-1738-4ac9-b330-e9258f305006 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-585733203" status: 200 len: 664 microversion: 2.1 time: 0.060168 Sep 03 20:55:45.527973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 932/1845] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-585733203 => generated 664 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:45.543688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.545672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:45.556644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.557637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.558381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.559539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.560327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.561022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.603654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:45.720607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.729997 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-52d6fd45-c4b0-415e-a425-4907bbcbe7dd tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1534 microversion: 2.1 time: 0.200645 Sep 03 20:55:45.732225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 933/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1534 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.737697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f55545ed-848a-4e26-89f8-89f3222d9fe4 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b82f940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.747043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.761203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.763562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:45.766628 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa70ff4f-4a1a-4996-8f0c-5fa18a04dff0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.442518 Sep 03 20:55:45.769305 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 914/1847] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:45.789677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.796782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:45.814965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.815466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.815950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.817236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.817725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.818185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.820152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f55545ed-848a-4e26-89f8-89f3222d9fe4 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1464 microversion: 2.1 time: 0.086605 Sep 03 20:55:45.822438 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 934/1848] 10.222.0.16 () {58 vars in 1338 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.848376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3286ca85-8ef0-4571-bc9a-47e05fce61fe tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b855e50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.944741 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3286ca85-8ef0-4571-bc9a-47e05fce61fe tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1464 microversion: 2.1 time: 0.109991 Sep 03 20:55:45.949189 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 935/1849] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:45.954881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:45.958766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:45.967976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.968826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.969398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:45.970188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:45.970714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:45.971400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.078758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:46.091900 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfb312e5-3edf-4b93-96ac-6a0cb305c22c tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1474 microversion: 2.1 time: 0.313448 Sep 03 20:55:46.093106 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 915/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.099218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff22578f-85ff-40ae-9e76-ed1cd6c891bf tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6769e280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.149408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:46.161728 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bbbc3627-af44-4e88-8440-433c3fd02c7f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.210467 Sep 03 20:55:46.162417 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 936/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:45 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.166997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01115d11-2b33-496c-96b5-7d1619f3622c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b8550d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.247578 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01115d11-2b33-496c-96b5-7d1619f3622c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.083995 Sep 03 20:55:46.249126 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 937/1852] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.257349 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff22578f-85ff-40ae-9e76-ed1cd6c891bf tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.162408 Sep 03 20:55:46.259103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.267669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:46.269485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 916/1853] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.284796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.286729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01928c80-ba07-4697-9e59-02bae948bf5e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6708f1f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.292793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.293985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.294595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.295058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.296221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.506949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01928c80-ba07-4697-9e59-02bae948bf5e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.225551 Sep 03 20:55:46.519101 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 917/1854] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.526818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097bd701-2414-46b1-bcff-a353121be860", "name": "network-vif-plugged", "status": "completed", "tag": "f7ab6f88-5107-4422-ad17-d5e4054814b2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:46.539699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.540511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.541204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.557502 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] Creating event network-vif-plugged:f7ab6f88-5107-4422-ad17-d5e4054814b2 for instance 097bd701-2414-46b1-bcff-a353121be860 on nch2-master-1 Sep 03 20:55:46.563816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:46.565562 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fb604465-afa7-4d8f-a4d1-ecf9140682bf req-c3a83d54-26ab-4e45-850b-d1e7dedb2e11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043584 Sep 03 20:55:46.568153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 918/1855] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:46.571975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:46.575533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.576683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:46.581248 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c854b9e-3076-4cec-b1ec-b462a3f636d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.330764 Sep 03 20:55:46.581910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 938/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.584355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.585115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.585752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.586680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.587328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.587947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.600345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e317e9f-710b-4ec7-bb67-cbb33a4c27c8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b883af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.656403 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e317e9f-710b-4ec7-bb67-cbb33a4c27c8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790" status: 200 len: 784 microversion: 2.1 time: 0.065897 Sep 03 20:55:46.657347 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 939/1857] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/images/bb6b1dcc-96d7-4d20-8933-997caa341790 => generated 784 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:46.674163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:46.687677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e1a35102-fa8b-456b-aba1-569b99bc55a1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b7e7790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.770726 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e1a35102-fa8b-456b-aba1-569b99bc55a1 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.096586 Sep 03 20:55:46.785172 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 940/1858] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.802713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.805749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:46.822858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.823709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.824366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.825417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.826104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.826784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.831726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:46.837238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:46.847390 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3c644b5-baf3-4c9c-b8ee-24de45e51e92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.277453 Sep 03 20:55:46.851523 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 919/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:46.857884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:46.858711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:46.867955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.868728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.869429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:46.870327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:46.872792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:46.873579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:47.162183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:47.171380 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce6bbd8c-7c50-4e58-8156-f1ae41d533d3 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1534 microversion: 2.1 time: 0.383269 Sep 03 20:55:47.174062 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 941/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1534 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:47.178844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25a74289-8921-44a0-93cc-64fd8e453f53 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae6b82f160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:47.337528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:47.355435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:47.357555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:47.358926 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5e0842f-c262-444a-9db0-59bf1e4cec0f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.505673 Sep 03 20:55:47.359660 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 920/1861] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:46 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:47.375861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:47.379934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:47.390610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:47.391121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:47.391571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:47.392304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:47.392764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:47.393223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:47.904658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:47.918905 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad360b0a-0d02-4bbf-8da8-c87e4f505545 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1474 microversion: 2.1 time: 0.557999 Sep 03 20:55:47.921690 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 921/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:47 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:47.929069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:47.931026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:47.937958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:47.938776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:47.939391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:47.940339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:47.941014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:47.941618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.141129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:48.151588 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f03dcc82-e9ed-4ad8-ba7f-c1bdd20a8fb7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.227723 Sep 03 20:55:48.152723 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 922/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:47 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:48.158103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ddf010de-ba7c-4e9f-ab1b-dcc2b2857d0b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6708faf0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:48.170366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25a74289-8921-44a0-93cc-64fd8e453f53 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56" status: 204 len: 0 microversion: 2.1 time: 0.995221 Sep 03 20:55:48.172227 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 942/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:47 2022] DELETE /compute/v2.1/images/7d84ef33-b905-4012-8c07-bdcec260cf56 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:48.178588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}, {"name": "network-changed", "server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:48.189101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.193286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.193975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.210752 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Creating event network-vif-unplugged:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch2-master-1 Sep 03 20:55:48.211543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Creating event network-changed:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch2-master-1 Sep 03 20:55:48.218735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:55:48.220372 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ddf010de-ba7c-4e9f-ab1b-dcc2b2857d0b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.066358 Sep 03 20:55:48.220977 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 923/1865] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:48 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:48.234162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:48.235083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:48.238707 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8822ad73-13c1-4dc5-aaf5-51c46c16ef52 req-9bc6bcbb-345b-4bf7-acf4-3cdbdb2ee0f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064412 Sep 03 20:55:48.239316 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 943/1866] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:48.242860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.243616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.244298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.245556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.246380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.247064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.254425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:48.255224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:48.267928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.268442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.268885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.269635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.270641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.271076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.454189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:48.454555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:48.463567 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9cc2f6c-bf7d-4f5a-8791-b007960946cb tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.233080 Sep 03 20:55:48.463800 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7bce153-f4cc-4e98-b43b-83ddcab16416 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.223054 Sep 03 20:55:48.464304 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 944/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:48 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:48.465565 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 924/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:48 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:48.471006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05788c32-a47f-472f-b15c-7275542d5b94 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae676c8550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:48.471155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:48.471777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:48.495803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.496730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.497389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:48.498455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:48.499072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:48.499692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.103875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:49.117034 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78a4afa7-880a-4dbe-9842-1efc87d997bc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1521 microversion: 2.1 time: 0.650149 Sep 03 20:55:49.117637 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 945/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:48 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:49.128453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:49.129100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:49.143170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.143673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.144117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.146328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.149923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.150455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.498682 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05788c32-a47f-472f-b15c-7275542d5b94 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b" status: 204 len: 0 microversion: 2.1 time: 1.031789 Sep 03 20:55:49.499424 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 925/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:48 2022] DELETE /compute/v2.1/images/d7284878-b2ff-428f-81ea-363557e34f5b => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:49.508889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:49.509898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:49.518284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.519189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.519926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.520736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.521302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.521809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.761698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:49.783028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:49.786653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:49.789871 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf484aa8-6945-48a4-a009-6540d8978284 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.671039 Sep 03 20:55:49.810462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 946/1871] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:49 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:49.825472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:49.829144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:49.874377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.876652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.877769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.933201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.933201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.933201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.934254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:49.934385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:55:49.934495 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1c2c48be-2d8b-4412-ba05-a5e79655a7ed tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1472 microversion: 2.1 time: 0.415483 Sep 03 20:55:49.934495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 926/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:49 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:49.934495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:49.934495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:49.934495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.934943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.946754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.947868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:49.948540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:49.949186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:49.983595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:50.020863 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24b29a62-aa11-4f27-a190-5dd06d52300e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 204 len: 0 microversion: 2.1 time: 0.212912 Sep 03 20:55:50.024738 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 947/1873] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:55:49 2022] DELETE /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:50.028111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af3cea62-0b97-43fe-81d1-ef7b1b24703b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b7cb040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.096687 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af3cea62-0b97-43fe-81d1-ef7b1b24703b tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1439 microversion: 2.1 time: 0.073445 Sep 03 20:55:50.106335 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 948/1874] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:50 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:50.106335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.106335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:50.116326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.116819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.117300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.118301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.118967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.119727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.305174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:50.314204 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9b9d60a-4543-4fb9-b1ab-43a5cddf3403 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.213099 Sep 03 20:55:50.314786 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 949/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:50 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:50.319618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.320406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:50.327417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.328110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.328728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.329749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.330466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.331045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.365513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:50.384758 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85a28a2f-c032-4047-8e8b-d26bd1be6775 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.462776 Sep 03 20:55:50.385383 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 927/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:49 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:50.416136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf7bec02-6d28-4465-a088-441de62d77b3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67167550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.527499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:50.541646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbbbb2de-6ef5-4104-8fcd-2b93a8ef5d47 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.225467 Sep 03 20:55:50.542243 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 950/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:50 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:50.554124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.554916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:50.572845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.573438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.573931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.574651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.575108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.575585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.801900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:50.814954 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf732f68-4e4f-4cb9-8f77-5019544d818e tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1527 microversion: 2.1 time: 0.271294 Sep 03 20:55:50.815910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 951/1878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:50 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1527 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:50.821498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef1ba9-973d-4f0b-afa7-3c226090ffda", "name": "network-vif-unplugged", "status": "completed", "tag": "376b5603-e166-4498-98d5-02cc1d5f3246"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:50.831844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.833090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.833597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.849468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] Creating event network-vif-unplugged:376b5603-e166-4498-98d5-02cc1d5f3246 for instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda on nch2-master-1 Sep 03 20:55:50.855142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-dcc0a6cb-e37e-4f75-b4c8-f62d172ace3b req-79043e6e-a705-45c5-983f-d29f80993d8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037171 Sep 03 20:55:50.856061 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 952/1879] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:50.861461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:50.862183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:50.868834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.869421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.869919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:50.870641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:50.871891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:50.872357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.044443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.053597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.055053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.056554 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14f6faeb-85f3-422d-a973-6ca1b9c25a91 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.199294 Sep 03 20:55:51.057143 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 953/1880] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:50 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:51.061715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.062537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.070307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.070801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.071446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.072164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.072674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.073198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.135305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf7bec02-6d28-4465-a088-441de62d77b3 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2" status: 204 len: 0 microversion: 2.1 time: 0.737107 Sep 03 20:55:51.136777 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 928/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:50 2022] DELETE /compute/v2.1/images/fe0b313d-ae04-4813-8ac9-d0d495083cd2 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:51.142512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-643957b7-bbcf-49cd-9537-ffa024b5dc78 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6721fee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.195240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-643957b7-bbcf-49cd-9537-ffa024b5dc78 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1448 microversion: 2.1 time: 0.056880 Sep 03 20:55:51.195810 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 929/1882] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1448 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.201544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.202049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.210017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.210516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.210962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.211682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.212499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.213283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.244180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.246259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:55:51.254417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-390d30ce-ff08-4d26-988f-16b9b37e7aa7 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1472 microversion: 2.1 time: 0.196065 Sep 03 20:55:51.255036 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 954/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.259682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2758c6d-8c71-4a5c-b2aa-144e91daac00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b8220d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.309992 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2758c6d-8c71-4a5c-b2aa-144e91daac00 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 200 len: 1448 microversion: 2.1 time: 0.053743 Sep 03 20:55:51.310564 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 955/1884] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 1448 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.325912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e1bbc39-c855-439e-b1ae-ca0ea37ac944 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b78a9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.349410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ea4a948-1879-40be-9301-711371d137a9 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 204 len: 0 microversion: 2.1 time: 0.151300 Sep 03 20:55:51.350306 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 930/1885] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:55:51 2022] DELETE /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:51.358286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.359491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.367379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.368311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.369466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.370880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.371502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.372372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.536781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.553274 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15751543-f7e5-4b91-90ff-ca34f993650b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.199872 Sep 03 20:55:51.554034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 931/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.560649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.562214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.576200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.577180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.577654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.578365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.579130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.580008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.736693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.755987 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85111004-97f4-470b-a045-dcd6763fac55 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1473 microversion: 2.1 time: 0.199644 Sep 03 20:55:51.758248 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 932/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.776424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.777719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.784241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.784831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.785481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.786673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.787139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.787568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.850524 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e1bbc39-c855-439e-b1ae-ca0ea37ac944 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 204 len: 0 microversion: 2.1 time: 0.528084 Sep 03 20:55:51.851392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 956/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] DELETE /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:51.878992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "name": "network-vif-plugged", "status": "completed", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:51.893561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.894047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.894575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.905913 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] Creating event network-vif-plugged:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:55:51.911056 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-23c87b01-3d66-496b-9db1-e3162cadef04 req-894efae6-06f2-4c23-b14b-2ae9b544a208 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058132 Sep 03 20:55:51.911663 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 957/1889] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:51.916940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.917648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.924381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.924946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.925442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.926788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.927254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.927683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.951187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:51.959191 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4db341c-7100-45ee-b751-31f4fa055386 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.198847 Sep 03 20:55:51.959764 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 933/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:51.964433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:51.965270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:51.974337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.975066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.975720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:51.976644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:51.977129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:51.977566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.064167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.077806 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11a3f759-9a6d-4ffd-8916-647d0840dd74 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.162733 Sep 03 20:55:52.078854 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 958/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:52.084345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:52.085325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:52.092735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.093921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.094542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.095613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.096116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.096720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.123923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.132848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f75936b-e7ab-466a-9260-a6c4b3e03af7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1527 microversion: 2.1 time: 0.172065 Sep 03 20:55:52.133457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 934/1892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:51 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1527 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:52.139440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:52.140063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:52.140678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:55:52.146488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.147169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.147772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.148723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.149409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.150035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.230899 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06da0d34-620a-47d1-8b7e-737b8f82741d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 204 len: 0 microversion: 2.1 time: 0.150169 Sep 03 20:55:52.231330 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 959/1893] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:55:52 2022] DELETE /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:55:52.279305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:52.280419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:52.287592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.287954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.288392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.289279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.289738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.290163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.291188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.302826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.304372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.305547 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73b193b8-6d95-48e8-93a3-bc3718117e7f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.170968 Sep 03 20:55:52.306221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 935/1894] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:52 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:52.339560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1368495460", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:52.397830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] validate_networks() for [('6d905ebc-d3fa-4cb8-b44b-f6c49edfcb47', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:52.435215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.444302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff0d69b7-6d32-43db-8a9d-67fc54427164 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1472 microversion: 2.1 time: 0.169494 Sep 03 20:55:52.444871 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 960/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:52 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:52.578326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:52.578949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:52.585906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.586635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.587084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.587813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.588279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.588710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.737300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:52.746006 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e8d83e24-461b-41c0-9248-f3ff51d17f4e tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.171444 Sep 03 20:55:52.746834 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 961/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:52 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:52.782066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:52.782756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:52.789001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.789487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.789925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.790624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.791077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.791501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.831245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:52.831709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:52.832318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:52.832732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:52.833170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:52.844269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.844869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.845336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.846079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.846569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.846999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:52.866718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:52.875171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Getting quotas for user d9688dca94a841cfa29420ad780562cd and project f17cee6ff91f4292b688b5cc63292039. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:52.890340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:52.893060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:52.956153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61a2c7c0-a225-4e5c-84bc-07c9c54bfc46 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620621 Sep 03 20:55:52.966477 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 936/1897] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:55:52.980410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aef1ba9-973d-4f0b-afa7-3c226090ffda", "tag": "376b5603-e166-4498-98d5-02cc1d5f3246"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:52.993243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:52.993998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:52.994801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.001799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.008447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] Creating event network-changed:376b5603-e166-4498-98d5-02cc1d5f3246 for instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda on nch2-master-1 Sep 03 20:55:53.013596 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0bf34530-8500-48f0-a426-1af7da575a67 req-66ad13ed-64ed-405b-a846-aef0d996807e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044068 Sep 03 20:55:53.014341 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 937/1898] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:53.021387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-107bc937-739b-44b7-98cd-9b1bdc87a720 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.022006 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5627566-4494-413f-87e1-d7bb40ce6c3a tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1473 microversion: 2.1 time: 0.244590 Sep 03 20:55:53.022681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-107bc937-739b-44b7-98cd-9b1bdc87a720 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.038675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 962/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:52 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:53.045875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.048396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.059728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.060296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.061016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.062414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.063079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.063974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.109086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-107bc937-739b-44b7-98cd-9b1bdc87a720 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.118116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-107bc937-739b-44b7-98cd-9b1bdc87a720 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1208 microversion: 2.1 time: 0.102327 Sep 03 20:55:53.119317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 938/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:53.137356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.138046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.148839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.151186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.151553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.152348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.154866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.155320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.230447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.240590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-860d4952-1f54-4edb-a6e7-33561ff7ccdb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.200674 Sep 03 20:55:53.242256 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 963/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:53.249573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.250866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.261532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.263327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.265120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.266910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.267441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.268018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.357425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.366474 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b0d921bd-a413-4574-9350-e31baeb8d0e6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.245675 Sep 03 20:55:53.367507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 939/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:53.372537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.373469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.380559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.381145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.381602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.382328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.382866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.383648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.540407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.551873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.553760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.555377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b532c138-e66f-48fa-85c1-eff16a5cc3af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.186679 Sep 03 20:55:53.556080 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 940/1903] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:53.562074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.563080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.571055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.571687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.572353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.573184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.573707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.574299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.579255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:53.787654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.790340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:53.795393 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed5b1d28-a5f6-4a71-97a4-18875ef733b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1469 microversion: 2.1 time: 0.238105 Sep 03 20:55:53.795971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 941/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:53.797912 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-31958be9-8c21-465f-b495-a92b18377a76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1527 microversion: 2.1 time: 0.554443 Sep 03 20:55:53.798457 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 964/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1527 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:53.804567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:53.805241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.811969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.812461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.813029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.813927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.814388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.814919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.819125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:53.820028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:53.826539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.827026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.827494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.828348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.829144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.829572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.910583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:53.952944 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-095c8c02-8706-4371-8418-94b75bff76fe tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "POST /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013/action" status: 202 len: 0 microversion: 2.1 time: 0.138046 Sep 03 20:55:53.954923 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 965/1906] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:55:53 2022] POST /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:55:53.963814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e93e45-2e21-4334-bd61-549f421cfd38", "name": "network-vif-plugged", "status": "completed", "tag": "3f0a4b9a-1c92-46e5-b5e6-470595279881"}, {"server_uuid": "097bd701-2414-46b1-bcff-a353121be860", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ab6f88-5107-4422-ad17-d5e4054814b2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:53.984310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:53.985226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:53.985878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:53.998679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.003102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Creating event network-vif-plugged:3f0a4b9a-1c92-46e5-b5e6-470595279881 for instance e0e93e45-2e21-4334-bd61-549f421cfd38 on nch1-master-1 Sep 03 20:55:54.005079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] Creating event network-vif-unplugged:f7ab6f88-5107-4422-ad17-d5e4054814b2 for instance 097bd701-2414-46b1-bcff-a353121be860 on nch2-master-1 Sep 03 20:55:54.011570 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-620e4fc3-6687-48dc-beea-ab16f79b4eea tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.214504 Sep 03 20:55:54.014157 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 942/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:53 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.015941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4ec3c404-df63-4221-a54e-ce6f9bf77d4e req-fb922357-25a4-423b-9ecc-a98a4119f438 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.058675 Sep 03 20:55:54.016918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 966/1908] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:54.025133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.026935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.049147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.050040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.051433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.054132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.054885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.055872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.056518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.058246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.068322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.069583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.070527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.071545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.073288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.073956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.435285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.444025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ed998af-85e3-41f3-a0e7-ee3e0b7c9606 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.428550 Sep 03 20:55:54.444618 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 943/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.449380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.450221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.459340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.459846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.460314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.461109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.461510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.461945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.505997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.514758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24d2e3be-71d7-4e87-af04-56cc5feec5f0 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1473 microversion: 2.1 time: 0.468095 Sep 03 20:55:54.515599 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 967/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.521718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.522604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.529136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.530168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.530957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.531755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.532492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.533045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.535088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.544130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c2fa6ae3-3234-47a1-a971-751a69959bcf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1260 microversion: 2.1 time: 0.098382 Sep 03 20:55:54.544717 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 944/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1260 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.549608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.550409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.558568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.559269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.559893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.560818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.561317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.561832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.737105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.746515 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf049cfb-82dd-4ddc-971e-f0a8efdde1d8 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.200404 Sep 03 20:55:54.748471 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 945/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.766383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.769243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.779670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.780512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.781688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.783240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.784055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.785159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.874071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.886415 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e81316b-bf48-40b9-a016-5b75be9e9218 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.368610 Sep 03 20:55:54.887943 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 968/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:54.895997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:54.897389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:54.912161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.913086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.914155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.915124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:54.915831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:54.916805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:54.967485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.985179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.986635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:54.987853 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05d1cea4-3c10-416d-b340-3def10c051a7 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.237646 Sep 03 20:55:54.988994 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 946/1914] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:55.036388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.037504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.043607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:55.045541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.046252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.046959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.047966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.048671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.049183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.056624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:55.069825 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13a1d54f-f860-4164-8b87-1807d7f55cb7 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1485 microversion: 2.1 time: 0.179389 Sep 03 20:55:55.070679 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 969/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:54 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1485 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:55.212429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097bd701-2414-46b1-bcff-a353121be860", "name": "network-vif-deleted", "tag": "f7ab6f88-5107-4422-ad17-d5e4054814b2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:55.215083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:55.224051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52542bd0-19a8-4217-9fb7-198cfc050f4a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.192083 Sep 03 20:55:55.224720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 947/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:55.226048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.226530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.227006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.241592 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] Creating event network-vif-deleted:f7ab6f88-5107-4422-ad17-d5e4054814b2 for instance 097bd701-2414-46b1-bcff-a353121be860 on nch2-master-1 Sep 03 20:55:55.246550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8ce97837-54f7-47e2-8a83-72775e97d5a8 req-477747ec-8f6f-4a08-958f-7c07649078c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039548 Sep 03 20:55:55.247156 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 970/1917] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:55:55.471459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.473480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.487245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.496100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.497287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.503165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.505622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.513308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.548603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.549464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.562871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.563731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.564452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.565428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.566099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.566865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.688720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:55.701446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c7d03f0c-098c-4594-9adb-b9a86fe87b13 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.234749 Sep 03 20:55:55.702111 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 948/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:55.709302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.710461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.717572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.718588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.719407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.720131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.720597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.721071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.798528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:55.807056 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fff3b64-cb07-4c9b-84c1-e0e595f934cd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1473 microversion: 2.1 time: 0.271703 Sep 03 20:55:55.808844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:55.817304 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 971/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:55.817672 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6fcd72d-3d0f-4dd6-b618-373d41d59f70 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1260 microversion: 2.1 time: 0.114501 Sep 03 20:55:55.825251 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 949/1920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1260 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:55.825817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.826683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.834506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.835381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.835862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.836717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.837257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.837814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.912513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:55.913271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:55.926050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.926580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.927016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.927743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:55.928204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:55.928635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:55.993638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.020348 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e24d9675-3c39-4493-b36d-6e188812898f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1323 microversion: 2.1 time: 0.199553 Sep 03 20:55:56.020952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 972/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:56.025729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:56.026339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:56.045784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.046610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.047737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.048832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.049506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.050424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.242540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.251806 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c741b6f5-143e-4634-8994-d89667000576 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.343946 Sep 03 20:55:56.261766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 950/1922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:55 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:56.273303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-plugged", "status": "completed", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:56.289409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.290552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.291220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.307234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Creating event network-vif-plugged:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch2-master-1 Sep 03 20:55:56.313810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:55:56.326112 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0272055e-b8da-4aed-b49f-b5de20189f23 req-da067e55-2be5-49e1-a1fe-ffe6c5037b6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060387 Sep 03 20:55:56.327509 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 951/1923] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:56.334441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:56.335639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:56.343848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.344853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.345761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.346995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.348473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.349229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.397295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.397791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.398241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.398693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lazy-loading 'fault' on Instance uuid 097bd701-2414-46b1-bcff-a353121be860 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:56.464852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.467617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.489598 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c46d5161-cead-48a0-af75-c1193469d4c8 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 200 len: 1315 microversion: 2.1 time: 0.159635 Sep 03 20:55:56.495347 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 952/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:56 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:56.501090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.503487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.503977 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e83a625-f756-4465-8010-7c48cf306147 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.481983 Sep 03 20:55:56.516115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 973/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:56 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:56.519392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:56.524800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:56.534325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.534960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.535577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.536391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.537113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.538710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.725780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:56.726384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:56.744411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.744943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.745397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.746332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.746966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.747568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.872053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:56.885867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53438ffb-d50e-4948-be45-4e96a18e573f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.385168 Sep 03 20:55:56.886455 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 953/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:56 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:56.891115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:56.895428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:56.903805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.904307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.904751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.905495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:56.905953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:56.906384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:56.993535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.008310 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a3773761-9fc9-4b5c-8da8-6ace27c5c3bd tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1431 microversion: 2.1 time: 0.119435 Sep 03 20:55:57.009437 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 954/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:56 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1431 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:57.026219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:57.027125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:57.036238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.037034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.037535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.038258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.038874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.039544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.115074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.139867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c551efd6-4568-4344-bdbd-ca4f04cfd858 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1266 microversion: 2.1 time: 0.127366 Sep 03 20:55:57.149247 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 955/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:57 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:57.160846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "868e0374-e87b-47bb-b1c6-454b021cb0c7", "name": "network-vif-deleted", "tag": "6fdb39ff-6197-4b7f-b337-ca2c08b9dbab"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:57.179329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.180497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.181362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.181819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.189385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8cf0a61-21e6-4f05-97c5-42967eea9ac5 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.467496 Sep 03 20:55:57.194003 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 974/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:56 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:55:57.205699 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] Creating event network-vif-deleted:6fdb39ff-6197-4b7f-b337-ca2c08b9dbab for instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 on nch1-master-1 Sep 03 20:55:57.214502 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-71a26dc9-c1a3-483a-b9d5-13046baf94a8 req-c6a7ea04-1361-4cba-a9cb-379f616591f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061892 Sep 03 20:55:57.216129 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 956/1930] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:57.224602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:57.225292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:57.232590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:57.237555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.238065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.238590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.239506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.239964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.241314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.277989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:57.278773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:57.289847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.290357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.290787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.295138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.295692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.296190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.473114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.481807 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a50df087-f775-4a09-8274-5b1f522d133d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.208795 Sep 03 20:55:57.482388 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 957/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:57 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:57.519127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:57.520082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:57.527931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.527931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.528359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.529162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.529757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.530336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.546470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 HTTP/1.1 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:55:57.548337 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:55:57.550368 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '097bd701-2414-46b1-bcff-a353121be860'} Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:55:57.551548 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:55:57.553303 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:55:57.554822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:55:57.554822 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b11d60ff-1078-4ff6-93d0-e6afadb7134b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 404 len: 111 microversion: 2.1 time: 0.037873 Sep 03 20:55:57.555526 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 958/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:57 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:55:57.564699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:57.565504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:57.574186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.574952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.575661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.576971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.577811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.578604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.583773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:57.737146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.747012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.748584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.749909 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3103b371-6d59-411e-96fd-6806d85642e3 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.191519 Sep 03 20:55:57.757071 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 959/1933] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:55:57 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:55:57.757071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1154615175", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:57.777359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:57.787271 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7abedd79-9285-4911-8ed4-97fdf415caf5 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1520 microversion: 2.1 time: 0.591715 Sep 03 20:55:57.787858 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 975/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:57 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1520 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:57.794086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be9d083-663e-4b1d-b5ac-a180071ebc7b", "name": "network-vif-deleted", "tag": "6b2cf02c-42d5-461b-bff2-0398711802ff"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:57.810033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:57.811029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:57.811850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:57.825647 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] Creating event network-vif-deleted:6b2cf02c-42d5-461b-bff2-0398711802ff for instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b on nch1-master-1 Sep 03 20:55:57.838502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a2b4127d-ad93-40f0-8f05-cdaa2f3ec550 req-2f9099a5-5ea4-4e9f-bf5d-2a50d0b97fd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048111 Sep 03 20:55:57.840004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 976/1935] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:57.842800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] validate_networks() for [('6233c6b9-6d19-495f-97e8-118b2a607de6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:55:57.846668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b4bc0a7-6c66-4735-a5d8-27080eb947b0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'create', calling method: .version_select at 0x7fae6b822040>, body: {"pool": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:58.315465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:55:58.315968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:55:58.316522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:55:58.317060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:55:58.317710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:55:58.328696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.329280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.329829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.330640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.331160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.331665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.357227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:55:58.364162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Getting quotas for user 27be6827d30e48acac9a59786021f7bb and project dad6ee8212ab418cba7f718ce4bb4726. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:55:58.381433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:55:58.402922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:55:58.485462 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9163cca-c02e-48cb-828d-227160e2f495 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.733276 Sep 03 20:55:58.486737 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 960/1936] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:55:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:55:58.493864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:58.494704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:58.511579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.512279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.512734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.513922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.514594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.533503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.728701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:58.742156 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6dbec30-38c4-457b-ac54-7dc065de5263 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1322 microversion: 2.1 time: 0.248833 Sep 03 20:55:58.742980 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 961/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:58 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:58.748386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:58.749252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:58.756347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.757082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.757769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.759188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.759651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.760090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.797436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:58.798089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:58.798841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:58.799481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lazy-loading 'fault' on Instance uuid 868e0374-e87b-47bb-b1c6-454b021cb0c7 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:55:58.933650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:58.947438 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b825fa5-ec10-46b4-8e55-e54bfce6e14c tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1307 microversion: 2.1 time: 0.202431 Sep 03 20:55:58.977256 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 962/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:58 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:58.988227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:58.991362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:59.008601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.010613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.011096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.014250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.015999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.018590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.317810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:59.330379 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfee2d39-8d73-4015-b331-8f710fa21d0d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.350924 Sep 03 20:55:59.364750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 963/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:58 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:59.379656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:59.380559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:59.392375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.393161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.393953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.395511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.396660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.397384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.599943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:59.611717 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab83721c-cd73-4722-99e4-d8b844372807 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.243972 Sep 03 20:55:59.613043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 964/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:59 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:59.618685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be9d083-663e-4b1d-b5ac-a180071ebc7b", "name": "network-vif-unplugged", "status": "completed", "tag": "6b2cf02c-42d5-461b-bff2-0398711802ff"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:55:59.632298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.633199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.633641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.645562 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] Creating event network-vif-unplugged:6b2cf02c-42d5-461b-bff2-0398711802ff for instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b on nch1-master-1 Sep 03 20:55:59.651938 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a829f14b-856c-4faf-9446-5ebd6196d07a req-6e50a409-56fe-42cf-8e09-6c1d7049cc8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036526 Sep 03 20:55:59.653114 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 965/1941] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:55:59.665087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:59.666251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:59.675712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.677106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.678148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.679247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.679817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.680379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.758044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:55:59.767823 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7518da50-8ff0-4481-b468-ab9eb407bd73 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1221 microversion: 2.1 time: 0.113314 Sep 03 20:55:59.781338 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 966/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:59 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:55:59.787884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:55:59.788545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:55:59.794999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.795500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.795954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:55:59.797274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:55:59.797274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:55:59.797649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.005970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.022153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fda7eb4e-c7df-40b0-9f58-7d3021e0cb4d tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.250882 Sep 03 20:56:00.037054 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 967/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:55:59 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:00.037054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:00.037054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:00.038074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.039236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.039792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.040660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.042339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.043921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.260302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.280867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.283041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.284613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08bdff02-3599-4c0c-830b-1b951fe3335f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.259853 Sep 03 20:56:00.285967 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 968/1944] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:00 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:00.291606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:00.292225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:00.299717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.300399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.301104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.302090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.302700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.303293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.476698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.485698 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b42c76de-7b9b-4541-b411-6e199a6e2e70 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1517 microversion: 2.1 time: 0.198473 Sep 03 20:56:00.486276 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 969/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:00 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:00.492265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:00.492874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:00.501707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.502830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.504089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.505273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.505770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.506256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.554505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.555002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.555450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.555944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lazy-loading 'fault' on Instance uuid 868e0374-e87b-47bb-b1c6-454b021cb0c7 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:00.603030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:00.612539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cb5bf18e-e909-47ab-b780-28ee450cfe99 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 200 len: 1307 microversion: 2.1 time: 0.124912 Sep 03 20:56:00.613030 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 970/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:00 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:00.625690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:00.625690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:00.625690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.626185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.626323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:00.627370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:00.628184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:00.628342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.008877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:01.036565 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd85601e-7a4a-47e9-9f90-622793ea6008 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.421454 Sep 03 20:56:01.037604 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 971/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:00 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:01.045754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:01.050193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:01.062012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.063129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.067414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.078734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.079634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.083088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.117491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lazy-loading 'flavor' on Instance uuid e0e93e45-2e21-4334-bd61-549f421cfd38 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:01.184668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b4bc0a7-6c66-4735-a5d8-27080eb947b0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.340491 Sep 03 20:56:01.199204 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 977/1948] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:55:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:01.201948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:01.202721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:01.217001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.217631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.219146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.241194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.247932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.248633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.300234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-216a5d1a-5358-4f2e-8fb5-5c93b273fffe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action" status: 200 len: 32 microversion: 2.1 time: 0.260739 Sep 03 20:56:01.303598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 972/1949] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:01 2022] POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:56:01.311095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:01.312006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:01.327102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.327872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.328777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.329943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.330598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.331106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.492954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:01.509199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-408336db-8525-4c6d-bff0-1e5b1a52c568 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1283 microversion: 2.1 time: 0.204137 Sep 03 20:56:01.510110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 973/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:01 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:01.518234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:01.518859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:01.536314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.537194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.538682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.539655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.540351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.541129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.584011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:01.722221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:01.731461 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac8afd1b-9ba0-4078-b737-2034c010245e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.540320 Sep 03 20:56:01.732316 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 978/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:01 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:01.751354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353de8f3-3b8d-41dd-95fb-26f3e3e8562b", "tag": "a974cd38-1ff2-4804-9165-31f634f47999"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:01.763862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:01.764514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:01.765109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:01.780790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] Creating event network-changed:a974cd38-1ff2-4804-9165-31f634f47999 for instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b on nch2-master-1 Sep 03 20:56:01.788587 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-dc8b99c5-cecc-4775-b349-fc6adfbd7cdb req-55d1b471-bed1-4b27-9dc4-cd868bed03bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046032 Sep 03 20:56:01.789890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 979/1952] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:01.797805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-430790008", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "2344d3b5-a659-4a36-8ca8-079609faaf44"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:01.878053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] validate_networks() for [('2344d3b5-a659-4a36-8ca8-079609faaf44', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:56:02.429892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:02.438275 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac62521b-0866-4db1-9733-6c30044f8538 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.927129 Sep 03 20:56:02.453806 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 974/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:01 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:02.463025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:02.463863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:02.471932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.473966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.474589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:02.475481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.476134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.476847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:02.725738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:56:02.726867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:56:02.727166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:56:02.731004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:56:02.731734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:56:02.743523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.744165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.744624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:02.745566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.746429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.746836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:02.775739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Getting quotas for project a9897f3d9893426f9fba83c8db250799. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:56:02.785257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Getting quotas for user f4d78b7738644ff38eb239daec52d641 and project a9897f3d9893426f9fba83c8db250799. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:56:02.806506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:56:02.810114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:56:02.896375 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8430ae77-1041-4036-b236-11ed8a8a511e tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104652 Sep 03 20:56:02.901175 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 980/1954] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:56:02.932256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:02.933748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:02.955228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.956761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.960170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:02.961470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:02.963878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:02.965446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.195655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.205473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.207094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.208348 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9a6b82ac-8f9e-4287-bdfd-92eddf5af490 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.753251 Sep 03 20:56:03.246157 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 975/1955] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:02 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:03.252219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:03.253267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 868e0374-e87b-47bb-b1c6-454b021cb0c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:03.263349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.264172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.264831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.265769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.266403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.267027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.285919 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] HTTP exception thrown: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Request method failure captured: Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 HTTP/1.1 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE76spTZS1AyZxMplyHfIHrNbt_PfsUdCdJtT0VmuiezxVf8QXjzT933YWiJM5DqY1uc8EGO6T3Ig4Z4Mm_RhQpqSOPKzuBmOp3DdI2PdJ9jI62sGfUu84Uxgt43j16M6pGusohNhbaMrnKRHmoSHoLfVQ-ywOzWa0-N6kGCHCJlZCj8 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 23ef148ffad044529cb3658ac1ed3107 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:03.287791 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 23ef148ffad044529cb3658ac1ed3107 Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListImageFiltersTestJSON-124868761-project Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 0f8ece445698482795d9b9d5ad5b13aa Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListImageFiltersTestJSON-124868761-project Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. Sep 03 20:56:03.290366 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '868e0374-e87b-47bb-b1c6-454b021cb0c7'} Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:03.293480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. Sep 03 20:56:03.297193 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:03.302376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Returning 404 to user: Instance 868e0374-e87b-47bb-b1c6-454b021cb0c7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:03.302376 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a0737035-6407-42a5-aaf2-f44eb7b5f434 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7" status: 404 len: 111 microversion: 2.1 time: 0.042308 Sep 03 20:56:03.302376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 976/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:03 2022] GET /compute/v2.1/servers/868e0374-e87b-47bb-b1c6-454b021cb0c7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:03.302376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64032526-9ab3-4528-9b6a-a4a9d0d5f631", "name": "network-vif-plugged", "status": "completed", "tag": "fb49300a-fe93-40a5-a740-b0e93324b179"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:03.310837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.311361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.311917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.329796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] Creating event network-vif-plugged:fb49300a-fe93-40a5-a740-b0e93324b179 for instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 on nch2-master-1 Sep 03 20:56:03.335821 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b35976de-382b-4f38-9182-f793e2eaf961 req-110eac68-a005-4916-9b6c-39666eafbc02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040699 Sep 03 20:56:03.337155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 977/1957] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:03.345736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:03.346986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:03.355906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.357373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.358017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.359130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.359811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.360642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.406007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.415915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce267b75-1b4d-4671-951c-00226e75a3e9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.513392 Sep 03 20:56:03.431708 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 981/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:02 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:03.436781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:03.469535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.470023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.470451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.488027 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Creating event network-vif-unplugged:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:56:03.499088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:56:03.515827 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b9ee4062-2149-476c-b2ba-e7e514067302 req-ddce0777-b5d9-4b7d-81b2-55f6ff91272b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097751 Sep 03 20:56:03.517214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 982/1959] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:03.525645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:03.526551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:03.534173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.534671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.535636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.536540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.540099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.540823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.666124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.684849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9b15ad0-37f9-4b5d-85af-b02fe1cb3987 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1283 microversion: 2.1 time: 0.165894 Sep 03 20:56:03.699191 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 983/1960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:03 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:03.699191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:03.699191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:03.716319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.717819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.718912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.720377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.722279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.724165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.914777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:03.932432 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dda9372b-7c35-4d93-9ec7-ccbe9476f02d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.593727 Sep 03 20:56:03.934186 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 978/1961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:03 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:03.946264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:03.946952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:03.956847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.958640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.959671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:03.961938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:03.962903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:03.963949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.150506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.174023 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-faba3666-f9dc-4ff0-a418-37facf9a7a5c tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1219 microversion: 2.1 time: 0.234215 Sep 03 20:56:04.174925 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 979/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:03 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:04.181144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:04.183521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:04.193511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.194370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.195266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.196127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.196778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.197647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.273386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:04.416368 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-585ffed3-efbf-4e2d-97b2-51c5990dabee tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 204 len: 0 microversion: 2.1 time: 0.239866 Sep 03 20:56:04.428213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 980/1963] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:04 2022] DELETE /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:04.446896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:04.448592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:04.458848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.459400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.459898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.461355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.462070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.462763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.535253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.543271 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4d39724-5022-467a-91e1-bda501610bc2 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.856601 Sep 03 20:56:04.544528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 984/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:03 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:04.549637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:04.550479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:04.556705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.557549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.558271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.559328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.559982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.560700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.778249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.791930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.795402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.796764 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9b637114-9aa0-4ca2-8e39-471572dbecd0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.251052 Sep 03 20:56:04.799131 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 985/1965] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:04 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:04.806033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:04.808842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:04.826259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.826961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.828830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.829824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.832379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.832842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.846060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:04.857178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:04.858901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88aab1d7-5b53-456f-a8ef-2e340fac57e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1390 microversion: 2.1 time: 0.428131 Sep 03 20:56:04.860213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 981/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:04 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:04.866023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:04.866993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:04.879757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.880250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.880746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:04.881555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:04.882011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:04.882438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.025494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.033914 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14281ba3-0cac-4995-b6cb-2b0d3516c8b8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1472 microversion: 2.1 time: 0.233784 Sep 03 20:56:05.034553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 986/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:04 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:05.040134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.041181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.047735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.048465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.049221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.049938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.050679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.051214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.138847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.155723 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0615b4d3-af7c-465e-b535-a0220ead4ab3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.294006 Sep 03 20:56:05.158375 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 982/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:04 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:05.171696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.173581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.192015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.192869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.193569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.194287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.195298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.195802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.232996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.242811 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3743a682-713c-4a17-9823-2e1cdf9bab14 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.206802 Sep 03 20:56:05.243658 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 987/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:05.252747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.253426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.260408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.260925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.261390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.262099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.262559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.262990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.325796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.335116 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d8e6235-9f77-4a78-8ada-f81251d64f21 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1283 microversion: 2.1 time: 0.089958 Sep 03 20:56:05.335782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 988/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:05.421487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.429932 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e73db0ba-a808-4b05-a830-ae8015804595 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.269645 Sep 03 20:56:05.430525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 983/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:05.561816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}, {"name": "network-changed", "server_uuid": "aea30a49-c252-47e8-9292-7a79cee5d453", "tag": "26a44f0d-8341-40ef-8068-318e4d42331b"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:05.566188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.566811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.569911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:05.572612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.573000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.573494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.573849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.574344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.574793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.575508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.575973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.576409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.587429 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Creating event network-changed:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:56:05.587941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Creating event network-changed:26a44f0d-8341-40ef-8068-318e4d42331b for instance aea30a49-c252-47e8-9292-7a79cee5d453 on nch1-master-1 Sep 03 20:56:05.593934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 20:56:05.606490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9c2b1ecc-a315-4d74-90da-611bda5920e7 req-f56a631d-9682-4c94-bb04-9b9ff36a588e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048343 Sep 03 20:56:05.607085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 989/1972] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:56:05.705207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.713554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ac31e8c-4144-4429-a6ed-3aa48d5007c3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.151171 Sep 03 20:56:05.714127 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 984/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:05.825179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.825820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.832598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.833112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.833545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.834235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.834690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.835112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.882853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:05.883530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:05.890128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.890613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.891055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.891783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:05.892197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:05.892621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:05.969382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.979068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.980513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:05.981664 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c0ca206-ed79-435a-849d-b2c589239c76 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.160838 Sep 03 20:56:05.982223 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 990/1974] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:06.025511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.033405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8002a9db-f008-44b0-86f4-0faa746b41e1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1380 microversion: 2.1 time: 0.154782 Sep 03 20:56:06.034002 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 985/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:05 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1380 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.055271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b897a8e-238f-4474-bc55-0f58c33990f8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '.version_select at 0x7fae6b78a9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.057647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.058242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.058717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b897a8e-238f-4474-bc55-0f58c33990f8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.059238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b897a8e-238f-4474-bc55-0f58c33990f8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.059690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b897a8e-238f-4474-bc55-0f58c33990f8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.064878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.065396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.065962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.067194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.067648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.068073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.073422 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b897a8e-238f-4474-bc55-0f58c33990f8 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4274 microversion: 2.1 time: 0.021701 Sep 03 20:56:06.074672 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 991/1976] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/os-migrations => generated 4274 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.102745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.103825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.110117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.110606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.111049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.111760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.112218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.112649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.210144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.218129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef6f5132-bed0-4d78-a5a4-635a2112ee05 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1472 microversion: 2.1 time: 0.164431 Sep 03 20:56:06.218960 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 986/1977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:06.224943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.225833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.231970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.232760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.233015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.233595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.234051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.234561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.306009 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c280ee16-cd80-4123-8d4a-fc37ca4ea1d2 tempest-LiveMigrationTest-297325220 tempest-LiveMigrationTest-297325220-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1531 microversion: 2.1 time: 0.217974 Sep 03 20:56:06.307330 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 992/1978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1531 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:06.311641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.312250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.318946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.319433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.319870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.320566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.321230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.321830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.385506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.394264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f3c0fa1-b8ed-47d3-b94d-cb29b34a2cd3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.174316 Sep 03 20:56:06.395372 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 987/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.400135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.401204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.407497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.408084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.408726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.409717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.410818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.411313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.436422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:06.474721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.482909 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e89d849-45f0-4458-a27b-013bc1f8b9c5 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.175046 Sep 03 20:56:06.483477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 993/1980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.488680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.489389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.495813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.496875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.496875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.497680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.498208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.498727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.515584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7421f368-cabd-4c6e-bbd3-c0b84484c367 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 204 len: 0 microversion: 2.1 time: 0.118985 Sep 03 20:56:06.516178 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 988/1981] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:06 2022] DELETE /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:06.521858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.522579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.528271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.528753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.529234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.529935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.530387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.530811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.535760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:06.571635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.579684 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ee1bd50-4d0a-4850-adca-24be461a80a4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1283 microversion: 2.1 time: 0.094933 Sep 03 20:56:06.580266 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 994/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.585362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.585971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.593160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.593906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.594346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.595046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.595505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.596336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.743429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.770136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52244249-16e8-45ad-985d-ff3072969780 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.252098 Sep 03 20:56:06.771091 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 989/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.782591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:06.783562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:06.793907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.794924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.795912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.796817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:06.798337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:06.799020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:06.831631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.846359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe5e5605-1fd5-40ab-9f24-83bcf828b4d7 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1386 microversion: 2.1 time: 0.264275 Sep 03 20:56:06.847416 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 995/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:06.952052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:06.961930 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e04a4514-dc47-4ac1-be3e-29caccc16b94 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.184060 Sep 03 20:56:06.962763 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 990/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:06 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:07.069144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.070003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.076667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.077219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.077656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.078671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.079228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.079754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.243505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.245008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.254771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.255349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.255849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.256760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.257424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.257861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.305666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.321319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.323230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.324585 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25304b87-5f03-4a71-a052-5b882b93f1f0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1280 microversion: 2.25 time: 0.322146 Sep 03 20:56:07.325274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 996/1986] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:07.420587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.421722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.430063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.430950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.431306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.432248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.432951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.433653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.518443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.528056 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40676e60-e67d-43a6-b330-6a2747f5043e tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1472 microversion: 2.1 time: 0.289410 Sep 03 20:56:07.528610 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 991/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:07.543528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.545362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.556948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.557925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.559542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.560884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.561649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.562322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.820205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.848519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.851584 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ccae0eab-965d-40b3-a52c-fbd9eae4aaeb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.436186 Sep 03 20:56:07.854037 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 997/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:07.864114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.864757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.875312 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48205193-2685-4b5c-853c-135b9d595483 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.345198 Sep 03 20:56:07.875821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.876210 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 992/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:07.876386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.876804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.877570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.878049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.878691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.882116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.882831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.889878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.890663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.891307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.892382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:07.892941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:07.893433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:07.967574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:07.977920 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e120054c-5356-45f2-b328-ee3461303aa7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1283 microversion: 2.1 time: 0.121554 Sep 03 20:56:07.978700 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 998/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:07.985901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:07.987972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:07.999334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.000677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.001269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.002131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.002898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.003118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.113081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.122482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5288a47d-57ed-420c-8202-6e242e2e71db tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.244392 Sep 03 20:56:08.138381 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 993/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:08.145812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.146714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.166365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.166866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.169799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.170569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.171049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.171496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.281499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.296309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-58ac3366-6e14-42fb-a865-7cb0c204c310 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1386 microversion: 2.1 time: 0.314865 Sep 03 20:56:08.297505 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 999/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:07 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:08.327313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed7062e-35f8-47f4-aee3-79417bc7081f", "name": "network-vif-deleted", "tag": "885ffc75-e8b5-46ed-a0b3-aa6a28d41082"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:08.342009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.343970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.344496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:08.345188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.362322 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] Creating event network-vif-deleted:885ffc75-e8b5-46ed-a0b3-aa6a28d41082 for instance 7ed7062e-35f8-47f4-aee3-79417bc7081f on nch2-master-1 Sep 03 20:56:08.371690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9d35bbc6-9ab4-4a9d-8afc-734db479560a req-973648a9-b009-4fe2-95b0-7e846ceec294 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047437 Sep 03 20:56:08.372553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=14 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:08.373642 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1000/1993] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:56:08.385221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.386140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.397058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.397222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.397718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.398231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.399019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.399746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.400709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.410422 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9da7ec96-5cb8-46e6-8da8-21dee2c49b74 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1468 microversion: 2.1 time: 0.270688 Sep 03 20:56:08.411412 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 994/1994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:08.551918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.552615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.561568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.562263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.562921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.563814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.564358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.564815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.569350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.583634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.585344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.586783 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c365d6b-4844-46f0-8a69-7763d2df392b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1476 microversion: 2.25 time: 0.211634 Sep 03 20:56:08.587367 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1001/1995] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:08.613819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.614518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.633753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.634632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.635181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.636099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.636760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.637434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.641035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.641597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.642068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.642581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lazy-loading 'fault' on Instance uuid 7ed7062e-35f8-47f4-aee3-79417bc7081f {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:08.700756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8ece445698482795d9b9d5ad5b13aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef148ffad044529cb3658ac1ed3107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:08.711065 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-647e74e9-91f7-4fa5-8765-58007976ac58 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 200 len: 1306 microversion: 2.1 time: 0.163767 Sep 03 20:56:08.712361 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 995/1996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 1306 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:08.809175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 64032526-9ab3-4528-9b6a-a4a9d0d5f631 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:08.830927 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f5cab9b0-b8a3-4df1-a7e3-72a2312d0d0b tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1968 microversion: 2.25 time: 0.221248 Sep 03 20:56:08.833139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1002/1997] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1968 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:08.858686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.859300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.865331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.866127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.866794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.867707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.868388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.873163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.876144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:08.877084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:08.884022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.884832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.885374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:08.886287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:08.887493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:08.888131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.052678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:09.062106 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da4c97fd-bac1-46a2-b6a5-8ae69d07b88a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.190136 Sep 03 20:56:09.063395 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1003/1998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:09.069380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.070701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.081268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.082711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.083433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.084408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.085151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.085811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.102738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 64032526-9ab3-4528-9b6a-a4a9d0d5f631 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:09.103140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:09.126797 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a524ea97-d68b-467a-8987-d52002579f00 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1968 microversion: 2.25 time: 0.271732 Sep 03 20:56:09.127387 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 996/1999] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:08 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1968 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:09.133129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.134077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.140866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.141668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.142423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.143377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.144120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.145563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.276945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:09.287257 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5f1efc3-ff4f-4b63-b31c-7e4a63e13651 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1293 microversion: 2.1 time: 0.157577 Sep 03 20:56:09.291058 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 997/2000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:09.314724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.315814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.329562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.330355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.333994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.335127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.335816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.336560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.338756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:09.352344 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac8ad9c6-4157-4704-ac36-f40053aecec4 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.287377 Sep 03 20:56:09.353648 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1004/2001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:09.359212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.363817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.364586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.365364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.367348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.368275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.369001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.402267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c237da4-8172-4b42-8bd0-a7b023b7b019 tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047302 Sep 03 20:56:09.413703 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1005/2002] 10.222.0.16 () {60 vars in 1217 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:56:09.421652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.424458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.435723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.436381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.437306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.438668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.439388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.440049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.641131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:09.654923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5765eeb0-d724-4174-abbd-0bed6db87c3a tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1386 microversion: 2.1 time: 0.239634 Sep 03 20:56:09.673264 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1006/2003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:09.673264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:09.673264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.693316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.693833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.694287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.695013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.695478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.695914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.734952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:09.753538 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d65c38a-e42d-4c8e-afb3-c08b558393b4 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.458335 Sep 03 20:56:09.754421 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 998/2004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:09.756479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'flavor' on Instance uuid 64032526-9ab3-4528-9b6a-a4a9d0d5f631 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:09.774049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:09.774888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:09.782425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Going to try to live migrate instance to nch1-master-1 {{(pid=140519) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 20:56:09.787526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.788105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.788552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:09.789307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:09.789762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:09.790191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.487883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:10.496345 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-006fd0f5-3475-4dbb-b242-845231122512 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1461 microversion: 2.1 time: 0.726523 Sep 03 20:56:10.496937 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 999/2005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:09 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1461 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:10.501328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353de8f3-3b8d-41dd-95fb-26f3e3e8562b", "name": "network-vif-plugged", "status": "completed", "tag": "a974cd38-1ff2-4804-9165-31f634f47999"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:10.510820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.511314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.511751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.525306 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] Creating event network-vif-plugged:a974cd38-1ff2-4804-9165-31f634f47999 for instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b on nch2-master-1 Sep 03 20:56:10.531649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2acaf2d1-f5b1-4b75-9014-462c3e872925 req-5adad357-8300-4f17-b2ac-a904d1055a4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Sep 03 20:56:10.532469 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1000/2006] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:10.539965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:10.540840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] [instance: 7ed7062e-35f8-47f4-aee3-79417bc7081f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:10.547344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.547841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.548289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.549020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.549479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.549912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.565006 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] HTTP exception thrown: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Request method failure captured: Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f HTTP/1.1 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE76spTZS1AyZxMplyHfIHrNbt_PfsUdCdJtT0VmuiezxVf8QXjzT933YWiJM5DqY1uc8EGO6T3Ig4Z4Mm_RhQpqSOPKzuBmOp3DdI2PdJ9jI62sGfUu84Uxgt43j16M6pGusohNhbaMrnKRHmoSHoLfVQ-ywOzWa0-N6kGCHCJlZCj8 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 23ef148ffad044529cb3658ac1ed3107 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:10.566884 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/23ef148ffad044529cb3658ac1ed3107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 23ef148ffad044529cb3658ac1ed3107 Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-124868761 Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListImageFiltersTestJSON-124868761-project Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 0f8ece445698482795d9b9d5ad5b13aa Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListImageFiltersTestJSON-124868761-project Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. Sep 03 20:56:10.568676 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7ed7062e-35f8-47f4-aee3-79417bc7081f'} Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:10.573961 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. Sep 03 20:56:10.575468 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:10.576742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Returning 404 to user: Instance 7ed7062e-35f8-47f4-aee3-79417bc7081f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:10.576742 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1050ed82-9f09-4a31-9fa0-93b11348ca24 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f" status: 404 len: 111 microversion: 2.1 time: 0.034567 Sep 03 20:56:10.576742 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1001/2007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:10 2022] GET /compute/v2.1/servers/7ed7062e-35f8-47f4-aee3-79417bc7081f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:10.576742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:10.576742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:10.581527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.582207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.582636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.583414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.583951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.584496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.776777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:10.785506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4404496-601d-4449-86be-78fc4673f563 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.214169 Sep 03 20:56:10.786093 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1002/2008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:10 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:10.790570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:10.791360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:10.807492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.808339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.808853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:10.809836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:10.810376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:10.810883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.010588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:11.018576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-182d5fdb-5dd2-48bf-97f7-2459bb51013d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.231467 Sep 03 20:56:11.019152 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1003/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:10 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:11.034090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.034741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:11.041520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.042039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.042519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.043236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.043696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.044126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.174602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:11.183014 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-638efc99-7ca8-4c60-8b2e-bb6cd37d445b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.152920 Sep 03 20:56:11.183587 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1004/2010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:11 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:11.291898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.292511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:11.298661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.299145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.299581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.300281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.301414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.301842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.431654 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a98e7558-4a0a-416c-b172-a20bcb0f20c2 tempest-MigrationsAdminTest-711416503 tempest-MigrationsAdminTest-711416503-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1612 microversion: 2.1 time: 0.247010 Sep 03 20:56:11.432229 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1005/2011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:11 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1612 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:11.436822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f656ed8-e56f-4daf-9d55-4483e40c5ca8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66a5edc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.661226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f656ed8-e56f-4daf-9d55-4483e40c5ca8 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23" status: 204 len: 0 microversion: 2.1 time: 0.227822 Sep 03 20:56:11.661803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1006/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:11 2022] DELETE /compute/v2.1/images/c170515e-237d-4a7a-b8a4-b2a9a9599f23 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:11.669868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.670737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:11.677902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.678441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.678884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.679823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.680288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.680726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.703135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:11.825933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:11.834125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf9fc395-6d18-4d05-a269-e839666675bf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1386 microversion: 2.1 time: 0.168385 Sep 03 20:56:11.834703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1007/2013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:11 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:11.839273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.839870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:11.846053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.846539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.847097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.848487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:11.848986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:11.849355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:11.982876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:11.991725 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c250a81-277a-4748-b95a-3ea39e9186f3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1308 microversion: 2.1 time: 0.156023 Sep 03 20:56:11.992328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1008/2014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:11 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:11.996852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:11.997380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:12.003144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.003661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.004111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.004816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.005301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.005742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.033015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:12.107505 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a522e1a0-3bdf-474d-9a2b-fe8a19954517 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 204 len: 0 microversion: 2.1 time: 0.113957 Sep 03 20:56:12.108100 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1009/2015] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:11 2022] DELETE /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:12.113719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-682862d6-fdf1-4c82-a6f8-d2d448b20069 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae66a5e940>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:12.327963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-682862d6-fdf1-4c82-a6f8-d2d448b20069 tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9" status: 204 len: 0 microversion: 2.1 time: 0.218660 Sep 03 20:56:12.328543 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1010/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:12 2022] DELETE /compute/v2.1/images/e85f5144-2a17-4bf0-9b66-0ea5a5fdfba9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:12.333647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:12.334377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:12.340344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.340834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.341321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.342033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.342738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.343178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.479479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:12.487219 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46056319-bf26-4e8a-87c2-e2970a92c4f2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.157689 Sep 03 20:56:12.487784 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1011/2017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:12 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:12.492105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:12.492708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:12.498253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.498808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.499248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.499944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.500403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.500839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.630149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:12.637861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8737553b-dc3d-4e04-a134-33b1783ac766 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.149128 Sep 03 20:56:12.638423 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1012/2018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:12 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:12.642818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:12.643422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:12.649609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.650095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.650534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.651227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.651704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.652181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.799018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:12.801481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:12.815096 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c3131b4a-4bd2-44b3-8027-ed174a0fc7f8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1467 microversion: 2.1 time: 0.175606 Sep 03 20:56:12.815689 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1013/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:12 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1467 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:12.834387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:12.835426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:12.843955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.844581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.845132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:12.845936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:12.846468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:12.846963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:13.217678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:13.225777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a6d04e6-524b-4209-b162-7eb72abf9f38 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.408603 Sep 03 20:56:13.226351 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1014/2020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:12 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:13.231244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2f2d6e9-a584-4431-bce1-bcd20756492b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] Calling method '.version_select at 0x7fae67180820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:13.478382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2f2d6e9-a584-4431-bce1-bcd20756492b tempest-ListImageFiltersTestJSON-124868761 tempest-ListImageFiltersTestJSON-124868761-project] 10.222.0.16 "DELETE /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328" status: 204 len: 0 microversion: 2.1 time: 0.250607 Sep 03 20:56:13.478949 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1015/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:13 2022] DELETE /compute/v2.1/images/396c75df-8f30-40a3-83bf-f668c04e7328 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:13.484259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-plugged", "status": "completed", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:13.495547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:13.496036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:13.496693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:13.513377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] Creating event network-vif-plugged:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:56:13.518414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b47c7629-40f4-483d-9ea1-643322aa83c3 req-de9a9553-d09a-47a9-ae6f-41a043dfc954 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038048 Sep 03 20:56:13.519019 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1016/2022] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:13.524248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:13.524977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:13.531187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:13.531681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:13.532125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:13.533154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:13.533623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:13.534059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:13.894981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:13.903038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-151cca48-fbdd-4be6-93da-4b8e0f8750fb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 200 len: 1386 microversion: 2.1 time: 0.382684 Sep 03 20:56:13.903617 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1017/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:13 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 1386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:13.908928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:13.909732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:13.916199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:13.917463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:13.918069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:13.918987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:13.919613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:13.920049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.161929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:14.171256 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad6d3957-7432-498f-a4a9-49f8d13065bf tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1489 microversion: 2.1 time: 0.266351 Sep 03 20:56:14.171922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1018/2024] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:13 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1489 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:14.177394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:14.178013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:14.186384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.186878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.187315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.188029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.188482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.188938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.401894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:14.411657 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8a65f11-52b0-4819-a3c0-23c5af5d23c7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.238725 Sep 03 20:56:14.412455 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1019/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:14 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:14.417000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:14.417893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:14.423890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.424384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.424936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.425707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.426165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.426787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.766024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:14.777140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e5e7f16-32e3-4350-8b77-e276e85ae25d tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.363467 Sep 03 20:56:14.790995 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1020/2026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:14 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:14.801832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:14.802951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:14.809737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.811560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.812290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:14.813574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:14.814277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:14.814956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.332868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:15.353523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b4e0aa1-e46b-4ad8-b3b0-55c21730d6cf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1467 microversion: 2.1 time: 0.556018 Sep 03 20:56:15.354613 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1021/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:14 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1467 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:15.360614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aef1ba9-973d-4f0b-afa7-3c226090ffda", "name": "network-vif-deleted", "tag": "376b5603-e166-4498-98d5-02cc1d5f3246"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:15.374898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.375696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.376134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.390481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] Creating event network-vif-deleted:376b5603-e166-4498-98d5-02cc1d5f3246 for instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda on nch1-master-1 Sep 03 20:56:15.397864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2245eea7-dceb-49be-be9c-2ec496bcea74 req-1ad525dc-3034-4e23-a61f-4884d2c9091d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041895 Sep 03 20:56:15.399451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1022/2028] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:15.406967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-101947232"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:15.410102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:15.417229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.418044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.418714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.419954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.420677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.421702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.603669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-38ede3e8-32ac-4ed4-ad9e-5ca64948f9ae tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631/action" status: 202 len: 0 microversion: 2.25 time: 5.939082 Sep 03 20:56:15.604952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1007/2029] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:56:09 2022] POST /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631/action => generated 0 bytes in 5941 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:15.612295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:15.615388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:15.649538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.650356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.651194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.656415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.657216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.657845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.818359 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a4f067f4-8ee4-4a2b-9d2f-0f7d7c3e5f0e tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "POST /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b/action" status: 202 len: 0 microversion: 2.1 time: 0.416839 Sep 03 20:56:15.821881 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1023/2030] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:15 2022] POST /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 20:56:15.834847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:15.835574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 3aef1ba9-973d-4f0b-afa7-3c226090ffda] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:15.857793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.858412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.858851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.860038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.860510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.860987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.865481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:15.877961 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6b27bc4-b729-4843-972f-8650c9583386 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.271213 Sep 03 20:56:15.879159 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1008/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:15 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:15.898976 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] HTTP exception thrown: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Request method failure captured: Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda HTTP/1.1 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73wRScQLJllZx30-sX0Ox3aE2OS6ulqxndYY4K6YHU11nCc8NImlnJY8pJRToP6HAwKss9ho5K4U-_rt-Fohenh6PlQYaogVfr_4j1AqC_5k6w8CebWXqRSyQD8H6-b_7gziqX5TflISa3Ix-h0wb-_xXQqHVplYPvYdGGoSVNs-Sc Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:15.900690 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 90d7e4c2e577467f949be3dc480cc7a2 Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. Sep 03 20:56:15.902511 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3aef1ba9-973d-4f0b-afa7-3c226090ffda'} Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:15.903744 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. Sep 03 20:56:15.905868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:15.907440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Returning 404 to user: Instance 3aef1ba9-973d-4f0b-afa7-3c226090ffda could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:15.907440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1b1a9a9-2b8e-405d-b4a6-f8710da22d80 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda" status: 404 len: 111 microversion: 2.1 time: 0.078907 Sep 03 20:56:15.911716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1024/2032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:15 2022] GET /compute/v2.1/servers/3aef1ba9-973d-4f0b-afa7-3c226090ffda => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:15.923165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:15.923816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:15.942011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.942417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.942862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.943592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:15.944043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:15.951384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:15.956261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:15.979714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f2f3cc5-fff9-4d31-829d-63cbb5eac066 tempest-ListImageFiltersNegativeTestJSON-1834271045 tempest-ListImageFiltersNegativeTestJSON-1834271045-project] Calling method '.version_select at 0x7fae6b7ee310>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.013380 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4f2f3cc5-fff9-4d31-829d-63cbb5eac066 tempest-ListImageFiltersNegativeTestJSON-1834271045 tempest-ListImageFiltersNegativeTestJSON-1834271045-project] HTTP exception thrown: Image not found. Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f2f3cc5-fff9-4d31-829d-63cbb5eac066 tempest-ListImageFiltersNegativeTestJSON-1834271045 tempest-ListImageFiltersNegativeTestJSON-1834271045-project] Request method failure captured: Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/images/59037abe-15f8-4d1e-a8bd-7e3db6a9cffd HTTP/1.1 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE79uS09g9dDTuEwHnv25gJT68EjtXjusu7rg1EnqtoQ5EAFzmm3Dh2kyaUQhZdn5HPjnFDAyStD9c38qvQqYOlJI9Nd1ykC_rRrJgfnDLMbMAPnAy1Gl_7qTC3xqz1H0CkaXFF_QNa9lCz5n4RKNEeZbHX05RyJLvErplFH-ji4gudA Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a6b699f400a84eed9e606a9a1c366970 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1834271045 Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:16.017047 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6b699f400a84eed9e606a9a1c366970"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6b699f400a84eed9e606a9a1c366970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6b699f400a84eed9e606a9a1c366970"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6b699f400a84eed9e606a9a1c366970"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1834271045 Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a6b699f400a84eed9e606a9a1c366970 Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1834271045 Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ListImageFiltersNegativeTestJSON-1834271045-project Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 55530fcf9fea48279b38c2bd7db37122 Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1834271045-project Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '59037abe-15f8-4d1e-a8bd-7e3db6a9cffd'} Sep 03 20:56:16.018886 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:16.020532 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 59037abe-15f8-4d1e-a8bd-7e3db6a9cffd Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:16.022698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59037abe-15f8-4d1e-a8bd-7e3db6a9cffd could not be found. Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:16.024942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:16.029946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f2f3cc5-fff9-4d31-829d-63cbb5eac066 tempest-ListImageFiltersNegativeTestJSON-1834271045 tempest-ListImageFiltersNegativeTestJSON-1834271045-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:16.032374 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f2f3cc5-fff9-4d31-829d-63cbb5eac066 tempest-ListImageFiltersNegativeTestJSON-1834271045 tempest-ListImageFiltersNegativeTestJSON-1834271045-project] 10.222.0.16 "GET /compute/v2.1/images/59037abe-15f8-4d1e-a8bd-7e3db6a9cffd" status: 404 len: 62 microversion: 2.1 time: 0.139655 Sep 03 20:56:16.032374 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1009/2033] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:56:15 2022] GET /compute/v2.1/images/59037abe-15f8-4d1e-a8bd-7e3db6a9cffd => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:16.040981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.043543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:16.064886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.065560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.067537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.068334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.071059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.074583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.463517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.478186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.483250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.486111 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f937feb2-c5f8-45f0-940e-ec7564cd7552 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.461467 Sep 03 20:56:16.488021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1010/2034] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:16.494598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.501464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:16.511998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.513118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.513619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.514086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.517481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.520097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.520436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.528397 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5e21b29-8df5-4dea-9c6e-599561689c49 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.615524 Sep 03 20:56:16.547633 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1025/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:15 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:16.557926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c784252-264f-43a9-b894-8d809404620a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66a5e9d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.630180 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c784252-264f-43a9-b894-8d809404620a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637" status: 200 len: 1413 microversion: 2.1 time: 0.079850 Sep 03 20:56:16.631645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1026/2036] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:16.637627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.638526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:16.646889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.647818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.648469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.649495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.650871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.651520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.789893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.798731 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ef03d74-b080-412d-ab56-1b6295248ab3 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1425 microversion: 2.1 time: 0.165573 Sep 03 20:56:16.816945 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1027/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1425 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:16.816945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39a73d0f-ed98-458d-b17f-7d3a12c33930 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66a5e8b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.844676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:16.864824 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8292dd6d-2c55-4eeb-aba7-b4237c6855d0 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.374718 Sep 03 20:56:16.865596 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1011/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:16.902086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39a73d0f-ed98-458d-b17f-7d3a12c33930 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637" status: 200 len: 1413 microversion: 2.1 time: 0.098078 Sep 03 20:56:16.902683 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1028/2039] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:16.907670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.908302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:16.917043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48578326-9a49-4fd7-8d82-ed1f30247cee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66a27040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:16.917338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.918327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.918901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:16.919905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:16.920571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:16.921235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.141017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48578326-9a49-4fd7-8d82-ed1f30247cee tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637" status: 204 len: 0 microversion: 2.1 time: 0.227586 Sep 03 20:56:17.142068 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1029/2040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:16 2022] DELETE /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:17.149252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.150363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7086aba2-5139-48be-a15e-2501873ee30d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae66a6a430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.161059 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c83945e-8b12-4c88-90c6-515df993bb2f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.258797 Sep 03 20:56:17.162861 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1012/2041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:16 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:17.198130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7086aba2-5139-48be-a15e-2501873ee30d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Image not found. Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7086aba2-5139-48be-a15e-2501873ee30d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 HTTP/1.1 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:17.200832 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '078fb1e6-4370-4d14-a8b0-574b266a8637'} Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:17.202758 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 078fb1e6-4370-4d14-a8b0-574b266a8637 Sep 03 20:56:17.203810 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:17.205104 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 078fb1e6-4370-4d14-a8b0-574b266a8637 could not be found. Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:17.206652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7086aba2-5139-48be-a15e-2501873ee30d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:17.207976 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7086aba2-5139-48be-a15e-2501873ee30d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637" status: 404 len: 62 microversion: 2.1 time: 0.056011 Sep 03 20:56:17.210581 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1030/2042] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 20:56:17.216146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.217732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.218256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.219035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.227237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.227819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.228275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.229018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.229480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.230352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.232021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.237053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.239029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.240531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.241545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.242288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.266310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:17.383464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:17.391523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42abb364-4087-4322-a2c1-3aa942da6516 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 204 len: 0 microversion: 2.1 time: 0.178283 Sep 03 20:56:17.392046 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1031/2043] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:17 2022] DELETE /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:17.401355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.402609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.408177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.408520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.408982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.409728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.410753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.411381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.420121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.428809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7d35f1c8-cd5d-4f8e-86b3-7cbd86da609d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1507 microversion: 2.1 time: 0.216859 Sep 03 20:56:17.429554 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1013/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:17.515337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.516120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.523321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.524004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.524551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.525368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.525936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.526607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.557527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.567667 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04f53cdd-c6c1-491a-9f69-f68b76440967 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1665 microversion: 2.1 time: 0.170539 Sep 03 20:56:17.576969 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1032/2045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:17.576969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.576969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.581290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.582128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.582816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.583771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.584542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.585280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.681661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.692517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.695004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.696659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8780da0d-e31c-491b-a527-a67f65097b26 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.185597 Sep 03 20:56:17.697417 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1014/2046] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:56:17.722560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fe43ee-b5a6-43d1-bbfe-02e3034dc456", "tag": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a"}, {"server_uuid": "1ac394b2-62f8-410b-9cd9-a9b52d821013", "name": "network-vif-deleted", "tag": "1f4f56b3-4109-4eed-b05c-9dff29ffe705"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:17.733885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.734458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.734962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.747017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.748254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Creating event network-changed:5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a for instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 on nch1-master-1 Sep 03 20:56:17.748760 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] Creating event network-vif-deleted:1f4f56b3-4109-4eed-b05c-9dff29ffe705 for instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 on nch1-master-1 Sep 03 20:56:17.756303 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bfae1106-9e98-4e49-b690-f144a45280e3 req-963d7306-ff92-4935-858a-f537c1acefaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037592 Sep 03 20:56:17.756844 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a08930b0-c5cd-4a38-bc96-60b4188ef320 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.186776 Sep 03 20:56:17.757470 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1015/2047] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:56:17.757608 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1033/2048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:17.836127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.836746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.843756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.844246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.844722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.845465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.845922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.846355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.887854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:17.888565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:17.895281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.895777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.896257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.897055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:17.897699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:17.898132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:17.916710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:17.925504 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f3619ce-7902-4fcc-bc8e-25e9e2756b05 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1425 microversion: 2.1 time: 0.093790 Sep 03 20:56:17.926649 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1034/2049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1425 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:18.029740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.038020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b43a9666-899c-4669-bdd5-629fc4706ae4 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.154375 Sep 03 20:56:18.038874 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1016/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:17 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:18.186788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.187413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.195413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.195907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.196404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.197247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.197716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.198154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.346154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.354851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94c3e5d9-c1cb-4065-8873-21ea3a97c78f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.172163 Sep 03 20:56:18.356070 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1035/2051] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:18.454581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.455596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.463302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.464068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.464692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.465440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.466140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.466794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.594750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.596014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.602849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.604204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.604758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.605235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.606138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.606677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.607587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.612194 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74f2ad23-cadb-4235-9354-126ee0c86c68 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1507 microversion: 2.1 time: 0.161585 Sep 03 20:56:18.613085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1017/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:18.723229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.724165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.730919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.731410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.731850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.732707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.733189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.733616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.788248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.797308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e65b7ca-0b29-4858-85a5-cd02d64714b6 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1665 microversion: 2.1 time: 0.206293 Sep 03 20:56:18.797565 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1036/2053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1665 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:18.832626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.833295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.858792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.859401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.859858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.860590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.861085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.861520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.906570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.915509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.919174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:18.920667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f59da332-b0bc-4e02-99fd-5bfc7856db8a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.202617 Sep 03 20:56:18.921656 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1018/2054] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:18.952375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:18.953015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:18.955263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:18.962106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.962709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.963138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:18.963887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:18.964565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:18.965015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.038205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:19.048714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-527d0c4e-86f4-4be9-ae3c-e952217aff73 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 200 len: 1425 microversion: 2.1 time: 0.101197 Sep 03 20:56:19.049967 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1019/2055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 1425 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:19.061355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:19.062606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:19.070041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.070897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.071622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.072560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.073298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.074172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.214210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:19.224723 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15729a9a-3591-473b-899a-712bcc44ac9c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.396574 Sep 03 20:56:19.225631 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1037/2056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:18 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:19.275014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:19.286881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-39236601-5283-488c-9350-14aa849f5d1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.229291 Sep 03 20:56:19.289505 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1020/2057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:19 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:19.378186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:19.379069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:19.385402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.385912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.386356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.387083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.387866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.388350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.628280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea30a49-c252-47e8-9292-7a79cee5d453", "name": "network-vif-plugged", "status": "completed", "tag": "26a44f0d-8341-40ef-8068-318e4d42331b"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:19.636965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:19.651226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.652575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.657266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.695077 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] Creating event network-vif-plugged:26a44f0d-8341-40ef-8068-318e4d42331b for instance aea30a49-c252-47e8-9292-7a79cee5d453 on nch1-master-1 Sep 03 20:56:19.704980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-de0038f5-2930-4cd3-83ed-6e917e8e8c45 req-2e511f90-ee46-4456-8f61-63fa8c41e3ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080993 Sep 03 20:56:19.705919 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1021/2058] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:56:19.713425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:19.714345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:19.722669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.723163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.723776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.724816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.730230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:19.735840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.736403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.743579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:19.744003 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b388ccd-3fb7-4ed2-a635-2dfb7b01b318 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.369392 Sep 03 20:56:19.745990 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1038/2059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:19 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:19.825738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:19.828982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:19.851934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.854007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.858782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:19.862210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:19.864016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:19.866893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.009911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.020623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed418f11-4bbc-4aee-bc11-143ad6c4392c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1502 microversion: 2.1 time: 0.312898 Sep 03 20:56:20.023349 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1022/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:19 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:20.037846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.040502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.054286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.055045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.056215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.059880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.061350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.062026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.256258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.273181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.274022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.277630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.282427 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c7e4e03d-2bd9-42dd-b2eb-0207b504cf1c tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.257590 Sep 03 20:56:20.283226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e399bfcf-4fbe-4cd5-a193-cb76315b19be tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1665 microversion: 2.1 time: 0.462199 Sep 03 20:56:20.289016 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1039/2061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:19 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1665 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:20.298695 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1023/2062] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:20.301573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.303690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 1ac394b2-62f8-410b-9cd9-a9b52d821013] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.308798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.309469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.317301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.317800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.318239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.318947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.325668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.326270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.327125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.333233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.333699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.335622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.336097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.336534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.356233 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] HTTP exception thrown: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Request method failure captured: Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 HTTP/1.1 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74G-amNHT9k8uNN4nQQ_MFh_HnnOK0AneZEKZLSAUHQhhTex21DLI3f3DrmOLRiNWSDNtrOd2Cliip_JVzSshs0Vp8EItZ3jMk4PoVfOmmYc28bFWdXVFasNWN94P8yyYt3N6526WLpx3PDHJRi5_0pvWIZvl9-RLl0V9ATr_cVXqA Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:20.362191 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2e11c33c786746e5b3effedd32674582 Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. Sep 03 20:56:20.364121 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1ac394b2-62f8-410b-9cd9-a9b52d821013'} Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:20.365172 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. Sep 03 20:56:20.366784 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:20.370535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Returning 404 to user: Instance 1ac394b2-62f8-410b-9cd9-a9b52d821013 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:20.372284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13ba334e-3e86-455d-9e2d-29e6ab48ccfc tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013" status: 404 len: 111 microversion: 2.1 time: 0.082053 Sep 03 20:56:20.375563 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1040/2063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/1ac394b2-62f8-410b-9cd9-a9b52d821013 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:20.397061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.398018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.405348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.406505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.407065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.407881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.408444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.409004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.623123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.634906 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18cc58dc-bcd9-4324-be97-8d7c6924a6e3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.334880 Sep 03 20:56:20.648927 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1024/2064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:20.648927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.648927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.651213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.652566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.653297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.654437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.655799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.656459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.713146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:20.789562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:20.797635 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f164fb16-a5f8-47e8-b9ca-edd54963be1a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.420595 Sep 03 20:56:20.798230 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1041/2065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:20.803633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.804362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.821319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.821740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.822190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.822918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.823376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.823811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.866672 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-636390dd-6d29-44b5-a876-2c77540b2437 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 204 len: 0 microversion: 2.1 time: 0.228746 Sep 03 20:56:20.868952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1025/2066] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:20 2022] DELETE /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:20.880788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:20.881787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:20.893681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.894372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.895535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:20.896319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:20.896847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:20.898507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.085070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.095560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d742a5c-7fd8-46a2-9f2b-1f968b2b7a6e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1534 microversion: 2.1 time: 0.222465 Sep 03 20:56:21.114101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1026/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1534 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:21.120517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:21.121171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:21.141264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.143178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.144791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.146083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.146932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.148669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.332840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.341450 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a67d0e3-266e-4154-85e1-706f9fe4c4ce tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1489 microversion: 2.1 time: 0.226130 Sep 03 20:56:21.346702 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1027/2068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:21 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1489 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:21.352140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:21.353418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:21.364992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.366000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.366159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.367511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.367976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.368411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.491947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.501513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aeda78b2-c353-4991-8175-72dc89e3663f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.702157 Sep 03 20:56:21.502993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1042/2069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:20 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:21.510118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:21.511104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:21.529140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.530206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.530902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.531935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.533442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.535886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.554416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.567274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.568868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.570267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-61903404-61c1-43a1-860c-0d3a1f5c572e tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.222370 Sep 03 20:56:21.577531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1028/2070] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:21 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:21.598558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:21.598930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:21.615529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.616188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.616935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.617925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.618939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.619633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.665490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:21.787769 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40fed934-4eed-4eff-8407-d0198cb93770 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 204 len: 0 microversion: 2.1 time: 0.199520 Sep 03 20:56:21.793210 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1029/2071] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:21 2022] DELETE /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:21.801245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:21.802224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:21.813619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.815846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.816822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.817621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:21.818161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:21.818807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:21.986615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:21.995438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e293bd5a-d680-47a8-a60c-5bbfc6baf355 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.200359 Sep 03 20:56:21.996173 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1030/2072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:21 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:22.019749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353de8f3-3b8d-41dd-95fb-26f3e3e8562b", "name": "network-vif-plugged", "status": "completed", "tag": "a974cd38-1ff2-4804-9165-31f634f47999"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:22.031173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.031450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.031793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.045567 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] Creating event network-vif-plugged:a974cd38-1ff2-4804-9165-31f634f47999 for instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b on nch2-master-1 Sep 03 20:56:22.051607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f07367dd-867a-46d3-9203-38d152cfa686 req-92df8b9e-94ef-480d-bfe9-2aaef4c23abf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041037 Sep 03 20:56:22.052853 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1031/2073] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:22.059392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90c01de9-d4b0-4e77-ba94-e3e5797bac57 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b75b550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.126669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-90c01de9-d4b0-4e77-ba94-e3e5797bac57 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Image not found. Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90c01de9-d4b0-4e77-ba94-e3e5797bac57 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 HTTP/1.1 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:22.129213 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '078fb1e6-4370-4d14-a8b0-574b266a8637'} Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:22.130760 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 078fb1e6-4370-4d14-a8b0-574b266a8637 to delete Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.131777 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 078fb1e6-4370-4d14-a8b0-574b266a8637 could not be found. Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:22.133559 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90c01de9-d4b0-4e77-ba94-e3e5797bac57 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90c01de9-d4b0-4e77-ba94-e3e5797bac57 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637" status: 404 len: 62 microversion: 2.1 time: 0.076665 Sep 03 20:56:22.135309 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1032/2074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:22 2022] DELETE /compute/v2.1/images/078fb1e6-4370-4d14-a8b0-574b266a8637 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:22.138206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.138980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.150436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.150943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.151393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.152276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.152739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.153266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.356456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:22.368398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f5166e36-e9cd-4991-bd4f-cb164fc2828f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.235797 Sep 03 20:56:22.369102 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1033/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:22 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:22.373722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.374452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.381512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.382080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.388752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.389765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.390532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.391932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.438800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:22.459170 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a13cc50-c188-4eba-9fa3-bc1dfff194f3 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1665 microversion: 2.1 time: 0.953992 Sep 03 20:56:22.460344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1043/2076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:21 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1665 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:22.471154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.471957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.494993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.496785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.498958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.500103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.501371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.505741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.543181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:22.548868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:22.611700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:22.633320 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.compute.api [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Instance is already in deleting state, ignoring this request Sep 03 20:56:22.633834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32097dc0-de09-44a3-852e-a4e47e5ab0b8 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1534 microversion: 2.1 time: 0.263541 Sep 03 20:56:22.634486 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1034/2077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:22 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1534 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:22.635017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15eaf05c-2a7c-4050-8f79-6bd4039e072a tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 204 len: 0 microversion: 2.1 time: 0.173173 Sep 03 20:56:22.635891 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1044/2078] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:22 2022] DELETE /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:22.647866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.648487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.650233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.651069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.659433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.660561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.661302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.662155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.663226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.663226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.663743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.664330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.665234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.665727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.666629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.667293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.853375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:22.864051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b969401-804e-4d40-aeb2-bf703c7b2dcc tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1325 microversion: 2.1 time: 0.228523 Sep 03 20:56:22.869319 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1035/2079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:22 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1325 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:22.872819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:22.875458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:22.890059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.891143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.891886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:22.907514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:22.908289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:22.908801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.039082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.048099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.049860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.052002 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-450cefec-fb05-4c1d-a1a2-82ea70b1c37d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.414865 Sep 03 20:56:23.065454 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1045/2080] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:22 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:23.075365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:23.076204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:23.082843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.083602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.084239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.085170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.085931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.086536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.150275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.158878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f1793674-048b-4125-a2ed-c6ee1ee60845 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1495 microversion: 2.1 time: 0.293104 Sep 03 20:56:23.178477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1036/2081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:22 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1495 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:23.393511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:23.395039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:23.422589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.423112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.423555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.429449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.430286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.430908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.438655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:23.472114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.484208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a7abdd0-59d9-4486-b076-d2cbf12c260d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.417515 Sep 03 20:56:23.485135 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1046/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:23 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:23.500688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:23.501832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:23.520806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.521415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.521862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.522595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.523059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.523493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.677842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.690365 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2cb157f-7c1c-40d7-853d-33bbf4749dbf tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1598 microversion: 2.1 time: 0.204096 Sep 03 20:56:23.706990 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1047/2083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:23 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1598 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:23.715921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b584970a-cead-49b8-9437-4b62c236be34", "name": "network-vif-deleted", "tag": "8ec3e315-24b3-4939-8efb-66265a9659ac"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:23.727893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.728397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.728922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.743552 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] Creating event network-vif-deleted:8ec3e315-24b3-4939-8efb-66265a9659ac for instance b584970a-cead-49b8-9437-4b62c236be34 on nch1-master-1 Sep 03 20:56:23.750040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-414b07c5-b642-4f00-a305-3d238c1355cf req-3128d960-f990-4fb3-9e61-935d9a51ba0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041068 Sep 03 20:56:23.750834 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1048/2084] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:23.757962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:23.758691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:23.765992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.766424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.766872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.767607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.768461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.768973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.953102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:23.964100 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cad8de6-5595-4f9e-b389-080da540ddbf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1534 microversion: 2.1 time: 0.212204 Sep 03 20:56:23.965503 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1049/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:23 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1534 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:23.973425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:23.974399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:23.986612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.987456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.988724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:23.989907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:23.990963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:23.991603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.245635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.255337 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c114da2c-a23a-4582-8068-12d7b71e7d01 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1522 microversion: 2.1 time: 0.288585 Sep 03 20:56:24.270557 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1050/2086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:23 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:24.283780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.285243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.292499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.293244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.293897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.294640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.295132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.295568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.532631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.536362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.546362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.548099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.549883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82f03d15-8d9b-42b4-a2f5-99c9efa410dd tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.277883 Sep 03 20:56:24.551530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1051/2087] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:24 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:24.556827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.557655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.564813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.565862 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a36c948-173d-407c-a8db-55e3c165185a tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 1.175749 Sep 03 20:56:24.566081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.566689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.566965 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1037/2088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:23 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:24.567860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.568607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.569520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.571825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.572389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.587519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.588042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.588497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.589254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.589754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.590306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.635153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:24.767309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.771310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53e2b395-34ee-41a5-85ba-66160f1feb09 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 204 len: 0 microversion: 2.1 time: 0.203021 Sep 03 20:56:24.774116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1038/2089] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:24 2022] DELETE /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:24.785644 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3636ddaa-55f7-4c86-b1e6-c1cedbe16aa3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1495 microversion: 2.1 time: 0.232774 Sep 03 20:56:24.786253 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1052/2090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:24 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1495 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:24.787476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.788395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.791261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fe43ee-b5a6-43d1-bbfe-02e3034dc456", "name": "network-vif-plugged", "status": "completed", "tag": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:24.796299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.798264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.798910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.799953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.800620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.801315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.802875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.803362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.804717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.820715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] Creating event network-vif-plugged:5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a for instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 on nch1-master-1 Sep 03 20:56:24.827070 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5467cc16-de16-4599-93b3-c8906fcaf91a req-6cba8081-b062-426c-ad3d-390082496d4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039638 Sep 03 20:56:24.828381 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1053/2091] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:24.847683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.849342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.857129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.858326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.859433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.860280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.860846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.861670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.913864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.914696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.915303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.915930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lazy-loading 'fault' on Instance uuid b584970a-cead-49b8-9437-4b62c236be34 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:24.961626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:24.971176 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd5a7dd8-5458-4682-b1d2-9d41198705d1 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1324 microversion: 2.1 time: 0.141473 Sep 03 20:56:24.973302 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1054/2092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:24 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1324 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:24.978341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:24.978948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:24.997131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.997472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:24.998128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:24.999237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:24.999862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.000455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.189211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.194515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.204740 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d579f94-2cad-42dd-ac52-16891bbdd16d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.431099 Sep 03 20:56:25.209019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1039/2093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:24 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:25.221471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f61e6246-5cad-48c3-9c00-1f0b6fbd6e76 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1528 microversion: 2.1 time: 0.234729 Sep 03 20:56:25.225759 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1055/2094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:24 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:25.246957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:25.247711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:25.256451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.257131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.257684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.259886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.260539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.262515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.416843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.455327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-346acb88-61f5-41e3-9aa9-4a804ddc0b63 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1492 microversion: 2.1 time: 0.232255 Sep 03 20:56:25.459592 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1040/2095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:25 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1492 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:25.535373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6fb51b-5437-4e53-95fd-65a7f0e2e380", "name": "network-vif-deleted", "tag": "0991d8db-65f2-4cc2-896f-5f971c096d8f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:25.548235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.548970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.549653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.563783 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] Creating event network-vif-deleted:0991d8db-65f2-4cc2-896f-5f971c096d8f for instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 on nch1-master-1 Sep 03 20:56:25.569652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b86910f0-0d5c-4e43-a374-fa5bd736a900 req-dc9af500-1a05-4e32-8927-07f995ae7060 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Sep 03 20:56:25.570863 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1056/2096] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:25.591317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:25.592328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:25.606893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.607400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.607852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.610534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:25.611574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:25.613630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.614382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.617633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.622324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.622813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.627676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.638005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.639332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.640000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.819828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.832198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07647122-9fa5-411d-ad36-dbb1e29452b3 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.236313 Sep 03 20:56:25.846880 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1057/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:25 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:25.846880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:25.846880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:25.852558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.853081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.853639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.854479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:25.855056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:25.855756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:25.937121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.953999 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cae67050-ab23-4cdb-9a2e-1a914efde5a3 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1453 microversion: 2.1 time: 0.119380 Sep 03 20:56:25.962821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.974075 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1058/2098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:25 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:25.982233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.983834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:25.985222 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c0d1880-dcd8-4a68-8d14-b48019809b4d tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.397925 Sep 03 20:56:25.985811 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1041/2099] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:25 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:25.997031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:25.997912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.005356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.006438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.007059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.008122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.008577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.009023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.068255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.068751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.069329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.069720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lazy-loading 'fault' on Instance uuid b584970a-cead-49b8-9437-4b62c236be34 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:26.147127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:26.162151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b576079-e897-4a02-97d7-967e0fa88c88 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 200 len: 1324 microversion: 2.1 time: 0.169272 Sep 03 20:56:26.163304 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1059/2100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:25 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:26.239016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:26.245670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.253052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:26.253858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.257076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.257907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.258574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.259536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.260348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.261022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.271061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.271902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.272786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.276856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.279008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.280509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.649551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:26.664327 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25120d78-4f21-4d57-8174-ec280a064e63 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1528 microversion: 2.1 time: 0.413482 Sep 03 20:56:26.677151 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1060/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:26 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1528 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:26.685344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:26.685974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.699567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.699944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.700390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.701141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.701594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.702409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.740423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:26.748513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:26.752737 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d350bddf-ec4a-4498-b684-e3738628c46f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.520387 Sep 03 20:56:26.756140 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1042/2102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:26 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:26.819852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:26.837489 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d497f268-5e11-4fc5-8e6e-569a3fffcb97 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1363 microversion: 2.1 time: 0.169607 Sep 03 20:56:26.838603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1061/2103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:26 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:26.861162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:26.861771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.876212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353de8f3-3b8d-41dd-95fb-26f3e3e8562b", "name": "network-vif-unplugged", "status": "completed", "tag": "a974cd38-1ff2-4804-9165-31f634f47999"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:26.889466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.891409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.891942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.895000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.895484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.898349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.906453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.906958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.907419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.944487 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] Creating event network-vif-unplugged:a974cd38-1ff2-4804-9165-31f634f47999 for instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b on nch2-master-1 Sep 03 20:56:26.950057 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7ff465ba-8e5f-4097-9cd9-bd6593c0eefa req-acd96766-484e-46a8-a6c8-4d174941ee63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078709 Sep 03 20:56:26.954162 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1062/2104] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:26.982496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:26.983568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:26.993440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.995041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.995812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:26.997374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:26.998139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:26.998765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.050220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.051513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.052186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.053663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lazy-loading 'fault' on Instance uuid 353de8f3-3b8d-41dd-95fb-26f3e3e8562b {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:27.134201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9688dca94a841cfa29420ad780562cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17cee6ff91f4292b688b5cc63292039', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:27.145668 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67bccd44-73df-4317-b3a3-bca8523600d5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 200 len: 1298 microversion: 2.1 time: 0.169064 Sep 03 20:56:27.161813 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1063/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:26 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:27.168790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:27.169587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:27.201383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.202714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.205548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.206825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.207474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.208083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.393509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:27.402684 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1d29f79-40ad-4bbc-8d5e-65a0ac4d1407 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 0.546295 Sep 03 20:56:27.403511 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1043/2106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:26 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:27.417264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:27.417264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: b584970a-cead-49b8-9437-4b62c236be34] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:27.435753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.436525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.437185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.438182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.438877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.439674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.456663 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] HTTP exception thrown: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Request method failure captured: Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 HTTP/1.1 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE73wRScQLJllZx30-sX0Ox3aE2OS6ulqxndYY4K6YHU11nCc8NImlnJY8pJRToP6HAwKss9ho5K4U-_rt-Fohenh6PlQYaogVfr_4j1AqC_5k6w8CebWXqRSyQD8H6-b_7gziqX5TflISa3Ix-h0wb-_xXQqHVplYPvYdGGoSVNs-Sc Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:27.458603 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 90d7e4c2e577467f949be3dc480cc7a2 Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. Sep 03 20:56:27.460331 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b584970a-cead-49b8-9437-4b62c236be34'} Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:27.461669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. Sep 03 20:56:27.463179 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:27.465775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Returning 404 to user: Instance b584970a-cead-49b8-9437-4b62c236be34 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:27.465775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af1f31b9-8204-417e-ac63-4758b9caa1bb tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34" status: 404 len: 111 microversion: 2.1 time: 0.053753 Sep 03 20:56:27.465775 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1044/2107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:27 2022] GET /compute/v2.1/servers/b584970a-cead-49b8-9437-4b62c236be34 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:27.470971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dfabcea5-cdb5-404b-a24f-c51e841e0c77 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '.version_select at 0x7fae66842700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:27.494860 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dfabcea5-cdb5-404b-a24f-c51e841e0c77 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836234442" status: 202 len: 0 microversion: 2.1 time: 0.027979 Sep 03 20:56:27.495528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1045/2108] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 20:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836234442 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:27.603834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:27.613519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:27.618546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353de8f3-3b8d-41dd-95fb-26f3e3e8562b", "name": "network-vif-deleted", "tag": "a974cd38-1ff2-4804-9165-31f634f47999"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:27.620540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:27.622824 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d84c681-14c0-46cd-a5ec-934cc55562b9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.465792 Sep 03 20:56:27.623942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1064/2109] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:27 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:27.652536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.653440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.654090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.676419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] Creating event network-vif-deleted:a974cd38-1ff2-4804-9165-31f634f47999 for instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b on nch2-master-1 Sep 03 20:56:27.681785 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-34394657-e9f1-409d-855c-db2a77c18db1 req-164c907c-06e7-4b1f-b965-2eeaf290eb1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087342 Sep 03 20:56:27.682919 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1046/2110] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:27.699678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:27.700299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:27.710398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.711142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.711781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.712791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.713550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.714554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.781020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:27.782502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:27.797072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.800708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.802993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:27.804018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:27.805634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:27.807590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.108373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:28.130101 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aaee707a-a637-4aed-a09f-278be2111cc6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.354714 Sep 03 20:56:28.131015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1047/2111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:27 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:56:28.153274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.156152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.167581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.171499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.172140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.173149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.174467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.174979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.226607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.227190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.227728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.228245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lazy-loading 'fault' on Instance uuid 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:28.231071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:28.239553 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bbe905cf-9c9e-45e0-b84e-2eec26e9410f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1528 microversion: 2.1 time: 0.543843 Sep 03 20:56:28.240845 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1065/2112] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:27 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1528 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:28.246049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64032526-9ab3-4528-9b6a-a4a9d0d5f631", "name": "network-vif-unplugged", "status": "completed", "tag": "fb49300a-fe93-40a5-a740-b0e93324b179"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:28.257274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.258027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.261018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.279841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] Creating event network-vif-unplugged:fb49300a-fe93-40a5-a740-b0e93324b179 for instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 on nch2-master-1 Sep 03 20:56:28.286073 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cd704fe5-b0a3-48b0-b0a0-0273886b097d req-01226b7e-f2a0-4703-88a8-bfa711daffc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043822 Sep 03 20:56:28.287330 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1066/2113] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:28.303099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.304004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 353de8f3-3b8d-41dd-95fb-26f3e3e8562b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.307398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:28.311982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.312751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.313410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.314352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.315005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.315642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.319755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1e19754b-92f8-4d3d-82c8-e172b5a4f0ca tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 200 len: 1368 microversion: 2.1 time: 0.187404 Sep 03 20:56:28.320962 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1048/2114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:28 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:28.335750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b HTTP/1.1 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:28.338641 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. Sep 03 20:56:28.340429 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '353de8f3-3b8d-41dd-95fb-26f3e3e8562b'} Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:28.341713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. Sep 03 20:56:28.343747 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.346878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 353de8f3-3b8d-41dd-95fb-26f3e3e8562b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:28.347935 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7b71be5-c61b-4f68-8e6b-097cf8d82f16 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b" status: 404 len: 111 microversion: 2.1 time: 0.059110 Sep 03 20:56:28.352302 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1067/2115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:28 2022] GET /compute/v2.1/servers/353de8f3-3b8d-41dd-95fb-26f3e3e8562b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:28.358603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8daa4fdd-7efe-4ca1-92ce-21c6a8d9e140 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae669bee50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.400516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8daa4fdd-7efe-4ca1-92ce-21c6a8d9e140 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Image not found. Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8daa4fdd-7efe-4ca1-92ce-21c6a8d9e140 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 HTTP/1.1 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:28.403035 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '43280172-df4e-4f63-ae21-a4391eef9314'} Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:28.404737 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43280172-df4e-4f63-ae21-a4391eef9314 to delete Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.405916 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43280172-df4e-4f63-ae21-a4391eef9314 could not be found. Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:28.407530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:28.409643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.414136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8daa4fdd-7efe-4ca1-92ce-21c6a8d9e140 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:28.415232 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8daa4fdd-7efe-4ca1-92ce-21c6a8d9e140 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314" status: 404 len: 62 microversion: 2.1 time: 0.061486 Sep 03 20:56:28.416317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1068/2116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:28 2022] DELETE /compute/v2.1/images/43280172-df4e-4f63-ae21-a4391eef9314 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:28.431605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.433395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.441379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.441958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.442632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.443428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.444268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.444784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.462387 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b HTTP/1.1 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:28.464532 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.466320 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '0be9d083-663e-4b1d-b5ac-a180071ebc7b'} Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:28.468091 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.471502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.474604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:28.474604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-536ab34a-e433-4b10-acdb-de448e7acee5 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 404 len: 111 microversion: 2.1 time: 0.045103 Sep 03 20:56:28.474604 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1069/2117] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:28 2022] DELETE /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:28.474604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.474604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.479874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.480369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.481091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.482045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.483500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.484141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.515744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c0bd11b-531b-4fb9-b9ae-eac82f4019e5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae6b8ad4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1116938178", "description": "tempest-description-976620255"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:28.708686 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c0bd11b-531b-4fb9-b9ae-eac82f4019e5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.386458 Sep 03 20:56:28.709749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1049/2118] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:56:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:28.724998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.727027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0be9d083-663e-4b1d-b5ac-a180071ebc7b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.740758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.741501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.742238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.743188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.743655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.744100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.768001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b HTTP/1.1 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:28.769774 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.771407 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0be9d083-663e-4b1d-b5ac-a180071ebc7b'} Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:28.772254 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. Sep 03 20:56:28.773710 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:28.777532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 0be9d083-663e-4b1d-b5ac-a180071ebc7b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:28.777532 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c24adc8-8d18-47e3-847c-af5e011c6bab tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b" status: 404 len: 111 microversion: 2.1 time: 0.055692 Sep 03 20:56:28.777532 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1050/2119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:28 2022] GET /compute/v2.1/servers/0be9d083-663e-4b1d-b5ac-a180071ebc7b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:28.777532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:28.777532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:28.786773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.786773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.786773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.788066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:28.788463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:28.788927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:28.981980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.000296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.007320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.008880 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9118c0c1-39ff-45c9-a79f-1aafe4ffc7a6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.236191 Sep 03 20:56:29.009786 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1051/2120] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:28 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:29.015565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51d9face-6aee-49b4-a93a-dc965333631c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae66868f70>, body: {"security_group_rule": {"parent_group_id": "d168133b-32e7-4b2a-913a-1c8726f980f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:29.281223 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51d9face-6aee-49b4-a93a-dc965333631c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.269922 Sep 03 20:56:29.288516 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1052/2121] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:29.288516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f6b6f36-6c7b-4796-9169-456d8590b2df tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b75b940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.313252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7f6b6f36-6c7b-4796-9169-456d8590b2df tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Image not found. Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f6b6f36-6c7b-4796-9169-456d8590b2df tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 HTTP/1.1 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:29.315038 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '92158d11-4188-4f5c-bcf5-43727ee114a6'} Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:29.317239 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 92158d11-4188-4f5c-bcf5-43727ee114a6 to delete Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.318257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92158d11-4188-4f5c-bcf5-43727ee114a6 could not be found. Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:29.319706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f6b6f36-6c7b-4796-9169-456d8590b2df tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f6b6f36-6c7b-4796-9169-456d8590b2df tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6" status: 404 len: 62 microversion: 2.1 time: 0.033947 Sep 03 20:56:29.322453 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1053/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:29 2022] DELETE /compute/v2.1/images/92158d11-4188-4f5c-bcf5-43727ee114a6 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:29.324848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.324848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.334329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.334831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.335278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.336024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.336476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.337149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.466845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.487399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49647491-48ae-4101-8972-51023b05cf58 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1323 microversion: 2.1 time: 1.018387 Sep 03 20:56:29.494329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1070/2123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:28 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1323 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:29.508816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.509655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.518604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.521050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.521756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.522375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.523579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.524962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.525635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.570532 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-75aa654a-7638-4d5d-bdca-9941e657a51d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.251300 Sep 03 20:56:29.571132 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1054/2124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:29 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:29.581483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8bfda776-05b5-4dcd-b458-ff3948927386 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae6b75b8b0>, body: {"security_group_rule": {"parent_group_id": "d168133b-32e7-4b2a-913a-1c8726f980f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:29.649178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:29.664942 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef90c3fc-c76e-4abc-a600-5e276d72d607 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1310 microversion: 2.1 time: 0.167124 Sep 03 20:56:29.676924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1071/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:29 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1310 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:29.677827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.678669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.696492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.698401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.699083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.707501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.709266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.715208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.758440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8bfda776-05b5-4dcd-b458-ff3948927386 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 Sep 03 20:56:29.763410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd HTTP/1.1 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:29.766611 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.768130 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd'} Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:29.769687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.771316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.774247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:29.775308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58262a5c-1990-4319-8f9c-f28e1ba9150d tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 404 len: 111 microversion: 2.1 time: 0.108045 Sep 03 20:56:29.776376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1072/2126] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:29 2022] DELETE /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8bfda776-05b5-4dcd-b458-ff3948927386 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 138 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:29.776865 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: {"security_group_rule": {"parent_group_id": "d168133b-32e7-4b2a-913a-1c8726f980f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 03 20:56:29.778711 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: exception: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd168133b-32e7-4b2a-913a-1c8726f980f6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:29.779758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.781908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8bfda776-05b5-4dcd-b458-ff3948927386 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: This rule already exists in group d168133b-32e7-4b2a-913a-1c8726f980f6 {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:29.785401 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8bfda776-05b5-4dcd-b458-ff3948927386 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.208045 Sep 03 20:56:29.787171 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1055/2127] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:56:29.789170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.789978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 3d6fb51b-5437-4e53-95fd-65a7f0e2e380] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.797512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.798045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.798446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.799160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.799617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.800064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.809923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.812337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.816478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] HTTP exception thrown: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Request method failure captured: Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 HTTP/1.1 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74G-amNHT9k8uNN4nQQ_MFh_HnnOK0AneZEKZLSAUHQhhTex21DLI3f3DrmOLRiNWSDNtrOd2Cliip_JVzSshs0Vp8EItZ3jMk4PoVfOmmYc28bFWdXVFasNWN94P8yyYt3N6526WLpx3PDHJRi5_0pvWIZvl9-RLl0V9ATr_cVXqA Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:29.818261 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2e11c33c786746e5b3effedd32674582 Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. Sep 03 20:56:29.819986 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3d6fb51b-5437-4e53-95fd-65a7f0e2e380'} Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:29.820995 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. Sep 03 20:56:29.822610 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.825290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Returning 404 to user: Instance 3d6fb51b-5437-4e53-95fd-65a7f0e2e380 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:29.826556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eccebce5-38c2-4bef-a641-9bb9e7d7f560 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380" status: 404 len: 111 microversion: 2.1 time: 0.041910 Sep 03 20:56:29.827183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1073/2128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:29 2022] GET /compute/v2.1/servers/3d6fb51b-5437-4e53-95fd-65a7f0e2e380 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:29.836380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.837088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:29.843752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.844689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.845343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.846249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.846863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.847519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.851863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.854815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.855743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.858072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:29.859367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:29.860138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:29.867143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd HTTP/1.1 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:29.869891 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.871435 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd'} Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:29.872270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. Sep 03 20:56:29.876185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:29.885520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:29.885520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6947603-7976-4b72-b758-c6cd06fb9a3c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd" status: 404 len: 111 microversion: 2.1 time: 0.050429 Sep 03 20:56:29.885520 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1074/2129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:29 2022] GET /compute/v2.1/servers/478173e4-e4a0-4ec9-9b2b-fc6c88f39fdd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:29.888719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-794efbae-3798-4ee1-99dd-c3f1234232e4 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae669e6ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:29.927179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:30.039476 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6bfe24c9-d3ec-4e7e-8c62-750de7a94402 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 204 len: 0 microversion: 2.1 time: 0.250490 Sep 03 20:56:30.041614 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1056/2130] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:29 2022] DELETE /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:30.051513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd7bd777-3a74-45be-80ca-ca52f5b40b24 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '.version_select at 0x7fae6b75b550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.079775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd7bd777-3a74-45be-80ca-ca52f5b40b24 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096013485" status: 202 len: 0 microversion: 2.1 time: 0.036175 Sep 03 20:56:30.082314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1057/2131] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 20:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096013485 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:30.089516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c694f629-d601-43d0-bfd7-88d9127ffa2c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '.version_select at 0x7fae6b776a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.119849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c694f629-d601-43d0-bfd7-88d9127ffa2c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Image not found. Sep 03 20:56:30.124658 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-794efbae-3798-4ee1-99dd-c3f1234232e4 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/62bea180-0215-4375-ab92-659c4c5192ed" status: 202 len: 0 microversion: 2.1 time: 0.241185 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c694f629-d601-43d0-bfd7-88d9127ffa2c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 HTTP/1.1 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:30.129112 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '11ef4585-389e-4569-8cfa-7ce793b9b380'} Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:30.130698 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 11ef4585-389e-4569-8cfa-7ce793b9b380 to delete Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.131753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 11ef4585-389e-4569-8cfa-7ce793b9b380 could not be found. Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:30.133901 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:30.136887 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.138968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1075/2132] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Sep 3 20:56:29 2022] DELETE /compute/v2.1/os-security-group-rules/62bea180-0215-4375-ab92-659c4c5192ed => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:30.138968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.138968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.142897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c694f629-d601-43d0-bfd7-88d9127ffa2c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:30.144178 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c694f629-d601-43d0-bfd7-88d9127ffa2c tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380" status: 404 len: 62 microversion: 2.1 time: 0.060490 Sep 03 20:56:30.150152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.150806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.151439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.152935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.153430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.153957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.155348 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1058/2133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:30 2022] DELETE /compute/v2.1/images/11ef4585-389e-4569-8cfa-7ce793b9b380 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:30.163372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.164266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.173949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.175827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.177682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.178409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.182212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.182752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.190580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:30.363676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:30.382361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:30.383980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:30.385916 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf1de978-210f-4639-9d72-5bd407e90c54 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.252713 Sep 03 20:56:30.386639 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1076/2134] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:30 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:30.387185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:30.399951 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c305534-b5db-4ffd-b8b2-8c18e2aae94b tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1481 microversion: 2.1 time: 0.243003 Sep 03 20:56:30.401228 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1059/2135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:30 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1481 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:30.409192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.410286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.414494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-30fd8a10-0ff9-4ab9-851e-46c765b9526b tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669db0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1011620369", "description": "tempest-description-1575483458"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:30.425838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:30.434319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.435503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.436296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.437242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.437968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.438568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.469864 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d HTTP/1.1 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:30.472481 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.474328 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0dd89dac-67e7-4386-8d33-0ca58ab9c14d'} Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:30.475372 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.476847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.478291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:30.478291 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8450eb1-2c22-401b-8d79-80e14500fb59 tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 404 len: 111 microversion: 2.1 time: 0.071379 Sep 03 20:56:30.478291 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1060/2136] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:30 2022] DELETE /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:30.498261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea30a49-c252-47e8-9292-7a79cee5d453", "name": "network-vif-deleted", "tag": "26a44f0d-8341-40ef-8068-318e4d42331b"}, {"name": "network-changed", "server_uuid": "64032526-9ab3-4528-9b6a-a4a9d0d5f631", "tag": "fb49300a-fe93-40a5-a740-b0e93324b179"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:30.521850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.522687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.523146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.544686 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Creating event network-vif-deleted:26a44f0d-8341-40ef-8068-318e4d42331b for instance aea30a49-c252-47e8-9292-7a79cee5d453 on nch1-master-1 Sep 03 20:56:30.545576 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] Creating event network-changed:fb49300a-fe93-40a5-a740-b0e93324b179 for instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 on nch2-master-1 Sep 03 20:56:30.559586 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c10184db-aa97-4c79-8ebd-2e843e68edbe req-e7e2a84b-bdcb-4edd-8b25-b7e1221ea1ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081877 Sep 03 20:56:30.561200 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1061/2137] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:30.567217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.568541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] [instance: 0dd89dac-67e7-4386-8d33-0ca58ab9c14d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.580086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.580721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.581250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.582373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.583045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.586088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.604280 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] HTTP exception thrown: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Request method failure captured: Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d HTTP/1.1 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE758nx3esUcgXOs0ZCzbDCl32P3gEdXCDtzBdNdRCIi-kdd_o70dpEpQMlikkviWa12ZUVAUH4EEq_m0tnwT1RxfRcfYUh4asnaIPcSKIlgXKUd1NTxsCoT0F_BR_VCrTMnIziIzxyaeyviPrkhEJUWCDV3rNUWpEDSqSaUgYiDYAn0 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:30.605994 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f17cee6ff91f4292b688b5cc63292039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f17cee6ff91f4292b688b5cc63292039 Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesTestJSON-1086523514 Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d9688dca94a841cfa29420ad780562cd Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesTestJSON-1086523514-project Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.607524 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0dd89dac-67e7-4386-8d33-0ca58ab9c14d'} Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:30.608423 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. Sep 03 20:56:30.611283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:30.614677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] Returning 404 to user: Instance 0dd89dac-67e7-4386-8d33-0ca58ab9c14d could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:30.614677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c654757f-05d5-4ea5-a5f1-2bbeab2476af tempest-ImagesTestJSON-1086523514 tempest-ImagesTestJSON-1086523514-project] 10.222.0.16 "GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d" status: 404 len: 111 microversion: 2.1 time: 0.044947 Sep 03 20:56:30.614677 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1062/2138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:30 2022] GET /compute/v2.1/servers/0dd89dac-67e7-4386-8d33-0ca58ab9c14d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:30.616226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.617132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.623820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.624407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.624827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.625960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.626734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.627555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.831125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-30fd8a10-0ff9-4ab9-851e-46c765b9526b tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.442952 Sep 03 20:56:30.834402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1077/2139] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:56:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:30.839807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:30.841012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:30.861513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.862391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.863499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:30.864264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:30.864729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:30.865817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.016460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:31.032053 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc9b4438-f1f2-485e-a138-3c080f1b26df tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 200 len: 1519 microversion: 2.1 time: 0.414981 Sep 03 20:56:31.032053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1063/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:30 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:31.044970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:31.045608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:31.053217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.053717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.054157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.061864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.062378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.062829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.114758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.115263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.115706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.116169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lazy-loading 'fault' on Instance uuid aea30a49-c252-47e8-9292-7a79cee5d453 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:31.166764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:31.181707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c402ddf-0d8e-4fe3-82ab-b962f263b295 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.344309 Sep 03 20:56:31.182935 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1078/2141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:30 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:31.190936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ad18007-b0e7-463d-ab85-48e4ceb3a284 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae6b74a790>, body: {"security_group_rule": {"parent_group_id": "ecfda0e4-cd5b-4c54-a20c-42f9419527fc", "ip_protocol": "tcp", "from_port": 1321748968, "to_port": 22}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:31.258897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27be6827d30e48acac9a59786021f7bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6ee8212ab418cba7f718ce4bb4726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:31.270896 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-141ddfff-6b44-4035-bffd-ccc295f0c445 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 200 len: 1315 microversion: 2.1 time: 0.237674 Sep 03 20:56:31.272343 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1064/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:31 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:31.285686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.223"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:31.285686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:31.294742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.296857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.297511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.298369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.299710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.300412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.318300 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7ad18007-b0e7-463d-ab85-48e4ceb3a284 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Invalid port range 1321748968:22. Former value cannot be greater than the later Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ad18007-b0e7-463d-ab85-48e4ceb3a284 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 146 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:31.321572 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "ecfda0e4-cd5b-4c54-a20c-42f9419527fc", "ip_protocol": "tcp", "from_port": 1321748968, "to_port": 22}} Sep 03 20:56:31.323418 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid port range 1321748968:22. Former value cannot be greater than the later Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ecfda0e4-cd5b-4c54-a20c-42f9419527fc', 'ip_protocol': 'tcp', 'from_port': 1321748968, 'to_port': 22}}} Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1321748968:22. Former value cannot be greater than the later Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:31.324527 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1321748968:22. Former value cannot be greater than the later Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1321748968:22. Former value cannot be greater than the later Sep 03 20:56:31.326130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.327457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ad18007-b0e7-463d-ab85-48e4ceb3a284 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: Invalid port range 1321748968:22. Former value cannot be greater than the later {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:31.327457 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ad18007-b0e7-463d-ab85-48e4ceb3a284 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.138952 Sep 03 20:56:31.327457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1079/2143] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:56:31.333458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0d831a1-c010-474a-93ac-301cb3147ba6 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669e6670>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-902748690", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:31.335479 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c0d831a1-c010-474a-93ac-301cb3147ba6 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Security group id should be uuid Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0d831a1-c010-474a-93ac-301cb3147ba6 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 130 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:31.341192 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-902748690", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:31.342849 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group id should be uuid Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-902748690', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:31.344183 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0d831a1-c010-474a-93ac-301cb3147ba6 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: Security group id should be uuid {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:31.346097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c0d831a1-c010-474a-93ac-301cb3147ba6 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013872 Sep 03 20:56:31.347241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1080/2144] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:56:31.354187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08aba438-ec0c-4f4c-8809-551e0bf962ec tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669e65e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1782372057", "description": "tempest-description-309136866"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:31.358269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:56:31.366046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquired lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:56:31.749879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08aba438-ec0c-4f4c-8809-551e0bf962ec tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.400259 Sep 03 20:56:31.759004 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1081/2145] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:56:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:31.759004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:31.759004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:31.766900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.767759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.768467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:31.769521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:31.770217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:31.770884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.068573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:32.089720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:32.091523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:32.093225 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b195e83b-c997-434a-8e29-a63c597e6e92 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.341418 Sep 03 20:56:32.094448 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1082/2146] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:31 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:32.099893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:32.100517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:32.106628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.107129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.107577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.114546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.115051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.115863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.427705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:32.443506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a946d565-cbf6-40ee-a8e6-362298d11c89 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1481 microversion: 2.1 time: 0.347460 Sep 03 20:56:32.476356 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1083/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:32 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1481 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:32.484210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-655718a2-d68e-477d-8644-f3af4023f4ae tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669d0280>, body: {"security_group_rule": {"parent_group_id": "7f88ac31-aea9-43ce-8ced-7854a2c20349", "ip_protocol": "tempest-999-911757013", "from_port": 22, "to_port": 22}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:32.599450 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-655718a2-d68e-477d-8644-f3af4023f4ae tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Invalid IP protocol tempest-999-911757013. Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-655718a2-d68e-477d-8644-f3af4023f4ae tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 156 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:32.601850 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "7f88ac31-aea9-43ce-8ced-7854a2c20349", "ip_protocol": "tempest-999-911757013", "from_port": 22, "to_port": 22}} Sep 03 20:56:32.603426 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid IP protocol tempest-999-911757013. Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7f88ac31-aea9-43ce-8ced-7854a2c20349', 'ip_protocol': 'tempest-999-911757013', 'from_port': 22, 'to_port': 22}}} Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-911757013. Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:32.604264 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-911757013. Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-911757013. Sep 03 20:56:32.605798 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:32.616458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-655718a2-d68e-477d-8644-f3af4023f4ae tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: Invalid IP protocol tempest-999-911757013. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:32.617814 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-655718a2-d68e-477d-8644-f3af4023f4ae tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.139332 Sep 03 20:56:32.618491 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1084/2148] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:32 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:56:32.634195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:32.635010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:32.651225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:32.653709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.655324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.656023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.657020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.657697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.658934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.963828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:32.974100 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c67ec673-f626-4e19-a1f1-2213a36d7388 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.351772 Sep 03 20:56:32.975142 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1085/2149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:32 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:32.980464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:32.981544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: aea30a49-c252-47e8-9292-7a79cee5d453] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:32.987708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.988453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.988952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:32.989880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:32.990551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:32.991191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:33.008002 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 HTTP/1.1 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:33.010239 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. Sep 03 20:56:33.012639 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'aea30a49-c252-47e8-9292-7a79cee5d453'} Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:33.013729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. Sep 03 20:56:33.016446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.018539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance aea30a49-c252-47e8-9292-7a79cee5d453 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:33.018539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb45e864-8e15-4104-8711-593054a2cbe1 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453" status: 404 len: 111 microversion: 2.1 time: 0.035490 Sep 03 20:56:33.018539 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1086/2150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:32 2022] GET /compute/v2.1/servers/aea30a49-c252-47e8-9292-7a79cee5d453 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:33.020728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:33.021350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:33.028872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:33.029465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:33.030012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:33.031522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:33.032459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:33.033478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:33.063272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:33.171143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99843449-a32c-4481-ae59-c672920aca4e tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 204 len: 0 microversion: 2.1 time: 0.156982 Sep 03 20:56:33.173403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1087/2151] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:33 2022] DELETE /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:33.180815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4df80f4e-f723-4590-b37e-06d615d853b9 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669d0a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1949028204", "description": "tempest-description-1096638176"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:33.354848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:33.642271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4df80f4e-f723-4590-b37e-06d615d853b9 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.466812 Sep 03 20:56:33.643079 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1088/2152] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:56:33 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:33.647890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6541c63-66bd-42fe-bc1c-b2018a27064f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae66a04f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:33.673803 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d6541c63-66bd-42fe-bc1c-b2018a27064f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Image not found. Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6541c63-66bd-42fe-bc1c-b2018a27064f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c HTTP/1.1 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:33.676218 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'bdf3e28a-4b26-46a2-ae6d-ab897194091c'} Sep 03 20:56:33.677971 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bdf3e28a-4b26-46a2-ae6d-ab897194091c to delete Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:33.682107 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bdf3e28a-4b26-46a2-ae6d-ab897194091c could not be found. Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:33.684187 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6541c63-66bd-42fe-bc1c-b2018a27064f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:33.688046 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d6541c63-66bd-42fe-bc1c-b2018a27064f tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c" status: 404 len: 62 microversion: 2.1 time: 0.033407 Sep 03 20:56:33.692028 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1089/2153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:33 2022] DELETE /compute/v2.1/images/bdf3e28a-4b26-46a2-ae6d-ab897194091c => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:33.696390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:33.697994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:33.708990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:33.710021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:33.710468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:33.711194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:33.712250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:33.712692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:33.735555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:33.982852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Updating instance_info_cache with network_info: [{"id": "6a8229ff-11de-475b-bab0-bd7fc2f10daa", "address": "fa:16:3e:c3:ff:19", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a8229ff-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:34.016875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Releasing lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:56:34.018895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-52a39fc3-984a-4bf2-a152-68680cae119f tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action" status: 202 len: 0 microversion: 2.1 time: 2.744602 Sep 03 20:56:34.022273 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1065/2154] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:31 2022] POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action => generated 0 bytes in 2749 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:56:34.032762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:34.034030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:34.045759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.046736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.048699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.049714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.050933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.051581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.185647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:34.198842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:34.200418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:34.201653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d948c08-0fb8-400d-a561-7aa07fa67cd2 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.522259 Sep 03 20:56:34.204426 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1090/2155] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:33 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:34.213904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:34.237946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.239436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.246909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.259851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:34.268530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ed9c230-d22d-4a82-babd-e950b8b6e186 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1469 microversion: 2.1 time: 0.239887 Sep 03 20:56:34.269942 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1066/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:34 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1469 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:34.274888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:34.275820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:34.278444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] Creating event network-changed:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:56:34.283550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.284319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.285012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.286333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.287025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.287695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.288443 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9e3e7987-fcd2-46b9-9be2-5b760e79021f req-43e08345-d2f5-44f8-b8ed-a61c53b27fb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079562 Sep 03 20:56:34.289072 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1091/2157] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:34.299221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4407654-40eb-4583-be4b-606a3ab647c5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669d0280>, body: {"security_group_rule": {"parent_group_id": "1c829f41-54f7-4d89-8f6c-8fbb63d9b098", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:34.398637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:34.414668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d61bd5a8-1478-4684-8d49-f159325bdbd5 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 200 len: 1280 microversion: 2.1 time: 0.142715 Sep 03 20:56:34.415846 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1067/2158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:34 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:34.420591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:34.421131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:34.430859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.431495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.433821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.437110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.440990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a4407654-40eb-4583-be4b-606a3ab647c5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 03 20:56:34.442841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4407654-40eb-4583-be4b-606a3ab647c5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 138 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:34.443077 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "1c829f41-54f7-4d89-8f6c-8fbb63d9b098", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 03 20:56:34.444883 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1c829f41-54f7-4d89-8f6c-8fbb63d9b098', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:34.445768 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 03 20:56:34.447799 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.450230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.451345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4407654-40eb-4583-be4b-606a3ab647c5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:34.452461 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a4407654-40eb-4583-be4b-606a3ab647c5 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.162102 Sep 03 20:56:34.453091 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1092/2159] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:56:34.465929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:34.480291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:34.490438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 HTTP/1.1 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:34.493595 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:34.495569 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '097bd701-2414-46b1-bcff-a353121be860'} Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:34.496652 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:34.499346 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:34.505261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:34.510779 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0edbe425-1aa8-44e3-96b9-438fd76b0a83 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 404 len: 111 microversion: 2.1 time: 0.093659 Sep 03 20:56:34.514278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1068/2160] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:34 2022] DELETE /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:34.521361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.521858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.522303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.523033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.523648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.524093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.562798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.223"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:34.567219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:34.575586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.580135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.581010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.582176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:34.582900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:34.583941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:34.652730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:56:34.653881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquired lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:56:35.381614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:35.397097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3c44b909-5094-4fe1-a235-9e554a8d7e4d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1523 microversion: 2.1 time: 0.942433 Sep 03 20:56:35.405385 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1093/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:34 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1523 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:35.419294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9709dc-96f2-4f5b-a2bf-0d650631ccee", "name": "network-vif-deleted", "tag": "2c393c94-4352-403b-b4e0-98e4a866bdd6"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:35.442466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:35.444787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:35.445992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:35.487193 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] Creating event network-vif-deleted:2c393c94-4352-403b-b4e0-98e4a866bdd6 for instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee on nch1-master-1 Sep 03 20:56:35.500761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6274daf7-699a-4c9d-8230-b5431a25b7e2 req-3933db1c-7c4f-444e-9ef3-4cf59948df0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093878 Sep 03 20:56:35.504406 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1094/2162] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:35.517203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a8c27dd-ee8d-4376-90e2-c89657a5695e tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669a3430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1665333859", "description": "tempest-description-1418076087"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:36.008995 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a8c27dd-ee8d-4376-90e2-c89657a5695e tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.501607 Sep 03 20:56:36.009982 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1095/2163] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:56:35 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:36.017667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.021483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: 097bd701-2414-46b1-bcff-a353121be860] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:36.039480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.040391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.041135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.042584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.044473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.045642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.072470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 HTTP/1.1 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:36.076014 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:36.077747 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '097bd701-2414-46b1-bcff-a353121be860'} Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:36.078646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. Sep 03 20:56:36.080350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.089270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance 097bd701-2414-46b1-bcff-a353121be860 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:36.092305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce5748ee-fbcf-4512-b7c8-3b40e76b6647 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860" status: 404 len: 111 microversion: 2.1 time: 0.080326 Sep 03 20:56:36.100480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1096/2164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:36 2022] GET /compute/v2.1/servers/097bd701-2414-46b1-bcff-a353121be860 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:36.105677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.106295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:36.115960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.116470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.117524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.125509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.126392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.127036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.488748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:36.501082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:36.502563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:36.504373 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e1d77cf-74ff-447d-ab2d-2d20e6b3ad78 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.402825 Sep 03 20:56:36.521854 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1097/2165] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:36 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:36.521854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.521854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:36.521854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.521854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.522987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.522987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.522987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.522987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.611090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:36.622882 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd941268-6f8b-4571-9206-31ab16bafcd9 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 200 len: 1298 microversion: 2.1 time: 0.115911 Sep 03 20:56:36.633480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1098/2166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:36 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:36.645679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.646311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 9c9709dc-96f2-4f5b-a2bf-0d650631ccee] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:36.654587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.655108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.656414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.657321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:36.658194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:36.658715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:36.689953 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] HTTP exception thrown: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Request method failure captured: Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee HTTP/1.1 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73wRScQLJllZx30-sX0Ox3aE2OS6ulqxndYY4K6YHU11nCc8NImlnJY8pJRToP6HAwKss9ho5K4U-_rt-Fohenh6PlQYaogVfr_4j1AqC_5k6w8CebWXqRSyQD8H6-b_7gziqX5TflISa3Ix-h0wb-_xXQqHVplYPvYdGGoSVNs-Sc Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:36.709797 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 90d7e4c2e577467f949be3dc480cc7a2 Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. Sep 03 20:56:36.711883 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9c9709dc-96f2-4f5b-a2bf-0d650631ccee'} Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:36.713000 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. Sep 03 20:56:36.715421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.718188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Returning 404 to user: Instance 9c9709dc-96f2-4f5b-a2bf-0d650631ccee could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:36.718188 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ed66df2-1049-4b4b-9ce2-5ce86234358f tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee" status: 404 len: 111 microversion: 2.1 time: 0.076932 Sep 03 20:56:36.718188 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1099/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:36 2022] GET /compute/v2.1/servers/9c9709dc-96f2-4f5b-a2bf-0d650631ccee => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:36.738066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44263767-49ac-4f2e-8e30-46d34b2b2100 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae66a04430>, body: {"security_group_rule": {"parent_group_id": "663ab50f-0b9f-4137-9eaf-07efc6199be2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1685661422}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:36.907086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-44263767-49ac-4f2e-8e30-46d34b2b2100 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44263767-49ac-4f2e-8e30-46d34b2b2100 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 146 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:36.909988 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "663ab50f-0b9f-4137-9eaf-07efc6199be2", "ip_protocol": "tcp", "from_port": 22, "to_port": 1685661422}} Sep 03 20:56:36.911906 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': '663ab50f-0b9f-4137-9eaf-07efc6199be2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1685661422}}} Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.912951 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 Sep 03 20:56:36.914666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:36.916240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44263767-49ac-4f2e-8e30-46d34b2b2100 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 400 to user: Invalid port range 22:1685661422. Valid TCP ports should be between 1-65535 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:36.916240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-44263767-49ac-4f2e-8e30-46d34b2b2100 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.191108 Sep 03 20:56:36.916240 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1100/2168] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:36 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:56:36.921437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eee8456c-489d-480f-be16-e91160875a3b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae669e65e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.961810 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eee8456c-489d-480f-be16-e91160875a3b tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629463894" status: 202 len: 0 microversion: 2.1 time: 0.048163 Sep 03 20:56:36.962651 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1101/2169] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 20:56:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629463894 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:36.986052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:36.987961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:37.002551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.003720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.005184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:37.008371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.010557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.011189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:37.370008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:37.381270 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc7e70c1-e1c0-4ddf-be38-611f15eba6ec tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1503 microversion: 2.1 time: 0.417216 Sep 03 20:56:37.382102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1102/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:36 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:37.388100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:37.396695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:37.410709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.417625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.418088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:37.418843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.419306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.419796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:37.484118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:37.678919 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7118bdb-b941-449c-948a-bf5ca4e69737 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "DELETE /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 204 len: 0 microversion: 2.1 time: 0.295249 Sep 03 20:56:37.683345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1103/2171] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:37 2022] DELETE /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:37.692160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Action: 'create', calling method: .version_select at 0x7fae669db0d0>, body: {"security_group_rule": {"parent_group_id": "87504a76-3f6b-41eb-8d2a-d88b23a8508d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:37.758382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:56:37.759025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Neutron security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:56:37.759734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.759734 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 138 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:37.762632 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: {"security_group_rule": {"parent_group_id": "87504a76-3f6b-41eb-8d2a-d88b23a8508d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 03 20:56:37.765496 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'security_group_rule': {'parent_group_id': '87504a76-3f6b-41eb-8d2a-d88b23a8508d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:56:37.767125 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 03 20:56:37.770249 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.772586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 404 to user: Security group 87504a76-3f6b-41eb-8d2a-d88b23a8508d does not exist Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d6a9d86d-1881-470f-8e59-f67b7b497a87'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:37.778636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-120b3334-0a72-423e-9e16-d108db579b4c tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.080246 Sep 03 20:56:37.780504 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1104/2172] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:56:37 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:37.782015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:37.782957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:37.817922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.818498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.818953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:37.819681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:37.820146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:37.820580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:38.368858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:38.377139 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d614fb78-e441-42cb-a988-06b3965e8a00 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1516 microversion: 2.1 time: 0.609773 Sep 03 20:56:38.381504 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1105/2173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:37 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1516 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:38.391561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:38.392317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:38.412428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:38.413345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:38.415857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:38.416693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:38.419568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:38.419735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:38.756517 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.neutron [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] re-assign floating IP 172.35.4.223 from instance 14a647f4-afcb-46cc-8329-e0357a84f408 Sep 03 20:56:38.859843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:39.060352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:39.071530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:39.073493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:39.074919 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7aa37c8a-a65f-4dc8-b5ed-c91d8e3beb70 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.692132 Sep 03 20:56:39.075666 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1106/2174] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:38 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:39.080374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e53a8-9704-4324-a827-f4a61772e4bd", "name": "network-vif-deleted", "tag": "5f6861e3-5d7a-4415-8ee7-5d545a68941d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:39.092394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:39.093952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:39.094579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:39.110055 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] Creating event network-vif-deleted:5f6861e3-5d7a-4415-8ee7-5d545a68941d for instance 6f1e53a8-9704-4324-a827-f4a61772e4bd on nch2-master-1 Sep 03 20:56:39.126806 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6d8d9c46-edc4-4d5b-8121-dea615ef3a67 req-fc461a70-c534-4bc1-900f-63edf314ebe5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049580 Sep 03 20:56:39.128857 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1107/2175] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:39.142422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:39.143173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: 6f1e53a8-9704-4324-a827-f4a61772e4bd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:39.150085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:39.150652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:39.151395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:39.152317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:39.152960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:39.153551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:39.169649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] HTTP exception thrown: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Request method failure captured: Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd HTTP/1.1 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74G-amNHT9k8uNN4nQQ_MFh_HnnOK0AneZEKZLSAUHQhhTex21DLI3f3DrmOLRiNWSDNtrOd2Cliip_JVzSshs0Vp8EItZ3jMk4PoVfOmmYc28bFWdXVFasNWN94P8yyYt3N6526WLpx3PDHJRi5_0pvWIZvl9-RLl0V9ATr_cVXqA Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:39.171580 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2e11c33c786746e5b3effedd32674582 Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. Sep 03 20:56:39.173280 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6f1e53a8-9704-4324-a827-f4a61772e4bd'} Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:39.174214 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. Sep 03 20:56:39.176751 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:39.180208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Returning 404 to user: Instance 6f1e53a8-9704-4324-a827-f4a61772e4bd could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:39.181342 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a83c4288-778c-4028-994e-d9a3dd28967d tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd" status: 404 len: 111 microversion: 2.1 time: 0.043316 Sep 03 20:56:39.182420 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1108/2176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:39 2022] GET /compute/v2.1/servers/6f1e53a8-9704-4324-a827-f4a61772e4bd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:39.193177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:39.194350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:39.202483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:39.203344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:39.204055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:39.205095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:39.205801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:39.206479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:39.984362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d7e4c2e577467f949be3dc480cc7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7e10b9d8594d16a4c1eb63196ea329', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:39.990418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Updating instance_info_cache with network_info: [{"id": "6a8229ff-11de-475b-bab0-bd7fc2f10daa", "address": "fa:16:3e:c3:ff:19", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a8229ff-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:39.996792 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af1a9073-ea17-4dc1-b15f-a8daa7a8f327 tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 200 len: 1497 microversion: 2.1 time: 0.811781 Sep 03 20:56:39.999865 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1109/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:39 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 1497 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:40.014067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:40.021226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae669d0670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:40.094538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:56:40.095304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Neutron security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa not found {{(pid=140520) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 03 20:56:40.096047 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] HTTP exception thrown: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.096047 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Request method failure captured: Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-security-group-rules/dc06825a-67e5-4a61-bf37-ccf34679afaa HTTP/1.1 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE798b6BqsIaUOghunTk1ioek7727Nsg0abPSCCuAHO0g4JBlqXA3nMsoKv1x1JpohO8mij0ooZc_TFzAg95zbr1enDE1PgNrbgMar8p6tQ0wXLW-iHEvJQy_GNQitosADfKm60kqjAkthXI0F6kM3hjNtVhqtA-T8L5xcXMK3OCMDMQ Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:40.100085 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_725b1b6cb58b449283c1ca003588e248"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/725b1b6cb58b449283c1ca003588e248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 725b1b6cb58b449283c1ca003588e248 Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741 Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c8a88f53cc78444299e4c462e004edf9 Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-80418741-project Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.101694 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'dc06825a-67e5-4a61-bf37-ccf34679afaa'} Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:40.103097 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 03 20:56:40.104449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.108254 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Returning 404 to user: Security group rule dc06825a-67e5-4a61-bf37-ccf34679afaa does not exist Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-760a767e-e0ec-44aa-be9e-4d6e13ec78c4'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4127c902-cb91-4b22-b183-d2be4104fc89 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/dc06825a-67e5-4a61-bf37-ccf34679afaa" status: 404 len: 199 microversion: 2.1 time: 0.107117 Sep 03 20:56:40.115247 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1110/2178] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Sep 3 20:56:40 2022] DELETE /compute/v2.1/os-security-group-rules/dc06825a-67e5-4a61-bf37-ccf34679afaa => generated 199 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:40.143427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:40.149226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: dfeba8da-2c4d-4901-8667-fb1fc95b1d24] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:40.176370 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/dfeba8da-2c4d-4901-8667-fb1fc95b1d24/action HTTP/1.1 Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 14 Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:40.190429 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: {"rescue": {}} Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:40.193836 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'dfeba8da-2c4d-4901-8667-fb1fc95b1d24', 'body': {'rescue': {}}} Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:40.194854 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. Sep 03 20:56:40.196343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.201704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 404 to user: Instance dfeba8da-2c4d-4901-8667-fb1fc95b1d24 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:40.202617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d22207dc-b1c3-4946-9c3f-0ec346ba07a4 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/dfeba8da-2c4d-4901-8667-fb1fc95b1d24/action" status: 404 len: 111 microversion: 2.1 time: 0.086795 Sep 03 20:56:40.203221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1111/2179] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:40 2022] POST /compute/v2.1/servers/dfeba8da-2c4d-4901-8667-fb1fc95b1d24/action => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:40.218238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:40.235351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:40.236228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:40.236963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:40.252273 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] Creating event network-changed:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:56:40.265997 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-89c4e04a-9c18-4084-83c0-58846e603b00 req-236a0645-f40f-437e-b88c-ce72bbc4cbf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060587 Sep 03 20:56:40.267353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1112/2180] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:40.293335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:40.294337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:40.309780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:40.311104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:40.311659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:40.314598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:40.315231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:40.319350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:40.380131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:40.551784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23e7aae8-e47b-4078-9748-ba50fc639eeb tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 204 len: 0 microversion: 2.1 time: 0.268926 Sep 03 20:56:40.556543 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1113/2181] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:40 2022] DELETE /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:40.570924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5de89782-856d-40e6-a537-b6b6c84b9913 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '.version_select at 0x7fae669a3550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:40.613393 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-5de89782-856d-40e6-a537-b6b6c84b9913 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Image not found. Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5de89782-856d-40e6-a537-b6b6c84b9913 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/38b512aa-b9ba-4820-bfde-2ba0a7b9e847 HTTP/1.1 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:40.616356 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '38b512aa-b9ba-4820-bfde-2ba0a7b9e847'} Sep 03 20:56:40.618443 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 38b512aa-b9ba-4820-bfde-2ba0a7b9e847 to delete Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.619607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 38b512aa-b9ba-4820-bfde-2ba0a7b9e847 could not be found. Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:40.621360 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5de89782-856d-40e6-a537-b6b6c84b9913 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:40.623955 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5de89782-856d-40e6-a537-b6b6c84b9913 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/images/38b512aa-b9ba-4820-bfde-2ba0a7b9e847" status: 404 len: 62 microversion: 2.1 time: 0.059740 Sep 03 20:56:40.626079 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1114/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:40 2022] DELETE /compute/v2.1/images/38b512aa-b9ba-4820-bfde-2ba0a7b9e847 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:40.633162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:40.635492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:40.650522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:40.656879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:40.657737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:40.659262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:40.659985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:40.660650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:41.124592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:41.135624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:41.138880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:41.140424 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7346de7-980b-459f-939a-e1cf3bd5ea9b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1486 microversion: 2.25 time: 0.521028 Sep 03 20:56:41.157951 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1115/2183] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:40 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1486 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:41.169436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57c9604a-7267-4ad7-9153-b8e6682fb6f8 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae66a04ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:41.821664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Updating instance_info_cache with network_info: [{"id": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a", "address": "fa:16:3e:60:34:34", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5ae7b9c4-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:41.844573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Releasing lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:56:41.847941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce2fefa6-0a27-4231-9547-bb3f58ab85ea tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456/action" status: 202 len: 0 microversion: 2.1 time: 7.331430 Sep 03 20:56:41.851909 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1069/2184] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:34 2022] POST /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456/action => generated 0 bytes in 7335 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:56:41.868926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:41.869925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:41.884405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:41.885661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:41.887143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:41.888099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:41.888850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:41.889615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:41.934823 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57c9604a-7267-4ad7-9153-b8e6682fb6f8 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/663ab50f-0b9f-4137-9eaf-07efc6199be2" status: 202 len: 0 microversion: 2.1 time: 0.774469 Sep 03 20:56:41.936713 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1116/2185] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:56:41 2022] DELETE /compute/v2.1/os-security-groups/663ab50f-0b9f-4137-9eaf-07efc6199be2 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:41.947169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:41.949922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:41.973760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:41.974378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:41.976676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:41.978759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:41.979668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:41.983389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.060221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:42.079102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8be0d86c-7caf-4515-8da3-58caf9973b92 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action" status: 202 len: 0 microversion: 2.1 time: 0.219629 Sep 03 20:56:42.080349 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1070/2186] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:41 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:42.113740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:42.115002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:42.155775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.156682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.157425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.158579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.160379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.161416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.187320 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 HTTP/1.1 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:42.193350 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:42.194995 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7'} Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:42.195879 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:42.200800 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.204457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:42.204457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b89a5a0d-9a96-4686-aa8b-034c3b3ef198 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 404 len: 111 microversion: 2.1 time: 0.114968 Sep 03 20:56:42.204457 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1071/2187] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:42 2022] DELETE /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:42.423078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e11c33c786746e5b3effedd32674582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96ec8c49f384e7d81244fd2476d0496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:42.434226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-813e837b-faed-4895-86d7-034c7b559000 tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 200 len: 1468 microversion: 2.1 time: 0.495529 Sep 03 20:56:42.435062 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1117/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:41 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 1468 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:42.437384 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3460738b-a681-4d69-b1b2-d043af7f50c5 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.238186 Sep 03 20:56:42.437973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1072/2189] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Sep 3 20:56:42 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 20:56:42.440341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:42.442149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] [instance: 47403d55-33e7-4317-975b-70d426624b25] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:42.445915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47403d55-33e7-4317-975b-70d426624b25", "name": "network-vif-deleted", "tag": "27f9de8c-c701-4f5e-af87-e4db6a17edf5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:42.451720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.452373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.453280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.454818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.454818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.455201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.457759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.458251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.458691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.472421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] Creating event network-vif-deleted:27f9de8c-c701-4f5e-af87-e4db6a17edf5 for instance 47403d55-33e7-4317-975b-70d426624b25 on nch1-master-1 Sep 03 20:56:42.474161 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] HTTP exception thrown: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Request method failure captured: Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 HTTP/1.1 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE73wRScQLJllZx30-sX0Ox3aE2OS6ulqxndYY4K6YHU11nCc8NImlnJY8pJRToP6HAwKss9ho5K4U-_rt-Fohenh6PlQYaogVfr_4j1AqC_5k6w8CebWXqRSyQD8H6-b_7gziqX5TflISa3Ix-h0wb-_xXQqHVplYPvYdGGoSVNs-Sc Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:42.475703 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a7e10b9d8594d16a4c1eb63196ea329"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6a7e10b9d8594d16a4c1eb63196ea329 Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveMigrationTest-2111888872 Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 90d7e4c2e577467f949be3dc480cc7a2 Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveMigrationTest-2111888872-project Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. Sep 03 20:56:42.477662 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '47403d55-33e7-4317-975b-70d426624b25'} Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:42.478589 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. Sep 03 20:56:42.481412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:42.485087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] Returning 404 to user: Instance 47403d55-33e7-4317-975b-70d426624b25 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:42.485087 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9abe94a8-01d6-40b4-a3fb-ca59a102faff tempest-LiveMigrationTest-2111888872 tempest-LiveMigrationTest-2111888872-project] 10.222.0.16 "GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25" status: 404 len: 111 microversion: 2.1 time: 0.041088 Sep 03 20:56:42.485087 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1118/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:42 2022] GET /compute/v2.1/servers/47403d55-33e7-4317-975b-70d426624b25 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:42.485577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4c7b074b-8b5d-439d-919e-ea4e055dc33d req-967030bb-2275-4745-b1d9-113e356812af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Sep 03 20:56:42.485577 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1073/2191] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:42.486900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32c59384-a394-4810-9327-b819662a3d94 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae66868f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:42.493843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.223"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:42.728306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:42.735220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.736037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.737026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.741599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.742315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.743161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.745757 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32c59384-a394-4810-9327-b819662a3d94 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1c829f41-54f7-4d89-8f6c-8fbb63d9b098" status: 202 len: 0 microversion: 2.1 time: 0.265264 Sep 03 20:56:42.749295 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1074/2192] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:56:42 2022] DELETE /compute/v2.1/os-security-groups/1c829f41-54f7-4d89-8f6c-8fbb63d9b098 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:42.755140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:42.756116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:42.790598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.798041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.798649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:42.801075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:42.801846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:42.802366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.051276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:43.064595 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8bb736d-f6fe-4db5-89f5-e0cf7c57b626 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1501 microversion: 2.1 time: 0.316669 Sep 03 20:56:43.066798 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1075/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:42 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1501 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:43.072909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:43.073619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:43.087975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.088935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.090405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.091370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.092058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.092719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.180346 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] HTTP exception thrown: Floating IP 172.35.4.223 is not associated with instance 14a647f4-afcb-46cc-8329-e0357a84f408. Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Request method failure captured: Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action HTTP/1.1 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 49 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE79CzYe4RCM5Ak0ksjPcQYCPegMOA_B9_JL3oW1lAcbEvxdol9ugCqhsX9SUwWK9KY3pATbZLUPlRzcDGboaCcI-FkCSN7W2dnKkAQJq0IilrL19kwVnj0pLFDWuTIUgSPJ-2vf5Kh8Taxv-eGEqBTmwH8FnQP5rzaW6YoR9X6sk3OQ Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:43.181794 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9897f3d9893426f9fba83c8db250799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f4d78b7738644ff38eb239daec52d641 Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: {"removeFloatingIp": {"address": "172.35.4.223"}} Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:43.183420 ncdv-master-1 devstack@n-api.service[140520]: exception: Floating IP 172.35.4.223 is not associated with instance 14a647f4-afcb-46cc-8329-e0357a84f408. Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '14a647f4-afcb-46cc-8329-e0357a84f408', 'body': {'removeFloatingIp': {'address': '172.35.4.223'}}} Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.223 is not associated with instance 14a647f4-afcb-46cc-8329-e0357a84f408. Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.184475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.223 is not associated with instance 14a647f4-afcb-46cc-8329-e0357a84f408. Sep 03 20:56:43.185912 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.187648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Returning 409 to user: Floating IP 172.35.4.223 is not associated with instance 14a647f4-afcb-46cc-8329-e0357a84f408. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:43.188737 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-316d9c47-f06a-4ea8-aafe-0ecaba44d029 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action" status: 409 len: 146 microversion: 2.1 time: 0.705442 Sep 03 20:56:43.189346 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1119/2194] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:42 2022] POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action => generated 146 bytes in 711 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:43.194849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:43.195523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] [instance: b73e36a8-4981-4140-a12e-274a9bd217a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:43.202411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.203258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.203755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.205037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.205583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.206653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.228999 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] HTTP exception thrown: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Request method failure captured: Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 HTTP/1.1 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE770yGfp4-p56u8RTBw4jmOvIdBNMVl8AIzrxH7VHLvX_d4jqH8IFWusvW90vZGn9WQQhzDH-pTOfHjDHYZb6GbKNKOa0GBuTXcunuxJuBACvlz2_Dqeom-j_bJu6gN8OiXgkmjzGvd_ZYomKQQx3BRTh3zBtcmKCaZQm97G0prPqe4 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:43.230569 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad6ee8212ab418cba7f718ce4bb4726"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: dad6ee8212ab418cba7f718ce4bb4726 Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-538015666 Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27be6827d30e48acac9a59786021f7bb Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-538015666-project Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:43.232440 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b73e36a8-4981-4140-a12e-274a9bd217a7'} Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:43.233362 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. Sep 03 20:56:43.236372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.240345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] Returning 404 to user: Instance b73e36a8-4981-4140-a12e-274a9bd217a7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:43.240345 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d836f9bd-0fb3-415c-be0b-ec1dcab0cad0 tempest-ImagesOneServerNegativeTestJSON-538015666 tempest-ImagesOneServerNegativeTestJSON-538015666-project] 10.222.0.16 "GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7" status: 404 len: 111 microversion: 2.1 time: 0.041429 Sep 03 20:56:43.240345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1120/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:43 2022] GET /compute/v2.1/servers/b73e36a8-4981-4140-a12e-274a9bd217a7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:43.243307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fe43ee-b5a6-43d1-bbfe-02e3034dc456", "tag": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a"}, {"server_uuid": "dc18fd6b-0212-4fc9-b052-801fa575c4d4", "name": "network-vif-deleted", "tag": "f1a7b04d-2e29-4b95-9378-d4836af9c419"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:43.263229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.264358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.265211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.272053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:43.280992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:43.282245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Creating event network-changed:5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a for instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 on nch1-master-1 Sep 03 20:56:43.283080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:43.283317 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] Creating event network-vif-deleted:f1a7b04d-2e29-4b95-9378-d4836af9c419 for instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 on nch2-master-1 Sep 03 20:56:43.284790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d56c8fb-6e1e-44e6-bbca-7785464788c9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1476 microversion: 2.25 time: 0.215555 Sep 03 20:56:43.285581 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1076/2196] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:43 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:43.294632 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3c27e122-cdaa-47cc-ade4-bbf0652c455d req-f6715716-cf73-4a4b-93f9-7f129c0d1508 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060571 Sep 03 20:56:43.295436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1121/2197] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:43.304499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-233f76ec-7587-4385-ab2e-0e5830831d40 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae6698a040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:43.305739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e937d96-61bb-455a-b52c-12e3a21f6423 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Calling method '.version_select at 0x7fae66803b80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:43.339360 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8e937d96-61bb-455a-b52c-12e3a21f6423 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] HTTP exception thrown: Image not found. Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e937d96-61bb-455a-b52c-12e3a21f6423 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Request method failure captured: Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-I06oZEqmGV33q05HORnDf05Fm-KmQ0yrsGE32pMtm1ar1FncTCUSvrpZeeMPdPX3XRAParARQRwEe4lsYGmz9jCnJvTpOksRY3GsnMT9BDxovzeyYYXXN2oc46xjh7ao3CF4My_24durfrG6ryArBDzxqxsMH0tCmRbwRlKy0Sm4 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:43.341348 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98285399acfb4823a65117e6e499fb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 2d129b2222f7408db35cae47dcb9a60a Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '-1'} Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:43.342968 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.345758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:43.349942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e937d96-61bb-455a-b52c-12e3a21f6423 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e937d96-61bb-455a-b52c-12e3a21f6423 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.056003 Sep 03 20:56:43.351816 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1077/2198] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Sep 3 20:56:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:43.357306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:43.357306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:43.360251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.360790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.361342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.362056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.363112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.363680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.368245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:43.393376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lazy-loading 'flavor' on Instance uuid e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:43.411472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Cannot 'rescue' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state paused Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action HTTP/1.1 Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 14 Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:43.413555 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: {"rescue": {}} Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:56:43.415324 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'rescue' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state paused Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8', 'body': {'rescue': {}}} Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 in vm_state paused. Cannot rescue while the instance is in this state. Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:43.416228 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state paused Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state paused Sep 03 20:56:43.417978 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:43.419388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 409 to user: Cannot 'rescue' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state paused {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:43.419388 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62a81146-91c1-4a56-88dc-c64e248c1ef2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action" status: 409 len: 144 microversion: 2.1 time: 0.070759 Sep 03 20:56:43.419388 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1078/2199] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:43 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action => generated 144 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:43.421998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: .version_select at 0x7fae68b2e700>, body: {"removeFloatingIp": {"address": "172.35.4.223"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:43.571745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:43.580226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.581002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.582030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.584115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:43.584619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:43.586425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:43.838389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:56:43.838813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquired lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:56:44.198797 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-233f76ec-7587-4385-ab2e-0e5830831d40 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/7f88ac31-aea9-43ce-8ced-7854a2c20349" status: 202 len: 0 microversion: 2.1 time: 0.902081 Sep 03 20:56:44.199422 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1122/2200] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:56:43 2022] DELETE /compute/v2.1/os-security-groups/7f88ac31-aea9-43ce-8ced-7854a2c20349 => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:44.208021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50f7172a-7c1a-447d-8ffb-114a1801bd2f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '.version_select at 0x7fae67180820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:44.212938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50f7172a-7c1a-447d-8ffb-114a1801bd2f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:44.214130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50f7172a-7c1a-447d-8ffb-114a1801bd2f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:44.214820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50f7172a-7c1a-447d-8ffb-114a1801bd2f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:44.228475 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50f7172a-7c1a-447d-8ffb-114a1801bd2f tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1697 microversion: 2.25 time: 0.026425 Sep 03 20:56:44.230134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1123/2201] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Sep 3 20:56:44 2022] GET /compute/v2.1/os-migrations => generated 1697 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:44.236602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43b25f8b-eda3-4330-8055-5cbb8ffde6a2 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Calling method '.version_select at 0x7fae66941a60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:44.263192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-43b25f8b-eda3-4330-8055-5cbb8ffde6a2 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] HTTP exception thrown: Image not found. Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43b25f8b-eda3-4330-8055-5cbb8ffde6a2 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Request method failure captured: Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/f1254e0d-8808-4ecb-882a-85b7d9b3748j HTTP/1.1 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-I06oZEqmGV33q05HORnDf05Fm-KmQ0yrsGE32pMtm1ar1FncTCUSvrpZeeMPdPX3XRAParARQRwEe4lsYGmz9jCnJvTpOksRY3GsnMT9BDxovzeyYYXXN2oc46xjh7ao3CF4My_24durfrG6ryArBDzxqxsMH0tCmRbwRlKy0Sm4 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:44.265950 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98285399acfb4823a65117e6e499fb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2d129b2222f7408db35cae47dcb9a60a Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f1254e0d-8808-4ecb-882a-85b7d9b3748j'} Sep 03 20:56:44.267844 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1254e0d-8808-4ecb-882a-85b7d9b3748j to delete Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:44.269511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1254e0d-8808-4ecb-882a-85b7d9b3748j could not be found. Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:44.271054 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43b25f8b-eda3-4330-8055-5cbb8ffde6a2 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:44.272763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-43b25f8b-eda3-4330-8055-5cbb8ffde6a2 tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/f1254e0d-8808-4ecb-882a-85b7d9b3748j" status: 404 len: 62 microversion: 2.1 time: 0.036076 Sep 03 20:56:44.274746 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1124/2202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:44 2022] DELETE /compute/v2.1/images/f1254e0d-8808-4ecb-882a-85b7d9b3748j => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:44.279443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:44.280406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:44.288040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:44.288572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:44.289095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:44.289873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:44.290578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:44.291045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:44.386894 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23ded77d-13ca-443c-878d-66467a63836f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action" status: 202 len: 0 microversion: 2.1 time: 0.110392 Sep 03 20:56:44.397156 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1125/2203] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:44 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:44.412411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:44.413266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] [instance: dc18fd6b-0212-4fc9-b052-801fa575c4d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:44.421400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:44.421928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:44.422603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:44.423534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:44.424185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:44.425414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:44.444602 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] HTTP exception thrown: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Request method failure captured: Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 HTTP/1.1 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74G-amNHT9k8uNN4nQQ_MFh_HnnOK0AneZEKZLSAUHQhhTex21DLI3f3DrmOLRiNWSDNtrOd2Cliip_JVzSshs0Vp8EItZ3jMk4PoVfOmmYc28bFWdXVFasNWN94P8yyYt3N6526WLpx3PDHJRi5_0pvWIZvl9-RLl0V9ATr_cVXqA Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:44.446427 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e96ec8c49f384e7d81244fd2476d0496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e96ec8c49f384e7d81244fd2476d0496 Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-MigrationsAdminTest-2092560452 Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2e11c33c786746e5b3effedd32674582 Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-MigrationsAdminTest-2092560452-project Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. Sep 03 20:56:44.448346 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'dc18fd6b-0212-4fc9-b052-801fa575c4d4'} Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:44.449425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. Sep 03 20:56:44.451287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:44.452992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] Returning 404 to user: Instance dc18fd6b-0212-4fc9-b052-801fa575c4d4 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:44.452992 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-baeda69e-a579-4364-ad39-89ae36e1b6bf tempest-MigrationsAdminTest-2092560452 tempest-MigrationsAdminTest-2092560452-project] 10.222.0.16 "GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4" status: 404 len: 111 microversion: 2.1 time: 0.047947 Sep 03 20:56:44.453745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1126/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:44 2022] GET /compute/v2.1/servers/dc18fd6b-0212-4fc9-b052-801fa575c4d4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:44.460008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62294212-9d36-4966-9bee-86a86609fe37 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae669a3790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:44.932992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:45.591362 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62294212-9d36-4966-9bee-86a86609fe37 tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ecfda0e4-cd5b-4c54-a20c-42f9419527fc" status: 202 len: 0 microversion: 2.1 time: 1.135158 Sep 03 20:56:45.592514 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1127/2205] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:56:44 2022] DELETE /compute/v2.1/os-security-groups/ecfda0e4-cd5b-4c54-a20c-42f9419527fc => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:45.598292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:45.599123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:45.615591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:45.616176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:45.617763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:45.620177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:45.621961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:45.622690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:45.748275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Updating instance_info_cache with network_info: [{"id": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a", "address": "fa:16:3e:60:34:34", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5ae7b9c4-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:45.762540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Releasing lock "refresh_cache-41fe43ee-b5a6-43d1-bbfe-02e3034dc456" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:56:45.763693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76e3c6a9-b898-43fd-9420-ebdc52de17da tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456/action" status: 202 len: 0 microversion: 2.1 time: 2.346815 Sep 03 20:56:45.764827 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1079/2206] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:43 2022] POST /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456/action => generated 0 bytes in 2348 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:56:45.774053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73156b11-6a65-4e18-818a-4ea78fc845ea tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Calling method '.version_select at 0x7fae6b7769d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:45.794927 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-73156b11-6a65-4e18-818a-4ea78fc845ea tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] HTTP exception thrown: Image not found. Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73156b11-6a65-4e18-818a-4ea78fc845ea tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Request method failure captured: Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/b6423c4d-3fd2-44bd-a857-c397c3f321281 HTTP/1.1 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-I06oZEqmGV33q05HORnDf05Fm-KmQ0yrsGE32pMtm1ar1FncTCUSvrpZeeMPdPX3XRAParARQRwEe4lsYGmz9jCnJvTpOksRY3GsnMT9BDxovzeyYYXXN2oc46xjh7ao3CF4My_24durfrG6ryArBDzxqxsMH0tCmRbwRlKy0Sm4 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:45.802479 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98285399acfb4823a65117e6e499fb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 2d129b2222f7408db35cae47dcb9a60a Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b6423c4d-3fd2-44bd-a857-c397c3f321281'} Sep 03 20:56:45.805168 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b6423c4d-3fd2-44bd-a857-c397c3f321281 to delete Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:45.806166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b6423c4d-3fd2-44bd-a857-c397c3f321281 could not be found. Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:45.807712 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:45.809622 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:45.815593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73156b11-6a65-4e18-818a-4ea78fc845ea tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:45.816524 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73156b11-6a65-4e18-818a-4ea78fc845ea tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/b6423c4d-3fd2-44bd-a857-c397c3f321281" status: 404 len: 62 microversion: 2.1 time: 0.050508 Sep 03 20:56:45.817283 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1080/2207] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:45 2022] DELETE /compute/v2.1/images/b6423c4d-3fd2-44bd-a857-c397c3f321281 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:45.827531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:45.829745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:45.840587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:45.841466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:45.842299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:45.844214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:45.845412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:45.846036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:45.974680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] Lazy-loading 'services' on Instance uuid 64032526-9ab3-4528-9b6a-a4a9d0d5f631 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:46.020332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a5836744-2c43-41ad-bad5-5d4e0da267bd tempest-LiveAutoBlockMigrationV225Test-963097059 tempest-LiveAutoBlockMigrationV225Test-963097059-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1968 microversion: 2.25 time: 0.426452 Sep 03 20:56:46.021152 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1128/2208] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:45 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1968 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:46.046644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fe43ee-b5a6-43d1-bbfe-02e3034dc456", "tag": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:46.073608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:46.085749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:46.091464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:46.091591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:46.100981 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4872ad8-eac7-4c54-b66f-079feceef9c8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1516 microversion: 2.1 time: 0.281950 Sep 03 20:56:46.103100 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1081/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:45 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:46.110946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f00d1b01-f8a4-4341-8feb-9d37bb64f1af tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] Calling method '.version_select at 0x7fae667b7c10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:46.148975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] Creating event network-changed:5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a for instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 on nch1-master-1 Sep 03 20:56:46.161976 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7a80408c-9a6e-405f-ab13-82ab1702c6e4 req-17e53ba1-7c43-4189-99a2-01308d1c79cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138851 Sep 03 20:56:46.163208 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1129/2210] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:46.170282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:46.171188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:46.179005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:46.180277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:46.181014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:46.182099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:46.182756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:46.183445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:46.250762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:46.499662 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85a8d990-d02e-4c24-9bec-f7bc8a51adbd tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 204 len: 0 microversion: 2.1 time: 0.334467 Sep 03 20:56:46.504142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f00d1b01-f8a4-4341-8feb-9d37bb64f1af tempest-SecurityGroupRulesNegativeTestJSON-80418741 tempest-SecurityGroupRulesNegativeTestJSON-80418741-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d168133b-32e7-4b2a-913a-1c8726f980f6" status: 202 len: 0 microversion: 2.1 time: 0.398262 Sep 03 20:56:46.504958 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1082/2211] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:56:46 2022] DELETE /compute/v2.1/os-security-groups/d168133b-32e7-4b2a-913a-1c8726f980f6 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:56:46.510618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c5ef860-3144-4edb-bd98-915ae70a916b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Calling method '.version_select at 0x7fae667fb280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:46.517495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1130/2212] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:46 2022] DELETE /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:56:46.554545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:46.555817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:46.577335 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8c5ef860-3144-4edb-bd98-915ae70a916b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] HTTP exception thrown: Image not found. Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c5ef860-3144-4edb-bd98-915ae70a916b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Request method failure captured: Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/images/tempest-invalid-342358367 HTTP/1.1 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-I06oZEqmGV33q05HORnDf05Fm-KmQ0yrsGE32pMtm1ar1FncTCUSvrpZeeMPdPX3XRAParARQRwEe4lsYGmz9jCnJvTpOksRY3GsnMT9BDxovzeyYYXXN2oc46xjh7ao3CF4My_24durfrG6ryArBDzxqxsMH0tCmRbwRlKy0Sm4 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:56:46.579146 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98285399acfb4823a65117e6e499fb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 2d129b2222f7408db35cae47dcb9a60a Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'tempest-invalid-342358367'} Sep 03 20:56:46.581519 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-342358367 to delete Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:46.586926 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-342358367 could not be found. Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:46.588601 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c5ef860-3144-4edb-bd98-915ae70a916b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:46.590897 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c5ef860-3144-4edb-bd98-915ae70a916b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-342358367" status: 404 len: 62 microversion: 2.1 time: 0.074995 Sep 03 20:56:46.594306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1083/2213] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Sep 3 20:56:46 2022] DELETE /compute/v2.1/images/tempest-invalid-342358367 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:46.597310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:46.599620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:46.600092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:46.602377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:46.603196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:46.605778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:46.705177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:47.004304 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aab42a05-e28a-45f2-809f-be69028c67d0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 204 len: 0 microversion: 2.25 time: 0.483902 Sep 03 20:56:47.005918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1131/2214] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:56:46 2022] DELETE /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:56:47.017998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578e876b-7f21-4b6a-843b-bb7a9470fc2b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Calling method '.version_select at 0x7fae669f13a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:47.077397 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-578e876b-7f21-4b6a-843b-bb7a9470fc2b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] HTTP exception thrown: Image not found. Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578e876b-7f21-4b6a-843b-bb7a9470fc2b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Request method failure captured: Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/2a4514a1-7237-4593-8f2d-e144cdb98542 HTTP/1.1 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-I06oZEqmGV33q05HORnDf05Fm-KmQ0yrsGE32pMtm1ar1FncTCUSvrpZeeMPdPX3XRAParARQRwEe4lsYGmz9jCnJvTpOksRY3GsnMT9BDxovzeyYYXXN2oc46xjh7ao3CF4My_24durfrG6ryArBDzxqxsMH0tCmRbwRlKy0Sm4 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:47.080816 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_98285399acfb4823a65117e6e499fb9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/98285399acfb4823a65117e6e499fb9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 98285399acfb4823a65117e6e499fb9a Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-492115408 Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2d129b2222f7408db35cae47dcb9a60a Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-492115408-project Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2a4514a1-7237-4593-8f2d-e144cdb98542'} Sep 03 20:56:47.083202 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a4514a1-7237-4593-8f2d-e144cdb98542 to delete Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:47.084686 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a4514a1-7237-4593-8f2d-e144cdb98542 could not be found. Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:47.086316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 20:56:47.088311 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:47.092335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578e876b-7f21-4b6a-843b-bb7a9470fc2b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:47.092335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-578e876b-7f21-4b6a-843b-bb7a9470fc2b tempest-ImagesDeleteNegativeTestJSON-492115408 tempest-ImagesDeleteNegativeTestJSON-492115408-project] 10.222.0.16 "DELETE /compute/v2.1/images/2a4514a1-7237-4593-8f2d-e144cdb98542" status: 404 len: 62 microversion: 2.1 time: 0.084534 Sep 03 20:56:47.093020 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1132/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:47 2022] DELETE /compute/v2.1/images/2a4514a1-7237-4593-8f2d-e144cdb98542 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:47.110229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:47.111453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:47.125032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:47.130949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:47.131776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:47.132529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:47.136971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:47.139640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:47.140452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:47.259007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.223"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:47.263154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:47.275506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:47.276431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:47.277302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:47.278574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:47.279620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:47.280324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:47.373797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:56:47.374219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquired lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:56:47.749357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:47.772583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:47.774746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:47.777901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e9957f7-41ae-4460-8416-716f373ca2af tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1482 microversion: 2.25 time: 0.681580 Sep 03 20:56:47.781227 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1133/2216] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:47 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1482 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:48.029791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:48.032803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:48.044105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:48.046791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:48.048454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:48.049662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:48.050496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:48.051771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:48.096165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lazy-loading 'flavor' on Instance uuid e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:56:48.220437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0442f20c-927e-4a2c-8c99-9dbfb021838c tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action" status: 200 len: 32 microversion: 2.1 time: 0.196992 Sep 03 20:56:48.222074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1134/2217] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:48 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:56:48.233611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:48.234512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:48.244799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:48.245496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:48.246548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:48.247332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:48.247951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:48.248687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:49.410991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:49.415465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:49.432307 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ac48d87-afa9-4461-b132-0d33d4a760b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 1.203655 Sep 03 20:56:49.432921 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1135/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:48 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:49.442352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:49.442352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:49.450580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:49.451281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:49.451912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:49.452817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:49.453466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:49.454068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:50.213958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:50.224538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:50.230441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:50.231584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-910ae20d-c4e0-4f56-92d6-77f06fcdced0 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 200 len: 1482 microversion: 2.25 time: 0.797719 Sep 03 20:56:50.249493 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1136/2219] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:49 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 1482 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:50.757275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:50.777564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Action: 'update', calling method: .version_select at 0x7fae66a04670>, body: {"quota_set": {"ram": "5120"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:51.292673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:51.294062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:51.294513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:51.295271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:51.295735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:51.296486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:51.457369 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07160d8b-734e-4f52-a822-1e7065fcac0c tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c" status: 200 len: 148 microversion: 2.57 time: 1.203380 Sep 03 20:56:51.459540 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1137/2220] 10.222.0.16 () {62 vars in 1303 bytes} [Sat Sep 3 20:56:50 2022] PUT /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c => generated 148 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:56:51.474433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:51.476120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:51.492360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:51.493236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:51.495279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:51.498037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:51.502409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:51.503538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:52.634191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:52.683877 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea20b1df-7ca5-4296-b4f9-606013802dd5 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 1.209488 Sep 03 20:56:52.689161 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1138/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:51 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:52.715121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:52.821963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:52.831598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:52.833083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:52.895470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] Creating event network-changed:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:56:52.904223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-da82d176-97e9-4a5f-9d46-2aba461db198 req-94e41aa4-5541-47ba-bd56-916d85111601 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208800 Sep 03 20:56:52.907766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1139/2222] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:52.925212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:52.926733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 64032526-9ab3-4528-9b6a-a4a9d0d5f631] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:52.959203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:52.959838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:52.964553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:52.965710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:52.966334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:52.967951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.004427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] HTTP exception thrown: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Request method failure captured: Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 HTTP/1.1 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE74meUZ28dSw00-WyDIxugmE6Wu6Na5I0Cyo8CZnQJ1_9qGzE5Dp6WKUzf_RXOhAq_EjrpmYtkXMU4fg310ZmqNj1Y_CQ4Wl4OnZD2Isrc2siCrScZ0h5_KVTCK8rlVjWylhayhuPgU9cGL6swkPkHskhcV9VeuW6VNlWjp7xHOlUYY Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.25 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:53.007035 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_361f907a187547aabda6cb54eeeb3684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 778561ee5e474accb31816f357985f44 Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. Sep 03 20:56:53.008686 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '64032526-9ab3-4528-9b6a-a4a9d0d5f631'} Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:53.009687 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. Sep 03 20:56:53.011740 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:53.014072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Returning 404 to user: Instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:53.023979 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b2d06b7-8640-4f02-8e38-149ca5e67709 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631" status: 404 len: 111 microversion: 2.25 time: 0.113057 Sep 03 20:56:53.025249 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1140/2223] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:52 2022] GET /compute/v2.1/servers/64032526-9ab3-4528-9b6a-a4a9d0d5f631 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:56:53.030825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Calling method '.version_select at 0x7fae6698adc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:53.081806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Updating instance_info_cache with network_info: [{"id": "6a8229ff-11de-475b-bab0-bd7fc2f10daa", "address": "fa:16:3e:c3:ff:19", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a8229ff-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:53.098327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Releasing lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:56:53.102259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60b857f5-3f7d-47b7-adc9-9ce7ff1d2871 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action" status: 202 len: 0 microversion: 2.1 time: 6.518818 Sep 03 20:56:53.105503 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1084/2224] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:46 2022] POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action => generated 0 bytes in 6523 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:56:53.150420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fe43ee-b5a6-43d1-bbfe-02e3034dc456", "name": "network-vif-deleted", "tag": "5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:53.181174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.181797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.185692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.207419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] Creating event network-vif-deleted:5ae7b9c4-5d72-4d07-b0cb-a84c7ab0a11a for instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 on nch1-master-1 Sep 03 20:56:53.223630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-70c1de8e-60fa-4259-97a3-2baa8c061c90 req-ae54a7d5-75c5-405e-a751-0c258d57a09b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112048 Sep 03 20:56:53.224429 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1085/2225] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:53.239978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5510ec6d-1018-4dae-8d7e-82a761412633 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '.version_select at 0x7fae6683a9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:53.298556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.298556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.298556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.299474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.300598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.301318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.335721 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f9095e5-f3b6-4721-bc09-f62aac870469 tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c/detail" status: 200 len: 463 microversion: 2.57 time: 0.308968 Sep 03 20:56:53.337414 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1141/2226] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Sep 3 20:56:53 2022] GET /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c/detail => generated 463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:56:53.574064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Action: 'update', calling method: .version_select at 0x7fae66a04ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:53.661410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5510ec6d-1018-4dae-8d7e-82a761412633 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/8e588945-cbcc-4bf4-8c6c-5175b5ffa7b4" status: 200 len: 185 microversion: 2.1 time: 0.435477 Sep 03 20:56:53.661991 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1086/2227] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:56:53 2022] GET /compute/v2.1/os-floating-ips/8e588945-cbcc-4bf4-8c6c-5175b5ffa7b4 => generated 185 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:53.697940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.223"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:53.717426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.724349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.725339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.726358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.727763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.729960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.774102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.774604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.775073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.775856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.776326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.776761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.857612 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b15a7ca6-cc36-4f56-9b14-5695a2b328ff tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c?user_id=417d593ea3c649f4ae88696e9dc7f74d" status: 200 len: 148 microversion: 2.57 time: 0.288114 Sep 03 20:56:53.858332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1142/2228] 10.222.0.16 () {62 vars in 1384 bytes} [Sat Sep 3 20:56:53 2022] PUT /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c?user_id=417d593ea3c649f4ae88696e9dc7f74d => generated 148 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:56:53.871575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:53.872518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:53.894095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.895057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.895681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.897420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.897846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.898360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.943394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:53.955217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.957772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.958864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:53.968504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:53.969676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:53.970327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:54.443882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:54.470977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1fb256b2-da65-4bd9-983c-a537d7147cbe tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.611284 Sep 03 20:56:54.473646 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1143/2229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:53 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:54.479951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e4c97ca-3580-4110-b18d-9b7eb050d6da tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] Calling method '.version_select at 0x7fae668fb5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:54.669711 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e4c97ca-3580-4110-b18d-9b7eb050d6da tempest-QuotasAdminTestV257-1335190500 tempest-QuotasAdminTestV257-1335190500-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c?user_id=417d593ea3c649f4ae88696e9dc7f74d" status: 200 len: 190 microversion: 2.57 time: 0.191995 Sep 03 20:56:54.671524 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1144/2230] 10.222.0.16 () {60 vars in 1364 bytes} [Sat Sep 3 20:56:54 2022] GET /compute/v2.1/os-quota-sets/aa5ca21ed2ba4455850119dab62e661c?user_id=417d593ea3c649f4ae88696e9dc7f74d => generated 190 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:56:55.279989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64032526-9ab3-4528-9b6a-a4a9d0d5f631", "name": "network-vif-deleted", "tag": "fb49300a-fe93-40a5-a740-b0e93324b179"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:55.303156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:55.304111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:55.304816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:55.334209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] Creating event network-vif-deleted:fb49300a-fe93-40a5-a740-b0e93324b179 for instance 64032526-9ab3-4528-9b6a-a4a9d0d5f631 on nch1-master-1 Sep 03 20:56:55.339576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5ed457ed-5cf5-4be2-8250-0f1824cd0fe4 req-3daad198-708b-4d82-a001-dddb0b00f593 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063648 Sep 03 20:56:55.340763 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1145/2231] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:55.554452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:56:55.555000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquired lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:56:55.797693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Calling method '.version_select at 0x7fae66907e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:55.824797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:55.825933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:55.826983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:55.828970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:55.842376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:55.842555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:55.897343 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56353df0-b7ee-428f-a4d2-e41cd8852b9d tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.457082 Sep 03 20:56:55.917069 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1146/2232] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 3 20:56:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:55.928066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:55.935521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:55.945433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:55.946245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:55.946877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:55.948174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:55.948817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:55.949458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:56.006732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:56:56.206659 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-320a1ada-9fde-48d5-84d1-559d719ffa37 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 204 len: 0 microversion: 2.25 time: 0.287570 Sep 03 20:56:56.207886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1147/2233] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:56:55 2022] DELETE /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:56:56.216393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:56.222473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:56.230929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:56.231701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:56.232821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:56.233899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:56.234742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:56.235725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:56.642557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:56.659974 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-396e1504-552d-4a85-ae54-9a2a2e9d01f6 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.448810 Sep 03 20:56:56.662225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1148/2234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:56 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:56.674290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900690925", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:56.773548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:56:56.858766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 20:56:57.530729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Getting quotas for project e033e783340b44719f9f77e6d1671a00. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:56:57.536946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Getting quotas for user bb1def1d544546d198ee70cab711964d and project e033e783340b44719f9f77e6d1671a00. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:56:57.563100 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Request method failure captured: Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 1751 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-Te1M_M1XBrzrJoCaUeuNUJDnFpWctgtCRmcToi7NXdOBtR0mRMU6qFYlM_FH-dD3RQ5nBOaaQfx75YN6BAX_zh1zu0V-4ADXZKIigSkREk84RawuqNlGxbTz945mgGRoJbyJ7Iz4hP3lZE4ZvcZIxdmdzH_jWHSKebbf5qx8MY6Y Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e033e783340b44719f9f77e6d1671a00 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1615065971 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e033e783340b44719f9f77e6d1671a00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e033e783340b44719f9f77e6d1671a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e033e783340b44719f9f77e6d1671a00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e033e783340b44719f9f77e6d1671a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1615065971 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e033e783340b44719f9f77e6d1671a00 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1615065971 Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: bb1def1d544546d198ee70cab711964d Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-900690925", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:57.570691 ncdv-master-1 devstack@n-api.service[140520]: exception: Maximum number of metadata items exceeds 128 Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-900690925', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:57.573435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 03 20:56:57.576652 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:57.584362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:57.585478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8b05400-cc62-4d8e-aa1e-0f1cbe26135b tempest-AbsoluteLimitsNegativeTestJSON-1615065971 tempest-AbsoluteLimitsNegativeTestJSON-1615065971-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.921245 Sep 03 20:56:57.587934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1149/2235] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Sep 3 20:56:56 2022] POST /compute/v2.1/servers => generated 87 bytes in 924 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:56:57.606574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:57.609976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:57.633311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:57.634170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:57.635591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:57.638346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:57.639750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:57.641310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.061851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Updating instance_info_cache with network_info: [{"id": "6a8229ff-11de-475b-bab0-bd7fc2f10daa", "address": "fa:16:3e:c3:ff:19", "network": {"id": "2344d3b5-a659-4a36-8ca8-079609faaf44", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2010856556-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a9897f3d9893426f9fba83c8db250799", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a8229ff-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 20:56:58.099401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Releasing lock "refresh_cache-14a647f4-afcb-46cc-8329-e0357a84f408" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:56:58.100874 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68fb41c7-12bb-439b-bad9-c41c5c1267d6 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action" status: 202 len: 0 microversion: 2.1 time: 4.428368 Sep 03 20:56:58.106321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1087/2236] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:56:53 2022] POST /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408/action => generated 0 bytes in 4434 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 20:56:58.121916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:56:58.187596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.188105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.188549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.235334 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] Creating event network-changed:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:56:58.268945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e36d6456-3c37-487d-b5ed-a4d8fd618b34 req-4a3de738-6d02-4b47-bd74-5619245a0e6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154418 Sep 03 20:56:58.273724 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1088/2237] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:56:58.290713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:58.299408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:58.305140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:58.305801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:58.310565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:58.315071 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3eb2947f-5760-4bbe-a803-8baee564dbaf tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1732 microversion: 2.25 time: 0.724936 Sep 03 20:56:58.316614 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1150/2238] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:57 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1732 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:56:58.321456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:58.321834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.322589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.323204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.324257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.324879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.325493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.335127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:58.358223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.358756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.359214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.360012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.360404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.360831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.410813 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] HTTP exception thrown: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Request method failure captured: Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 HTTP/1.1 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE79CzYe4RCM5Ak0ksjPcQYCPegMOA_B9_JL3oW1lAcbEvxdol9ugCqhsX9SUwWK9KY3pATbZLUPlRzcDGboaCcI-FkCSN7W2dnKkAQJq0IilrL19kwVnj0pLFDWuTIUgSPJ-2vf5Kh8Taxv-eGEqBTmwH8FnQP5rzaW6YoR9X6sk3OQ Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9897f3d9893426f9fba83c8db250799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f4d78b7738644ff38eb239daec52d641 Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '41fe43ee-b5a6-43d1-bbfe-02e3034dc456'} Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:58.412519 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Returning 404 to user: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:58.419515 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92ba5f1d-e306-4d34-8ff4-be06ec6fd3b2 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 404 len: 111 microversion: 2.1 time: 0.098757 Sep 03 20:56:58.426968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1151/2239] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:56:58 2022] DELETE /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:58.443355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:58.444020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 41fe43ee-b5a6-43d1-bbfe-02e3034dc456] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:58.471830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.472447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.472984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.473769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:58.474279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:58.483212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:58.516365 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] HTTP exception thrown: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Request method failure captured: Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 HTTP/1.1 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE79CzYe4RCM5Ak0ksjPcQYCPegMOA_B9_JL3oW1lAcbEvxdol9ugCqhsX9SUwWK9KY3pATbZLUPlRzcDGboaCcI-FkCSN7W2dnKkAQJq0IilrL19kwVnj0pLFDWuTIUgSPJ-2vf5Kh8Taxv-eGEqBTmwH8FnQP5rzaW6YoR9X6sk3OQ Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9897f3d9893426f9fba83c8db250799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f4d78b7738644ff38eb239daec52d641 Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '41fe43ee-b5a6-43d1-bbfe-02e3034dc456'} Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.518120 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. Sep 03 20:56:58.522727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:56:58.524942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Returning 404 to user: Instance 41fe43ee-b5a6-43d1-bbfe-02e3034dc456 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:56:58.527662 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6317c387-eef8-47c5-b35c-2733709144ba tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456" status: 404 len: 111 microversion: 2.1 time: 0.099611 Sep 03 20:56:58.531635 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1152/2240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:58 2022] GET /compute/v2.1/servers/41fe43ee-b5a6-43d1-bbfe-02e3034dc456 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:56:58.537347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f6fec70-1c87-41e3-823c-e1a5fe607f35 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '.version_select at 0x7fae668dd310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:58.783230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:58.806469 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a93b477-dce6-426b-978f-53d4daadd426 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.531063 Sep 03 20:56:58.809546 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1089/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:56:58 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:56:59.343501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:56:59.344484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:56:59.364608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:59.365169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:59.365621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:59.366374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:56:59.366835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:56:59.367270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:56:59.778697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:59.797967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:59.801279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:56:59.803654 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-df0d180b-f945-46a2-9626-b2b8b5d1e216 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1732 microversion: 2.25 time: 0.463951 Sep 03 20:56:59.805925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1090/2242] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:56:59 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1732 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:57:00.480769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2404e4ee-a09c-4296-ac2e-85f8353ed372 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae6b8aba60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAB1jEevMK2dUu/Z41zDMcsFnAsqlT1UDA/LpuVFbB4Yse37rfdLeBSpaRxriopwgYbXWyRAiut5ukqeqBCMqFeP7uCEg/uW8V/QAKl0p9ukkY2RzOg+/5Mt1GoqmzLUQ=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2404e4ee-a09c-4296-ac2e-85f8353ed372 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 257 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAB1jEevMK2dUu/Z41zDMcsFnAsqlT1UDA/LpuVFbB4Yse37rfdLeBSpaRxriopwgYbXWyRAiut5ukqeqBCMqFeP7uCEg/uW8V/QAKl0p9ukkY2RzOg+/5Mt1GoqmzLUQ=="}} Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAB1jEevMK2dUu/Z41zDMcsFnAsqlT1UDA/LpuVFbB4Yse37rfdLeBSpaRxriopwgYbXWyRAiut5ukqeqBCMqFeP7uCEg/uW8V/QAKl0p9ukkY2RzOg+/5Mt1GoqmzLUQ=='}}} Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 03 20:57:00.490377 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2404e4ee-a09c-4296-ac2e-85f8353ed372 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2404e4ee-a09c-4296-ac2e-85f8353ed372 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.684847 Sep 03 20:57:00.496447 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1091/2243] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:56:59 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 686 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:57:00.509502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:00.510184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:00.525258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=50 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:00.530363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:00.531665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:00.538039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:00.539754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:00.540377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:00.543511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:00.849207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:00.861125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b22752ef-33f1-4ea1-8088-97e3edce33ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.359255 Sep 03 20:57:00.876336 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1092/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:00 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:00.892849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae667b7280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1866345182", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:00.938050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:00.949243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for user d4bb698e4a2e4598acdb662511ce9eeb and project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:00.990911 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 2167 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1866345182", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:01.009661 ncdv-master-1 devstack@n-api.service[140519]: exception: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1866345182', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:01.012481 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd6872ff-4218-4b75-84fe-d11dd15b8107 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.132373 Sep 03 20:57:01.017226 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1093/2245] 10.222.0.16 () {60 vars in 1160 bytes} [Sat Sep 3 20:57:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:57:01.028986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:01.034836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:01.050109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:01.051030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:01.057722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:01.063258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:01.066197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:01.066889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:01.876076 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f6fec70-1c87-41e3-823c-e1a5fe607f35 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/8e588945-cbcc-4bf4-8c6c-5175b5ffa7b4" status: 202 len: 0 microversion: 2.1 time: 3.343048 Sep 03 20:57:01.877103 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1153/2246] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:56:58 2022] DELETE /compute/v2.1/os-floating-ips/8e588945-cbcc-4bf4-8c6c-5175b5ffa7b4 => generated 0 bytes in 3345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:01.884973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bc19ee07-61dc-462c-8db2-2d1d2c5a94ee tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae66a04ca0>, body: {"keypair": {"name": "tempest-keypair-1945575970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODuubb9BZ/Z643pB0zwKoVMg83IK8jo+GmZMxc5YgXMaGW6A3n1zvutR1oyp/az5CSn2pSuVWtPARtIUw6J0flMSS8InU4zGXljrF0N+vYZgRzVPM3yHr3ON87yiOI5KQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:01.926410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:01.971223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bc19ee07-61dc-462c-8db2-2d1d2c5a94ee tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:01.972436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:01.986750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:01.988547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:01.990044 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ed80d57-f51a-4cb6-86c7-39081bc4177f tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 200 len: 1664 microversion: 2.25 time: 0.976242 Sep 03 20:57:01.991118 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1094/2247] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:01 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 1664 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:01.997572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de366e88-7f23-48df-8fa7-a11187537c06", "name": "network-vif-deleted", "tag": "a7600aef-f597-4126-9418-5db497d829db"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:02.002168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bc19ee07-61dc-462c-8db2-2d1d2c5a94ee tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for user d4bb698e4a2e4598acdb662511ce9eeb and project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:02.007852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.008621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.009253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.023513 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] Creating event network-vif-deleted:a7600aef-f597-4126-9418-5db497d829db for instance de366e88-7f23-48df-8fa7-a11187537c06 on nch1-master-1 Sep 03 20:57:02.030576 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0ed43a2a-d159-4e78-9b35-eda3e50ace1f req-c0a1c6b1-8c8c-4b04-91bb-aa7d804fe57e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037831 Sep 03 20:57:02.032379 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1095/2248] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:02.039993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:02.040889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:02.048539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.049950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.050950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.052317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.053014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.053632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.090498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:57:02.139851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bc19ee07-61dc-462c-8db2-2d1d2c5a94ee tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.259955 Sep 03 20:57:02.140541 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1154/2249] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:02.161357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:02.163820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:02.192058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.193619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.195065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.196930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.198384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.200329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.263856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cb80372-381b-43e6-ad55-b24819f74f38 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 204 len: 0 microversion: 2.1 time: 0.229582 Sep 03 20:57:02.265092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1096/2250] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:57:02 2022] DELETE /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:57:02.272255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae6b8ab940>, body: {"keypair": {"name": "tempest-keypair-1945575970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0VRAP7eEAuXVE4j+pzPmUm1HXMBKptNOvJIRjIK3h9NtdlkCjWcSfQPoq5u53z34hF9YJf8uo/oOYYnE4DUo0ytLRS9uUB9iAj9oICju6VxBpkwpGtbj69lGKTL0Xc8A=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:02.314395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:02.332253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for user d4bb698e4a2e4598acdb662511ce9eeb and project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:02.383510 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] HTTP exception thrown: Key pair 'tempest-keypair-1945575970' already exists. Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 273 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "tempest-keypair-1945575970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0VRAP7eEAuXVE4j+pzPmUm1HXMBKptNOvJIRjIK3h9NtdlkCjWcSfQPoq5u53z34hF9YJf8uo/oOYYnE4DUo0ytLRS9uUB9iAj9oICju6VxBpkwpGtbj69lGKTL0Xc8A=="}} Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: exception: Key pair 'tempest-keypair-1945575970' already exists. Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1945575970', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0VRAP7eEAuXVE4j+pzPmUm1HXMBKptNOvJIRjIK3h9NtdlkCjWcSfQPoq5u53z34hF9YJf8uo/oOYYnE4DUo0ytLRS9uUB9iAj9oICju6VxBpkwpGtbj69lGKTL0Xc8A=='}}} Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'd4bb698e4a2e4598acdb662511ce9eeb-tempest-keypair-1945575970' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 03 20:57:02.428852 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi session.flush() Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result.read() Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 03 20:57:02.434446 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'd4bb698e4a2e4598acdb662511ce9eeb-tempest-keypair-1945575970' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 3, 20, 57, 2, 372072), 'updated_at': None, 'name': 'tempest-keypair-1945575970', 'user_id': 'd4bb698e4a2e4598acdb662511ce9eeb', 'fingerprint': '1b:ec:e8:0c:19:7b:6d:0d:83:8d:74:a3:1c:02:d0:ac', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0VRAP7eEAuXVE4j+pzPmUm1HXMBKptNOvJIRjIK3h9NtdlkCjWcSfQPoq5u53z34hF9YJf8uo/oOYYnE4DUo0ytLRS9uUB9iAj9oICju6VxBpkwpGtbj69lGKTL0Xc8A==', 'type': 'ssh'}] Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi keypair.create() Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._create() Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1945575970' already exists. Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 03 20:57:02.438871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1945575970' already exists. Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1945575970' already exists. Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 409 to user: Key pair 'tempest-keypair-1945575970' already exists. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b86cb0c2-4e44-4485-b9fb-5b21728d338c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.163786 Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1097/2251] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:02.444853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:02.467313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.469810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.472693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.475685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:02.478481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:02.479219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:02.835612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:02.844125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b35a174d-e53b-447a-a739-cfea39d4e743 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1526 microversion: 2.1 time: 0.411192 Sep 03 20:57:02.844685 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1098/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:02 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1526 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:02.861807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c121e23-4819-4f59-b6f0-ff4e9b8f4f83 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Calling method '.version_select at 0x7fae6b893f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:02.902226 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c121e23-4819-4f59-b6f0-ff4e9b8f4f83 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945575970" status: 202 len: 0 microversion: 2.1 time: 0.053239 Sep 03 20:57:02.903173 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1099/2253] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 20:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945575970 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:02.916014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4033ed6-d727-4c2e-a018-69f24801498c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae66ef91f0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY/HO6AyP9gZA6LUg4hZfUtH4X+zWvSWbEtEmReipZpnDu6YRvP/jw7QWn2uTE6l4ItlWEqYSziQPg8fSSdbPYynMKWiXHEexbpN1ozyxVGj4OdpmwBkN9/MQ6ZaFGilA=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4033ed6-d727-4c2e-a018-69f24801498c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 247 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY/HO6AyP9gZA6LUg4hZfUtH4X+zWvSWbEtEmReipZpnDu6YRvP/jw7QWn2uTE6l4ItlWEqYSziQPg8fSSdbPYynMKWiXHEexbpN1ozyxVGj4OdpmwBkN9/MQ6ZaFGilA=="}} Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY/HO6AyP9gZA6LUg4hZfUtH4X+zWvSWbEtEmReipZpnDu6YRvP/jw7QWn2uTE6l4ItlWEqYSziQPg8fSSdbPYynMKWiXHEexbpN1ozyxVGj4OdpmwBkN9/MQ6ZaFGilA=='}}} Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi '' Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:57:02.923467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4033ed6-d727-4c2e-a018-69f24801498c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4033ed6-d727-4c2e-a018-69f24801498c tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.014771 Sep 03 20:57:02.931782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1100/2254] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 20:57:02.939816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae6b8ade50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-395929650", "public_key": " "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:02.978933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:02.999934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for user d4bb698e4a2e4598acdb662511ce9eeb and project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:03.046100 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 94 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-395929650", "public_key": " "}} Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: exception: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-395929650', 'public_key': ' '}}} Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.050033 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.054809 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.067468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:03.072503 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2f6202e-5b00-4d75-bf7e-03ecfa223367 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136428 Sep 03 20:57:03.073981 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1101/2255] 10.222.0.16 () {60 vars in 1158 bytes} [Sat Sep 3 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:57:03.102946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:03.107878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: de366e88-7f23-48df-8fa7-a11187537c06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:03.130211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:03.132140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:03.135278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:03.137901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:03.145374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:03.152754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:03.154609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:03.168113 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20b8125a-79d5-460b-94af-b346179f76b1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 1.026411 Sep 03 20:57:03.171593 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1155/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:02 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:03.185258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d59eedb9-8444-4586-b3d6-4c71f7c052d7 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae668dd940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPSRa6oALrBvCowfF/Ie3+hMvp5WMXsdKrDn8/LVmDmgrt8mDIG9tUdSndZ23P/NfoNoWHppL+P0k0mueonnlN583wV0EjoUXXsSCBYdMiwDbYLm9x4z+6njqnCyEUWoQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d59eedb9-8444-4586-b3d6-4c71f7c052d7 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 507 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPSRa6oALrBvCowfF/Ie3+hMvp5WMXsdKrDn8/LVmDmgrt8mDIG9tUdSndZ23P/NfoNoWHppL+P0k0mueonnlN583wV0EjoUXXsSCBYdMiwDbYLm9x4z+6njqnCyEUWoQ=="}} Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPSRa6oALrBvCowfF/Ie3+hMvp5WMXsdKrDn8/LVmDmgrt8mDIG9tUdSndZ23P/NfoNoWHppL+P0k0mueonnlN583wV0EjoUXXsSCBYdMiwDbYLm9x4z+6njqnCyEUWoQ=='}}} Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 03 20:57:03.201600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 03 20:57:03.208318 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.221102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] HTTP exception thrown: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. Sep 03 20:57:03.222336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d59eedb9-8444-4586-b3d6-4c71f7c052d7 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:03.223549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d59eedb9-8444-4586-b3d6-4c71f7c052d7 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.050632 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Request method failure captured: Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 HTTP/1.1 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE74meUZ28dSw00-WyDIxugmE6Wu6Na5I0Cyo8CZnQJ1_9qGzE5Dp6WKUzf_RXOhAq_EjrpmYtkXMU4fg310ZmqNj1Y_CQ4Wl4OnZD2Isrc2siCrScZ0h5_KVTCK8rlVjWylhayhuPgU9cGL6swkPkHskhcV9VeuW6VNlWjp7xHOlUYY Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.25 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_361f907a187547aabda6cb54eeeb3684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 778561ee5e474accb31816f357985f44 Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'de366e88-7f23-48df-8fa7-a11187537c06'} Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. Sep 03 20:57:03.224076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.229385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Returning 404 to user: Instance de366e88-7f23-48df-8fa7-a11187537c06 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:03.232536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3da26c4e-a2b2-48d0-ab50-0d18684b90de tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06" status: 404 len: 111 microversion: 2.25 time: 0.156875 Sep 03 20:57:03.235183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1102/2257] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:03 2022] GET /compute/v2.1/servers/de366e88-7f23-48df-8fa7-a11187537c06 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:57:03.236209 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1156/2258] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:03 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:57:03.250854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a67c867a-8aa4-4e94-9f4b-62c654653f25 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '.version_select at 0x7fae66956e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:03.253856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Action: 'create', calling method: .version_select at 0x7fae6b9a44c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353804415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:03.271110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:03.285100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Getting quotas for user d4bb698e4a2e4598acdb662511ce9eeb and project bcdfcb6afebd476ca5781f53008fe1c8. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:03.296535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a67c867a-8aa4-4e94-9f4b-62c654653f25 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589833773" status: 204 len: 0 microversion: 2.25 time: 0.053760 Sep 03 20:57:03.297638 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1157/2259] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589833773 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:57:03.323136 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 117 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-353804415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: exception: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-353804415', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 03 20:57:03.326219 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 03 20:57:03.332350 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.336454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:03.337683 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91544b24-24de-4b2b-b520-2fabaa24484d tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.093387 Sep 03 20:57:03.338768 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1103/2260] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 20:57:03.349441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e394c4a-c5c9-49de-974a-1b328fd3ca61 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Calling method '.version_select at 0x7fae669070d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:03.380582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-0e394c4a-c5c9-49de-974a-1b328fd3ca61 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e394c4a-c5c9-49de-974a-1b328fd3ca61 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Request method failure captured: Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2032330007 HTTP/1.1 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-bIdOkg9YVqDuo6FX8ZgBo2FMPLjFOE7U8L75fvr1JjwtPgdWJJbBz9QTQUPvMUEcugDCK2D98VFdhC_A-d_hzDjiChB9CaHwGzYPQE929vTMJhHg0xTTVcuerSQlaWnhvLvyObRiq1sh1eCEnwf-1mWBIHX0nqlOfVsTuiqFgU00 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bcdfcb6afebd476ca5781f53008fe1c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: bcdfcb6afebd476ca5781f53008fe1c8 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-617305765 Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-KeyPairsNegativeTestJSON-617305765-project Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: exception: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'tempest-keypair-non-existent-2032330007'} Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.383457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb Sep 03 20:57:03.389014 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:03.392471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e394c4a-c5c9-49de-974a-1b328fd3ca61 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2032330007 not found for user d4bb698e4a2e4598acdb662511ce9eeb {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:03.396415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e394c4a-c5c9-49de-974a-1b328fd3ca61 tempest-KeyPairsNegativeTestJSON-617305765 tempest-KeyPairsNegativeTestJSON-617305765-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2032330007" status: 404 len: 145 microversion: 2.1 time: 0.051462 Sep 03 20:57:03.397189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1158/2261] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2032330007 => generated 145 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:57:03.869276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:03.869912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:03.880446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:03.897102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:03.898476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:03.899609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:03.900527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:03.901167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:03.932376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:04.338805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cf62027-649e-438e-a6d1-988f81344c8f tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] Action: 'create', calling method: .version_select at 0x7fae668dd9d0>, body: {"security_group": {"name": "tempest-securitygroup-1943027034", "description": "tempest-description-1814220249"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:04.647772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:04.661510 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0c2bf90-cee3-4ffa-93e2-2d98e3c4697b tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1526 microversion: 2.1 time: 0.791107 Sep 03 20:57:04.662114 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1104/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:03 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1526 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:04.682870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:04.683742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:04.691243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:04.691952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:04.692567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:04.693491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:04.694108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:04.694693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:05.121647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:05.131628 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5ea54e73-99f4-4b50-848c-37416e7ae125 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.457012 Sep 03 20:57:05.140983 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1105/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:04 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:05.686920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:05.688208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:05.698741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:05.706260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:05.706726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:05.707493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:05.707959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:05.708395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:05.871330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=11 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:05.958816 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cf62027-649e-438e-a6d1-988f81344c8f tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.864820 Sep 03 20:57:05.960043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1159/2264] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:04 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:05.980100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f835798-13e6-4d6f-9f2b-cfa6dfe591d4 tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] Action: 'create', calling method: .version_select at 0x7fae66907790>, body: {"security_group": {"name": "tempest-securitygroup-169515600", "description": "tempest-description-1350915559"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:06.381875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:06.396660 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9befaffe-c9c0-4549-952f-57ba7648c543 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1526 microversion: 2.1 time: 0.713611 Sep 03 20:57:06.402366 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1106/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:05 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1526 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:06.417983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:06.424036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:06.453582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:06.455188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:06.457351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:06.460078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:06.464110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:06.466495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:06.572815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:57:06.873013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b51e48d0-75dc-4000-9fcc-13408ba0eff5 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 204 len: 0 microversion: 2.25 time: 0.465267 Sep 03 20:57:06.879367 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1107/2266] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:57:06 2022] DELETE /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:57:06.907624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:06.908373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:06.943781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:06.944294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:06.944842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:06.945488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:06.954191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:06.954661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.482983 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f835798-13e6-4d6f-9f2b-cfa6dfe591d4 tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.506859 Sep 03 20:57:07.484178 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1160/2267] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:07.491200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a647f4-afcb-46cc-8329-e0357a84f408", "name": "network-vif-deleted", "tag": "6a8229ff-11de-475b-bab0-bd7fc2f10daa"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:07.519490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.520174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.521504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.535383 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] Creating event network-vif-deleted:6a8229ff-11de-475b-bab0-bd7fc2f10daa for instance 14a647f4-afcb-46cc-8329-e0357a84f408 on nch2-master-1 Sep 03 20:57:07.540989 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-174c1f44-68fb-49ad-a020-4f5d421bcca0 req-accfbba9-69f1-435d-babe-9c068fd71a78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055178 Sep 03 20:57:07.541813 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1161/2268] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:07.548843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:07.549871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:07.558713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.559528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.560321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.561566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.562285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.563444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.593518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:07.603652 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-412f51bd-44cd-4e4c-93ed-6689b3aa8f35 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1502 microversion: 2.1 time: 0.722807 Sep 03 20:57:07.607940 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1108/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:06 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:07.619446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:07.625810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:07.639070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.640741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.643270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.644800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.647250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.647798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.735630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:07.736270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:07.737371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:07.738695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lazy-loading 'fault' on Instance uuid 14a647f4-afcb-46cc-8329-e0357a84f408 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:57:07.935080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d78b7738644ff38eb239daec52d641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9897f3d9893426f9fba83c8db250799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:07.965258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f3154c4-6bf1-4bf7-9060-a911d6f1a6f7 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 200 len: 1313 microversion: 2.1 time: 0.354803 Sep 03 20:57:07.967662 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1109/2270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:07 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:08.274321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74c5fd64-cfa0-4046-9381-70848195e154 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Action: 'create', calling method: .version_select at 0x7fae676a9550>, body: {"security_group": {"name": "tempest-securitygroup-903838242", "description": "tempest-description-1217609901"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:08.380706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:08.390096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:08.396815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:08.415116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f1452abe-2275-4d62-9e8a-99b53f53394a tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1548 microversion: 2.25 time: 0.864066 Sep 03 20:57:08.417384 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1162/2271] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:07 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1548 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:08.434951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0adb6e45-9611-454a-af2d-365a145715bc"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:08.438148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:08.451760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.452281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.452739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.453676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.454214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.454949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.489435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Cannot 'attach_volume' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state rescued Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/os-volume_attachments HTTP/1.1 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 74 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: {"volumeAttachment": {"volumeId": "0adb6e45-9611-454a-af2d-365a145715bc"}} Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'attach_volume' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state rescued Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': 'e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8', 'body': {'volumeAttachment': {'volumeId': '0adb6e45-9611-454a-af2d-365a145715bc'}}} Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 03 20:57:08.501175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state rescued Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state rescued Sep 03 20:57:08.504727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:08.507283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 409 to user: Cannot 'attach_volume' instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 while it is in vm_state rescued {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:08.508314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92d54ed0-3839-470a-b6a7-44e6d472d4ee tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088754 Sep 03 20:57:08.509556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1163/2272] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 3 20:57:08 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 20:57:08.520484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:08.521075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:08.530563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.531689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.532154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.532890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.533741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.534601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.672052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bccd82e6-bdf4-4191-89f2-d9d2d647feef tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action" status: 202 len: 0 microversion: 2.1 time: 0.155675 Sep 03 20:57:08.677639 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1164/2273] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:57:08 2022] POST /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:08.685904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:08.688157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:08.724126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.727143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.728554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.730958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:08.731658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:08.734574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:08.798446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:09.239001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:09.265546 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-deffdcad-67d8-46ec-b548-9c123714dac7 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1510 microversion: 2.1 time: 0.583572 Sep 03 20:57:09.265546 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1165/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:08 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:09.287856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:09.288797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] [instance: 14a647f4-afcb-46cc-8329-e0357a84f408] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:09.304752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:09.305399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:09.310332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:09.311217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:09.311840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:09.312346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:09.344341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] HTTP exception thrown: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Request method failure captured: Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 HTTP/1.1 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE79CzYe4RCM5Ak0ksjPcQYCPegMOA_B9_JL3oW1lAcbEvxdol9ugCqhsX9SUwWK9KY3pATbZLUPlRzcDGboaCcI-FkCSN7W2dnKkAQJq0IilrL19kwVnj0pLFDWuTIUgSPJ-2vf5Kh8Taxv-eGEqBTmwH8FnQP5rzaW6YoR9X6sk3OQ Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a9897f3d9893426f9fba83c8db250799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a9897f3d9893426f9fba83c8db250799"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a9897f3d9893426f9fba83c8db250799 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1006754197 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f4d78b7738644ff38eb239daec52d641 Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1006754197-project Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '14a647f4-afcb-46cc-8329-e0357a84f408'} Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:09.351659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. Sep 03 20:57:09.355392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:09.359992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] Returning 404 to user: Instance 14a647f4-afcb-46cc-8329-e0357a84f408 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:09.361513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7abe18de-87e0-4eb4-ad06-35ed9cce3809 tempest-FloatingIPsAssociationTestJSON-1006754197 tempest-FloatingIPsAssociationTestJSON-1006754197-project] 10.222.0.16 "GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408" status: 404 len: 111 microversion: 2.1 time: 0.087623 Sep 03 20:57:09.361942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1166/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:09 2022] GET /compute/v2.1/servers/14a647f4-afcb-46cc-8329-e0357a84f408 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:57:09.444928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:09.446277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:09.454511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:09.455822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:09.456656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:09.457715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:09.458392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:09.459071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:09.971956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:09.990622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:09.995152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:09.997279 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63470bdc-9229-4568-b60a-561119b1d801 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1548 microversion: 2.25 time: 0.558307 Sep 03 20:57:09.999277 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1167/2276] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:09 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1548 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:10.021776 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74c5fd64-cfa0-4046-9381-70848195e154 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.048219 Sep 03 20:57:10.025710 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1110/2277] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:10.044527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5c4843de-256c-4765-95d6-c1c16a21a484 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Action: 'create', calling method: .version_select at 0x7fae66908820>, body: {"security_group": {"name": "tempest-securitygroup-136435513", "description": "tempest-description-304354739"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:10.288137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:10.288769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:10.311834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:10.313042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:10.313776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:10.314902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:10.315639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:10.316479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:10.547555 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5c4843de-256c-4765-95d6-c1c16a21a484 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.513916 Sep 03 20:57:10.548695 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1168/2278] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:10 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:10.559019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf9f6a0-a5cb-4458-8402-6600ef7605fe", "name": "network-vif-deleted", "tag": "f6c9c6fa-589a-463a-afdd-a5bbccade4e9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:10.583463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:10.584460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:10.585276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:10.608490 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] Creating event network-vif-deleted:f6c9c6fa-589a-463a-afdd-a5bbccade4e9 for instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe on nch2-master-1 Sep 03 20:57:10.625075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5acce56d-61e6-466c-b910-16ac96d2c9ce req-6b38846c-623c-4f8f-8ed6-aa6c65b315da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071170 Sep 03 20:57:10.628863 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1169/2279] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:10.637100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Calling method '.version_select at 0x7fae66907310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:10.847316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:10.861592 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2215eb3f-2d4c-47ff-a4d1-81765b7baa02 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1510 microversion: 2.1 time: 0.577749 Sep 03 20:57:10.864794 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1111/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:10 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:11.025396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:11.026826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:11.040473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:11.041501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:11.042132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:11.044240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:11.047704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:11.048715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:11.240927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:11.268378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:11.271077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:11.272490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4458a4f3-0c70-4371-bacd-98640f7ba5b6 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 200 len: 1331 microversion: 2.25 time: 0.252151 Sep 03 20:57:11.275343 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1112/2281] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:11 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:11.889266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:11.890248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:11.904955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:11.907731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:11.910155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:11.913107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:11.914309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:11.916062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:12.050595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=36 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:12.675054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:12.690411 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb3c04d6-e4c7-47e7-aafb-c5b36c8d15c9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1516 microversion: 2.1 time: 0.805919 Sep 03 20:57:12.697308 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1113/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:11 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1516 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:12.716158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:12.720136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: dbf9f6a0-a5cb-4458-8402-6600ef7605fe] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:12.755735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:12.760381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:12.761128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:12.761894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:12.771366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:12.772396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:12.830508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] HTTP exception thrown: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Request method failure captured: Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe HTTP/1.1 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE74meUZ28dSw00-WyDIxugmE6Wu6Na5I0Cyo8CZnQJ1_9qGzE5Dp6WKUzf_RXOhAq_EjrpmYtkXMU4fg310ZmqNj1Y_CQ4Wl4OnZD2Isrc2siCrScZ0h5_KVTCK8rlVjWylhayhuPgU9cGL6swkPkHskhcV9VeuW6VNlWjp7xHOlUYY Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.25 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_361f907a187547aabda6cb54eeeb3684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 778561ee5e474accb31816f357985f44 Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'dbf9f6a0-a5cb-4458-8402-6600ef7605fe'} Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. Sep 03 20:57:12.834747 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. Sep 03 20:57:12.837810 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:12.842371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Returning 404 to user: Instance dbf9f6a0-a5cb-4458-8402-6600ef7605fe could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:12.852574 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8fd35dc8-008b-434e-ade1-c6a336986922 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe" status: 404 len: 111 microversion: 2.25 time: 0.153192 Sep 03 20:57:12.867965 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1114/2283] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:12 2022] GET /compute/v2.1/servers/dbf9f6a0-a5cb-4458-8402-6600ef7605fe => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:57:12.895026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:12.898934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:12.927515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:12.928327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:12.929534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:12.933184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:12.934261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:12.935285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:13.038228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:57:13.305449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:13.321950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d870ef8b-cc85-477f-a959-29c25f15983b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 204 len: 0 microversion: 2.25 time: 0.441428 Sep 03 20:57:13.322542 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1115/2284] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:57:12 2022] DELETE /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:57:13.335068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:13.335777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:13.353869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:13.358316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:13.362862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:13.363351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:13.364105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:13.364572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:13.365034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:14.778711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:14.797371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:14.800242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:14.806214 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4249353c-f393-452c-8133-0d56a53314f9 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1563 microversion: 2.25 time: 1.475197 Sep 03 20:57:14.818225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1116/2285] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:13 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1563 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:14.831662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5cd27253-db29-48c0-93e6-c215499e0af3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: .version_select at 0x7fae67013d30>, body: {"keypair": {"name": "tempest-keypair-624382545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQmmc9i4zNeQlbfj6/Bwgh8NbIfs9aVXESpcUPgvgU5uUeitpDtN/Y0IixLaa5NpUZ+MmS/nSTWrpFGCYfWdc6VJT5o4xq1YWfKE86VZJc8tGZz0eC/0UzJtaujhIejiA=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:14.894284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5cd27253-db29-48c0-93e6-c215499e0af3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:14.919932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5cd27253-db29-48c0-93e6-c215499e0af3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for user db307623f73f4532a96342f551ba011c and project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:15.001363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5cd27253-db29-48c0-93e6-c215499e0af3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181768 Sep 03 20:57:15.003589 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1117/2286] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:15.835890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:15.838958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:15.888435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:15.889089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:15.889474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:15.890212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:15.890677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:15.891111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:16.384960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:16.398308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:16.406295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '778561ee5e474accb31816f357985f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361f907a187547aabda6cb54eeeb3684', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:16.407715 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c93da5c6-8806-483c-8937-3cda03b6951b tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 200 len: 1521 microversion: 2.25 time: 0.576836 Sep 03 20:57:16.409067 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1118/2287] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:15 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:57:16.852061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9bf4e577-fa8a-40f0-b39e-c2c23fbc0fa1 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae66e6f8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:16.963419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9bf4e577-fa8a-40f0-b39e-c2c23fbc0fa1 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11" status: 200 len: 371 microversion: 2.1 time: 0.549909 Sep 03 20:57:16.965782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1119/2288] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 20:57:16 2022] GET /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11 => generated 371 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:16.980270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60053839-fd83-4869-9c93-cc6ce1c6f6ee", "name": "network-vif-deleted", "tag": "4b3e9c56-57de-488b-8332-f75b77ef84b3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:17.005073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:17.007004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:17.017650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:17.052921 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] Creating event network-vif-deleted:4b3e9c56-57de-488b-8332-f75b77ef84b3 for instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee on nch1-master-1 Sep 03 20:57:17.064161 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8e6f87ab-3e34-42b2-b071-817b3aeb9340 req-091e9675-0113-4145-bada-e6ac35c703be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096351 Sep 03 20:57:17.077762 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1120/2289] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:17.083356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Action: 'update', calling method: .version_select at 0x7fae67026550>, body: {"quota_set": {"ram": "5120"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:17.181086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:17.182277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:17.182904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:17.183892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:17.184632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:17.185470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:17.296031 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bfc5bf49-164d-4e12-8f82-f5bffa884185 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11" status: 200 len: 328 microversion: 2.1 time: 0.216676 Sep 03 20:57:17.304065 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1121/2290] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:57:17 2022] PUT /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11 => generated 328 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:17.306474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e992e7db-e12b-41b0-be5e-f635f0bf6868 does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:57:17.307214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Neutron security group e992e7db-e12b-41b0-be5e-f635f0bf6868 not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:57:17.307908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.security_groups [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Security Group ID e992e7db-e12b-41b0-be5e-f635f0bf6868 does not exist {{(pid=140520) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 03 20:57:17.310347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cdc596e-73e7-483b-a332-b40b308c5f58 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:17.329137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cdc596e-73e7-483b-a332-b40b308c5f58 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11" status: 202 len: 0 microversion: 2.1 time: 0.023146 Sep 03 20:57:17.330100 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1122/2291] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 20:57:17 2022] DELETE /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:17.339250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e32c67d-010c-4cca-a794-238142bd4740 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae6b97c310>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:17.358379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e992e7db-e12b-41b0-be5e-f635f0bf6868 does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:57:17.359163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Neutron security group e992e7db-e12b-41b0-be5e-f635f0bf6868 not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:57:17.359871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.security_groups [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Security Group ID e992e7db-e12b-41b0-be5e-f635f0bf6868 does not exist {{(pid=140520) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 03 20:57:17.457450 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e32c67d-010c-4cca-a794-238142bd4740 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11" status: 200 len: 371 microversion: 2.1 time: 0.122526 Sep 03 20:57:17.466918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1123/2292] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 20:57:17 2022] GET /compute/v2.1/os-quota-sets/f7a9688e86564b39b3b7a800dff9cb11 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:17.480397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:17.489401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] [instance: 60053839-fd83-4869-9c93-cc6ce1c6f6ee] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:17.499107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:17.508488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:17.510416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:17.512864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:17.515867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:17.516498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:17.558188 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] HTTP exception thrown: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Request method failure captured: Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee HTTP/1.1 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE74meUZ28dSw00-WyDIxugmE6Wu6Na5I0Cyo8CZnQJ1_9qGzE5Dp6WKUzf_RXOhAq_EjrpmYtkXMU4fg310ZmqNj1Y_CQ4Wl4OnZD2Isrc2siCrScZ0h5_KVTCK8rlVjWylhayhuPgU9cGL6swkPkHskhcV9VeuW6VNlWjp7xHOlUYY Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.25 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_361f907a187547aabda6cb54eeeb3684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/361f907a187547aabda6cb54eeeb3684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 361f907a187547aabda6cb54eeeb3684 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 778561ee5e474accb31816f357985f44 Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1007400564-project Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '60053839-fd83-4869-9c93-cc6ce1c6f6ee'} Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. Sep 03 20:57:17.568433 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:57:17.571395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] Returning 404 to user: Instance 60053839-fd83-4869-9c93-cc6ce1c6f6ee could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:17.576804 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95b9de2d-f8cc-4916-9918-9590694534f1 tempest-LiveAutoBlockMigrationV225Test-1007400564 tempest-LiveAutoBlockMigrationV225Test-1007400564-project] 10.222.0.16 "GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee" status: 404 len: 111 microversion: 2.25 time: 0.096478 Sep 03 20:57:17.582866 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1124/2293] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:17 2022] GET /compute/v2.1/servers/60053839-fd83-4869-9c93-cc6ce1c6f6ee => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:57:17.673303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e3074dd-3851-455b-a17a-1ed3b5e40359 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae6b97cb80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:17.901645 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e3074dd-3851-455b-a17a-1ed3b5e40359 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.232791 Sep 03 20:57:17.913522 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1125/2294] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 20:57:17 2022] GET /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a/defaults => generated 371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:18.157224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Action: 'update', calling method: .version_select at 0x7fae67353550>, body: {"quota_set": {"ram": "5120"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:18.255091 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e9ced5d-73c1-4816-ae41-e503726ca868 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9231 microversion: 2.1 time: 7.624384 Sep 03 20:57:18.256027 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1170/2295] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Sep 3 20:57:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9231 bytes in 7626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:18.278007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ba46b90a-f17b-45a4-85fd-4c731427e63b tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] Calling method '.version_select at 0x7fae66963550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:18.367351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.368607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.369636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:18.370926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.372782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.373795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:18.382276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:18.443310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af57c72a-f557-4cf5-85ab-97a21aa342d2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e" status: 200 len: 328 microversion: 2.1 time: 0.289858 Sep 03 20:57:18.452572 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1126/2296] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 20:57:18 2022] PUT /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e => generated 328 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:18.459531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae6b97c820>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:18.558255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.559301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.560067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:18.561550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.562281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.562923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:18.589601 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24247257-4706-42fc-8e46-fb3dd1472810 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e/detail" status: 200 len: 916 microversion: 2.1 time: 0.134273 Sep 03 20:57:18.590841 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1127/2297] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:57:18 2022] GET /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e/detail => generated 916 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:18.726530 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ba46b90a-f17b-45a4-85fd-4c731427e63b tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.452137 Sep 03 20:57:18.727598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1171/2298] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Sep 3 20:57:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:18.744262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8eef630-a248-4a15-9774-a0016df51e6d tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Calling method '.version_select at 0x7fae67026670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:18.841564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Action: 'update', calling method: .version_select at 0x7fae668e2790>, body: {"quota_set": {"ram": "2048"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:18.967485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.968776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.970251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:18.971804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:18.973179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:18.974724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:19.059274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:19.060939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:19.061831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:19.068939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:19.069763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:19.070688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:19.227400 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-280a8fcc-7394-4eb2-93d0-2a161b99d596 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e?user_id=e6d25936a3154576ada571f8e0ca4369" status: 200 len: 328 microversion: 2.1 time: 0.390219 Sep 03 20:57:19.228650 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1172/2299] 10.222.0.16 () {60 vars in 1343 bytes} [Sat Sep 3 20:57:18 2022] PUT /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e?user_id=e6d25936a3154576ada571f8e0ca4369 => generated 328 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:19.242456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b45010a3-7e10-4c06-9d01-1601364531e2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae669635e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:19.368067 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b45010a3-7e10-4c06-9d01-1601364531e2 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e?user_id=e6d25936a3154576ada571f8e0ca4369" status: 200 len: 370 microversion: 2.1 time: 0.130018 Sep 03 20:57:19.369495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1173/2300] 10.222.0.16 () {58 vars in 1323 bytes} [Sat Sep 3 20:57:19 2022] GET /compute/v2.1/os-quota-sets/682deb5531564b5db5b94ebad74c6d4e?user_id=e6d25936a3154576ada571f8e0ca4369 => generated 370 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:19.584360 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8eef630-a248-4a15-9774-a0016df51e6d tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0b653e58-94b1-480e-b2fb-1988fc382971" status: 202 len: 0 microversion: 2.1 time: 0.845869 Sep 03 20:57:19.585206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1128/2301] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:18 2022] DELETE /compute/v2.1/os-security-groups/0b653e58-94b1-480e-b2fb-1988fc382971 => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:57:19.593406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3082a2c4-19cd-4656-a682-d4c6b7a72f31 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] Calling method '.version_select at 0x7fae669071f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:19.939303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5651d6fb-5564-4201-9b80-2abd6a3ba62d tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Calling method '.version_select at 0x7fae6b8553a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:20.292867 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5651d6fb-5564-4201-9b80-2abd6a3ba62d tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.357633 Sep 03 20:57:20.293479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1129/2302] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 20:57:19 2022] GET /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a/defaults => generated 371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:20.306240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Action: 'update', calling method: .version_select at 0x7fae6b8ad8b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:20.407198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:20.409906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:20.410548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:20.415584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:20.416135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:20.416624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:20.527040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3082a2c4-19cd-4656-a682-d4c6b7a72f31 tempest-SecurityGroupsTestAdminJSON-24301330 tempest-SecurityGroupsTestAdminJSON-24301330-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9d7f54d7-e429-459e-87d1-9d097fb716e9" status: 202 len: 0 microversion: 2.1 time: 0.937036 Sep 03 20:57:20.530358 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1174/2303] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:19 2022] DELETE /compute/v2.1/os-security-groups/9d7f54d7-e429-459e-87d1-9d097fb716e9 => generated 0 bytes in 942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:57:20.560145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9941a79a-105c-499c-af99-9e6dee5f280d tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] Calling method '.version_select at 0x7fae66a04ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:20.766702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=15,nova_api:DELETE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:20.870809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-665c804c-6a01-4b36-a48f-ea0b462a1ec9 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a" status: 200 len: 329 microversion: 2.1 time: 0.568288 Sep 03 20:57:20.879668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1130/2304] 10.222.0.16 () {60 vars in 1263 bytes} [Sat Sep 3 20:57:20 2022] PUT /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a => generated 329 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:20.896361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Action: 'update', calling method: .version_select at 0x7fae67295160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:21.047301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:21.048298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:21.049019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:21.050218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:21.053211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:21.053819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:21.546444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9941a79a-105c-499c-af99-9e6dee5f280d tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5b882134-4fb5-4561-b1e1-115d9c82929c" status: 202 len: 0 microversion: 2.1 time: 1.004445 Sep 03 20:57:21.547359 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1175/2305] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:20 2022] DELETE /compute/v2.1/os-security-groups/5b882134-4fb5-4561-b1e1-115d9c82929c => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:21.556361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df0f530e-1b75-43e6-87a3-a3c18e8fa9fd tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] Calling method '.version_select at 0x7fae66907280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:21.673336 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4897a0c5-0f6e-4579-844a-b588bcca4d78 tempest-QuotasAdminTestJSON-453852387 tempest-QuotasAdminTestJSON-453852387-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a" status: 200 len: 329 microversion: 2.1 time: 0.785485 Sep 03 20:57:21.687222 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1131/2306] 10.222.0.16 () {60 vars in 1263 bytes} [Sat Sep 3 20:57:20 2022] PUT /compute/v2.1/os-quota-sets/df8d15077d42417ca165bf7400c3b87a => generated 329 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:21.695175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1608765182", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "238bcf65-9e8e-49f1-a53b-a322f79ca876"}], "security_groups": [{"name": "tempest-securitygroup--324250954"}], "key_name": "tempest-keypair-624382545", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:22.042979 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df0f530e-1b75-43e6-87a3-a3c18e8fa9fd tempest-SecurityGroupsTestAdminJSON-558083554 tempest-SecurityGroupsTestAdminJSON-558083554-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c7e05058-72de-483d-98fd-02890099350f" status: 202 len: 0 microversion: 2.1 time: 0.490735 Sep 03 20:57:22.044176 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1176/2307] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:21 2022] DELETE /compute/v2.1/os-security-groups/c7e05058-72de-483d-98fd-02890099350f => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:57:22.105198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] validate_networks() for [('238bcf65-9e8e-49f1-a53b-a322f79ca876', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:57:22.499562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e491d414-3d1f-4c2c-9ea4-095e41cf757b tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae669633a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-272028572", "description": "tempest-description-1204021413"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:22.922767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e491d414-3d1f-4c2c-9ea4-095e41cf757b tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.877166 Sep 03 20:57:22.923705 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1177/2308] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:23.083084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:23.083520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:23.084065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:23.084484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:23.084976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:23.100063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:23.103244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:23.105354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:23.106889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:23.107515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:23.108099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:23.137964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:23.146891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Getting quotas for user db307623f73f4532a96342f551ba011c and project a7715a4d463a44168bc78b9fa7a7718f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:23.156427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:23.166187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:57:23.168917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:57:23.253727 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1526b534-320c-4b78-a88e-9b906a942061 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.565048 Sep 03 20:57:23.256933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1132/2309] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:57:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:57:23.268969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a42c4973-7c8d-4c1b-9ca5-d87d3890ff50 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae6b8ad040>, body: {"security_group_rule": {"parent_group_id": "9b1ea990-da18-4865-a203-b9d75cd0dce3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:23.273074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e9db03e-c6a2-4930-a766-82bd5a434f82 tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] Action: 'create', calling method: .version_select at 0x7fae6686fd30>, body: {"keypair": {"name": "tempest-keypair-1778769616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb+Vqcq1700oIci0lIT6ur0PS84o6g4DAaak0XysUWhJQu86L/fdQ0GEZBURl3bXyMr4uhHSlTmiRGO2h/Sm7g5pafOsV6GJ9q2tklV+cOZwZj6vCJ8KzBFhUOVyaydYw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:23.348330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3e9db03e-c6a2-4930-a766-82bd5a434f82 tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] Getting quotas for project 5500274fc1834f768e8659be97e4004c. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:23.356738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3e9db03e-c6a2-4930-a766-82bd5a434f82 tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] Getting quotas for user f40d4376bec042e49ee8356e22baa812 and project 5500274fc1834f768e8659be97e4004c. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:23.413425 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e9db03e-c6a2-4930-a766-82bd5a434f82 tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.487341 Sep 03 20:57:23.414856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1178/2310] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:57:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:23.426733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8efbd853-939c-4a42-9da7-40ea6c59cbcf tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:23.441092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8efbd853-939c-4a42-9da7-40ea6c59cbcf tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:23.664338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8efbd853-939c-4a42-9da7-40ea6c59cbcf tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:23.678532 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8efbd853-939c-4a42-9da7-40ea6c59cbcf tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1245 microversion: 2.1 time: 0.259906 Sep 03 20:57:23.681628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1179/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:23 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1245 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:23.973585 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a42c4973-7c8d-4c1b-9ca5-d87d3890ff50 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.712398 Sep 03 20:57:23.975260 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1133/2312] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:23.989149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b93fd123-bcb0-47b2-850f-fd04b6cf5485 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae66874e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1276547544", "description": "tempest-description-1127015890"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:24.495394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b93fd123-bcb0-47b2-850f-fd04b6cf5485 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.511434 Sep 03 20:57:24.496186 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1180/2313] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:24.512180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76e5f304-e0d2-4ce7-93b3-1ad17f38246f tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae671463a0>, body: {"security_group_rule": {"parent_group_id": "b1f0fa83-bff9-4b7f-9cde-9de445a43a5c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:24.706756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:24.707606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:24.736281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:24.738386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:24.738858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:24.743194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:24.748778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:24.749450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:25.128591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:25.145208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53228705-2ffe-4e40-9e5d-782a2866df83 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1297 microversion: 2.1 time: 0.443470 Sep 03 20:57:25.146772 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1181/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:24 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1297 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:26.084383 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76e5f304-e0d2-4ce7-93b3-1ad17f38246f tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.577058 Sep 03 20:57:26.085088 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1134/2315] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:26.099636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e013d41-ac5d-47de-8625-945787b561e2 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae66a04160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1035379367", "description": "tempest-description-1916254002"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:26.181266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:26.183565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:26.198815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:26.200102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:26.200767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:26.201705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:26.202481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:26.203323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:26.420100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:26.435232 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cf5186c-b34d-44ce-abfd-105dc97ac4fa tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1303 microversion: 2.1 time: 0.263988 Sep 03 20:57:26.436151 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1135/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:26 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:27.093369 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e013d41-ac5d-47de-8625-945787b561e2 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.998009 Sep 03 20:57:27.096817 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1182/2317] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:27.110054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-591bdfc2-7692-4d4d-bf1e-caaff31c1c1c tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae6b8add30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1550487381", "description": "tempest-description-1855885619"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:27.459351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:27.460160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:27.483889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:27.484693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:27.485334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:27.487116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:27.487767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:27.488389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:28.658796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:28.681763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8405de4-e5fb-43b9-b59a-acf9904e0600 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1303 microversion: 2.1 time: 1.226493 Sep 03 20:57:28.684511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1183/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:27 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1303 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:29.275856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-591bdfc2-7692-4d4d-bf1e-caaff31c1c1c tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.169169 Sep 03 20:57:29.275856 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1136/2319] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:29.296396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0890f8a-ac5c-443a-bd82-7f6fd046bd6f tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae66908820>, body: {"security_group_rule": {"parent_group_id": "34d51c98-c3cc-46fd-861c-db838d22caff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "39405143-f4cd-40b7-98c8-6785824c1dca"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:29.315183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:29.711980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:29.713131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:29.754020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:29.757106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:29.758505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:29.762211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:29.763394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:29.765927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:30.183439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:30.205556 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-074f10cf-684a-417f-bfff-9b0a059f71ab tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.499315 Sep 03 20:57:30.220308 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1137/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:29 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:30.905170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1767239169", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:30.923491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=19,nova_api:UPDATE=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:30.988372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:57:30.994266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c0890f8a-ac5c-443a-bd82-7f6fd046bd6f tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.702741 Sep 03 20:57:30.997621 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1184/2321] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:29 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:31.104519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2004773763", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:31.193594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:31.194426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:31.195132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:31.197090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:31.197786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:31.217667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.218168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.218699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:31.219741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.221392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.221988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:31.248792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Getting quotas for project 0c65af796be74447b2bbba4e8b9d4f35. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:31.255658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Getting quotas for user 9baf371d1c0942eda0b4ea9466b03b79 and project 0c65af796be74447b2bbba4e8b9d4f35. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:31.272325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:57:31.275104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:57:31.346643 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75be0c86-2d4f-43dd-becd-f25df1814ff6 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.347349 Sep 03 20:57:31.353734 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1185/2322] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 20:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 20:57:31.358766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20c2d54c-f4de-4ac2-bc08-5c5bd6fda98d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae668dd430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2121182462", "description": "tempest-description-1617859703"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:31.529861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:31.530295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:31.530780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:31.531200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:31.531626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:31.548073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.548622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.549101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:31.552545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.553229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.556063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:31.617679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:31.643221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for user 0c77fca40dbc430db41e4a30639b28b5 and project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:31.677471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:57:31.680232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:57:31.789331 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-956e3255-fedd-4b79-b1b0-a12c47f1239d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173740 Sep 03 20:57:31.793460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1138/2323] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:57:31.821544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:31.824484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:31.847252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.850793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.851349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:31.857064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:31.864582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:31.872156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:32.659036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:32.667445 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-79226249-6dbd-4cb3-9f87-d92fd13cee14 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.872810 Sep 03 20:57:32.668039 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1139/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:31 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:32.688700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:32.696808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:32.714231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:32.714749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:32.715206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:32.715942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:32.716413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:32.716851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:32.868869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:32.882894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:32.887174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:32.901531 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4b25816-cd2c-4321-930b-cc034da686dc tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "PUT /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1355 microversion: 2.75 time: 0.220216 Sep 03 20:57:32.928573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1140/2325] 10.222.0.16 () {62 vars in 1297 bytes} [Sat Sep 3 20:57:32 2022] PUT /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1355 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:32.940308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1098037815", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:33.007312 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20c2d54c-f4de-4ac2-bc08-5c5bd6fda98d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.657690 Sep 03 20:57:33.017344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1186/2326] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:33.023221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:33.032394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:33.038335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:33.051331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.051937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.055554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.057310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.060508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.064836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.071748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:57:33.252970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:33.262934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:33.264398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:33.280403 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8e38637-276c-44e7-80a5-0bd8eacab326 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1411 microversion: 2.75 time: 0.261124 Sep 03 20:57:33.281020 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1187/2327] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:33 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:33.290088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00a8e936-92d9-4639-88d2-c206e45ba243 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae668dd820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-456981684", "description": "tempest-description-67002207"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:33.392787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:33.393730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:33.394593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:33.395163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:33.395829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:33.415094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.415808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.416437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.417395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.418019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.418610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.472455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:33.479535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for user 0c77fca40dbc430db41e4a30639b28b5 and project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:33.503062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:57:33.506531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:57:33.577980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1e7822dd-cb7f-4710-bb92-8a75448265a5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647556 Sep 03 20:57:33.609135 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1141/2328] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:57:33.619779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcade07-def5-44a5-a548-8f7c952914f1", "tag": "ba1680a6-779b-4252-a9c6-0f65c700406f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:33.651231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.653640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.656438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.695344 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] Creating event network-changed:ba1680a6-779b-4252-a9c6-0f65c700406f for instance cbcade07-def5-44a5-a548-8f7c952914f1 on nch1-master-1 Sep 03 20:57:33.705512 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-220b666c-d76d-426e-af14-cbaf75a0ded3 req-da276549-c9fd-48c3-a0bb-cecb4a5183e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092381 Sep 03 20:57:33.707195 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1142/2329] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:33.718739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65bc3a16-d9f0-43d9-9018-9c17f1fd389f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:33.722915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-65bc3a16-d9f0-43d9-9018-9c17f1fd389f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:33.847892 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00a8e936-92d9-4639-88d2-c206e45ba243 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.562669 Sep 03 20:57:33.849180 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1188/2330] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:33 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:33.865337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:33.866946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:33.876959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.880019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.880626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.882901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:33.884835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:33.886156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:33.896686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-65bc3a16-d9f0-43d9-9018-9c17f1fd389f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:33.914125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65bc3a16-d9f0-43d9-9018-9c17f1fd389f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1214 microversion: 2.1 time: 0.199921 Sep 03 20:57:33.915116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1143/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:33 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:33.934900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8f11590-1c0e-4261-9c76-b36930c8acf0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae6b855820>, body: {"security_group_rule": {"parent_group_id": "f361df02-a429-4014-84ff-e3b24eb57abb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8b691d9e-6b9e-4b87-8ae2-028352442114"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:34.400690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8f11590-1c0e-4261-9c76-b36930c8acf0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.469802 Sep 03 20:57:34.401339 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1144/2332] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:33 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:34.414279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:34.415089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:34.429702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:34.430461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:34.431056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:34.432034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:34.432803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:34.433534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:34.566433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:34.579519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:34.581888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:34.589247 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90f754e2-e9c9-4bf4-9a5f-510fd13ac430 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1417 microversion: 2.75 time: 0.179044 Sep 03 20:57:34.590464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1145/2333] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:34 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1417 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:34.606547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd28f52c-898e-4962-83f1-67c258c8a045 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae667b7280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:34.748742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:34.764030 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07125475-d96c-4f25-8624-cd21c5c74925 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.913445 Sep 03 20:57:34.767873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1189/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:33 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:34.944917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:34.945737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:34.954472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:34.955368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:34.956112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:34.957084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:34.958418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:34.959175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:35.081165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:35.092199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94a6254e-e429-4bb3-a33a-01332e94e66b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1266 microversion: 2.1 time: 0.151150 Sep 03 20:57:35.094699 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1190/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:34 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:35.363635 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd28f52c-898e-4962-83f1-67c258c8a045 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8b691d9e-6b9e-4b87-8ae2-028352442114" status: 202 len: 0 microversion: 2.1 time: 0.771741 Sep 03 20:57:35.364311 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1146/2336] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:34 2022] DELETE /compute/v2.1/os-security-groups/8b691d9e-6b9e-4b87-8ae2-028352442114 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:35.373068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b31f07e-4279-41b0-9281-f3feb59e8a04 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae6688d5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:35.625714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:35.626740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:35.636284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:35.643326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:35.644426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:35.647683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:35.648457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:35.649176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:35.694409 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b31f07e-4279-41b0-9281-f3feb59e8a04 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/f361df02-a429-4014-84ff-e3b24eb57abb" status: 200 len: 248 microversion: 2.1 time: 0.325567 Sep 03 20:57:35.694996 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1191/2337] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 20:57:35 2022] GET /compute/v2.1/os-security-groups/f361df02-a429-4014-84ff-e3b24eb57abb => generated 248 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:35.712126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5363064b-c362-44d6-9e8a-574cfa175d58 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae668fb4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1226508162", "description": "tempest-description-445082772"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:35.926214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:35.943623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:35.945592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:35.954127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-baa39751-fcbc-4971-83de-2b8f0cf7d73b tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1417 microversion: 2.75 time: 0.334494 Sep 03 20:57:35.956359 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1147/2338] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:35 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1417 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:35.970064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:35.971822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:35.988110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:35.989796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:35.990585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:35.991473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:35.999318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:35.999803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:36.152346 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5363064b-c362-44d6-9e8a-574cfa175d58 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.446084 Sep 03 20:57:36.153109 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1192/2339] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 20:57:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:36.159960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:36.160716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:36.186170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:36.186808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:36.187332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:36.188138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:36.188672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:36.189863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:36.303492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:36.317899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09742aa2-2f87-4989-89e5-6871428bcfc6 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1272 microversion: 2.1 time: 0.163509 Sep 03 20:57:36.318494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1193/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:36 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:36.324600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4a22920d-90e8-4bcf-966a-594765981ea6 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae6688d670>, body: {"security_group_rule": {"parent_group_id": "9beafe40-f651-4022-94be-a6563854deba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:36.625833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:36.635841 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-100184b5-26a3-49ee-82b2-cee52566cc9f tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.677490 Sep 03 20:57:36.643103 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1148/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:35 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:36.973968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4a22920d-90e8-4bcf-966a-594765981ea6 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.653914 Sep 03 20:57:36.974563 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1194/2342] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:36.988274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:36.989445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:37.003194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-846c4212-4512-426e-b72e-83030f8f8a6d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Action: 'create', calling method: .version_select at 0x7fae66896940>, body: {"security_group_rule": {"parent_group_id": "9beafe40-f651-4022-94be-a6563854deba", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:37.032419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.033174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.034030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.035690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.038272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.039006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.363808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:37.386882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:37.390194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:37.397097 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b12d18d4-1ddf-4d79-aa67-7f2ce92a2e10 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1438 microversion: 2.75 time: 0.413054 Sep 03 20:57:37.398235 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1149/2343] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:36 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1438 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:37.418893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:37.419694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:37.438022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.438814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.439499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.441423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.442051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.442667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.552772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:37.565351 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a5afa7f-6cd7-4d17-b510-49a9adb08907 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1272 microversion: 2.1 time: 0.165736 Sep 03 20:57:37.566782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1150/2344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:37 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:37.588071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:37.594857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:37.606909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.609036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.614772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.615079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.615520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.618701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.833767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:37.840208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:37.841386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:37.842538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:37.852449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:37.988441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:37.995744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.996400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.997165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:37.998437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:37.999033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:37.999634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:38.107367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.119809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.125211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.141537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0baa9bff-478f-4aec-96ad-6cd8dcf71425 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "POST /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c/action" status: 202 len: 1495 microversion: 2.75 time: 0.562829 Sep 03 20:57:38.143968 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1151/2345] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:57:37 2022] POST /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c/action => generated 1495 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 03 20:57:38.162382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:38.163358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:38.179065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:38.179581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:38.180024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:38.180751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:38.181256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:38.182012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:38.299499 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-846c4212-4512-426e-b72e-83030f8f8a6d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.300812 Sep 03 20:57:38.301099 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1195/2346] 10.222.0.16 () {60 vars in 1195 bytes} [Sat Sep 3 20:57:36 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:38.308644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:38.308644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:38.337252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:38.337767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:38.341138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:38.342828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:38.343439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:38.344278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:38.518474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.549375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.554620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.572412 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e89a7fb9-7abe-485a-ac5e-7f89fbe1b412 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.270128 Sep 03 20:57:38.573790 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1196/2347] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:38 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:38.602105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6da07ccc-2c91-4957-858c-a02d66e4869d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae668fb5e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:38.977535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:38.986992 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e309030b-4492-4a93-a82b-2622b2a8fa2d tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.841769 Sep 03 20:57:38.998339 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1152/2348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:38 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:39.004838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:39.005671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:39.019694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:39.020470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:39.021092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:39.022558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:39.033605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:39.034241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:39.034540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6da07ccc-2c91-4957-858c-a02d66e4869d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/9beafe40-f651-4022-94be-a6563854deba" status: 200 len: 664 microversion: 2.1 time: 0.458892 Sep 03 20:57:39.035235 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1197/2349] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 20:57:38 2022] GET /compute/v2.1/os-security-groups/9beafe40-f651-4022-94be-a6563854deba => generated 664 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:39.058636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-824ade39-cf1f-4b1e-99ae-64bcf7fe112d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae66936280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:39.170786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:39.173640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:39.188814 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2b5cabe-07ea-48f9-a567-7e1fd6f0dd1b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1272 microversion: 2.1 time: 0.189162 Sep 03 20:57:39.189979 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1153/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:38 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:39.605631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:39.606539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:39.618264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:39.619097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:39.619743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:39.625950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:39.627300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:39.627949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:39.767217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:39.778061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:39.791973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:39.804284 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59f06fa4-96ce-427e-9099-12d2ec91140c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.202475 Sep 03 20:57:39.838098 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1154/2351] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:39 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:57:39.892987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f418a14-c2a7-4495-85ca-22f600a66d65", "tag": "434c214a-3a8a-4c83-ae50-679a35739a55"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:39.906450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:39.906945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:39.907385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:39.973726 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] Creating event network-changed:434c214a-3a8a-4c83-ae50-679a35739a55 for instance 9f418a14-c2a7-4495-85ca-22f600a66d65 on nch2-master-1 Sep 03 20:57:40.014165 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2c868eb7-701c-47d2-9cf0-5e82da0d4b49 req-09e5b19f-56a6-4ba4-a747-c322578b9c64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123994 Sep 03 20:57:40.021407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1155/2352] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:40.071481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:40.074517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:40.157636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:40.160883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:40.162985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:40.163788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:40.164275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:40.164719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:40.389962 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-824ade39-cf1f-4b1e-99ae-64bcf7fe112d tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/946962b5-9424-41d7-b6d1-c41366cb6b6c" status: 202 len: 0 microversion: 2.1 time: 1.342028 Sep 03 20:57:40.398144 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1198/2353] 10.222.0.16 () {58 vars in 1287 bytes} [Sat Sep 3 20:57:39 2022] DELETE /compute/v2.1/os-security-group-rules/946962b5-9424-41d7-b6d1-c41366cb6b6c => generated 0 bytes in 1351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:40.404116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:40.405515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:40.422376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:40.423887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:40.424585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:40.428107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:40.428784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:40.429350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:40.440114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=63 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:40.741028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:40.759063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8a51913-7366-4b56-9f25-9982acaa3439 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.730752 Sep 03 20:57:40.760584 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1156/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:40 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:40.768694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-10c2efdf-cb79-4cd4-bb05-f1bf0b6dbb6a tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae6b893160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:41.237915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:41.273896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=28 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:41.493607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-10c2efdf-cb79-4cd4-bb05-f1bf0b6dbb6a tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9beafe40-f651-4022-94be-a6563854deba" status: 202 len: 0 microversion: 2.1 time: 0.730617 Sep 03 20:57:41.496607 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1157/2355] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:40 2022] DELETE /compute/v2.1/os-security-groups/9beafe40-f651-4022-94be-a6563854deba => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:41.505620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:41.507577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:41.529562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:41.536327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:41.540625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:41.549954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:41.550822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:41.551489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:41.592339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:41.618398 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0dae1841-fb05-4649-bc83-6c5e06efd44b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 1.214134 Sep 03 20:57:41.625230 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1199/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:40 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:41.635579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcade07-def5-44a5-a548-8f7c952914f1", "name": "network-vif-plugged", "status": "completed", "tag": "ba1680a6-779b-4252-a9c6-0f65c700406f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:41.671283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:41.673684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:41.674452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:41.688052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] Creating event network-vif-plugged:ba1680a6-779b-4252-a9c6-0f65c700406f for instance cbcade07-def5-44a5-a548-8f7c952914f1 on nch1-master-1 Sep 03 20:57:41.694687 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5c92ece7-a3cf-4b05-8f60-4fabb9abf92e req-d1b39848-c405-40e1-b61b-d46be4d40345 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067788 Sep 03 20:57:41.695851 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1200/2357] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:41.703053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae66896790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:41.746614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:41.764398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:41.766203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:41.778536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aebe32b4-e6b8-4ed1-8cf0-3abe441f6813 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.279703 Sep 03 20:57:41.779135 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1158/2358] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:41 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:41.786203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:41.787030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:41.795567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:41.796433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:41.797115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:41.809139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:41.810029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:41.819036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:41.958476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:57:41.958632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Neutron security group 8b691d9e-6b9e-4b87-8ae2-028352442114 not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:57:41.959770 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] HTTP exception thrown: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.959770 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Request method failure captured: Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-security-groups/8b691d9e-6b9e-4b87-8ae2-028352442114 HTTP/1.1 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-xtfLI3DnX076ByD84xxB3DS1dPdONRS_iXYHIFMVqvBJI_Ng97LT4aqHHpJDh2Ol9-G4SsNU4sjcXptZjTD75JXncfPmnH_pEHdGxcmt6Qq8lqAWQIvWkK4s0IJ35FDErEaEh9uX76lKJFtO-AnKzd3iN8dffz6FbD1oEMUjhS4w Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42f287c9b2f24f4a94002ca61190c12d Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1032619023 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f287c9b2f24f4a94002ca61190c12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42f287c9b2f24f4a94002ca61190c12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42f287c9b2f24f4a94002ca61190c12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42f287c9b2f24f4a94002ca61190c12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1032619023 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42f287c9b2f24f4a94002ca61190c12d Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1032619023 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupRulesTestJSON-1032619023-project Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3da1337b27b64e008b26a2c464578913 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1032619023-project Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '8b691d9e-6b9e-4b87-8ae2-028352442114'} Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:57:41.962141 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] Sep 03 20:57:41.965873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:57:41.971541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Returning 404 to user: Security group 8b691d9e-6b9e-4b87-8ae2-028352442114 does not exist Sep 03 20:57:41.971541 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-0da60346-3e73-48d3-8f54-67a5575c9273'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:57:41.972701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c2eab8a6-4491-43a0-bfb6-beb5aead28be tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8b691d9e-6b9e-4b87-8ae2-028352442114" status: 404 len: 194 microversion: 2.1 time: 0.275442 Sep 03 20:57:41.976865 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1201/2359] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:41 2022] DELETE /compute/v2.1/os-security-groups/8b691d9e-6b9e-4b87-8ae2-028352442114 => generated 194 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:57:41.986172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e493501b-1218-43a9-b513-b5685af195c0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae669569d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:42.086725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:42.108534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02fde0b5-b0d7-4ec7-8cf2-b4e57a665ebb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.327995 Sep 03 20:57:42.110071 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1159/2360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:41 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:42.129613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55cce66-5224-49ba-95a4-33f77168d196", "tag": "bd2e12f1-ea0c-410e-adc0-8a5a6b38a160"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:42.144125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:42.144806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:42.145429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:42.167644 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] Creating event network-changed:bd2e12f1-ea0c-410e-adc0-8a5a6b38a160 for instance f55cce66-5224-49ba-95a4-33f77168d196 on nch1-master-1 Sep 03 20:57:42.174387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-54da078d-214b-48c0-ace6-9d49905df877 req-2b4ad16c-8041-4f3d-a595-d836db44dfd7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062247 Sep 03 20:57:42.175210 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1160/2361] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:42.657210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:42.659544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:42.666330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:42.667189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:42.667857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:42.680068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:42.682250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:42.682730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:42.911407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:42.922618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f35d5b14-5fbb-4683-bc92-1d2066c92930 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.269594 Sep 03 20:57:42.923435 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1161/2362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:42 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:42.929935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:42.930940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:42.937967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:42.939191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:42.940171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:42.941121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:42.945628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:42.946363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:42.969858 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e493501b-1218-43a9-b513-b5685af195c0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/f361df02-a429-4014-84ff-e3b24eb57abb" status: 202 len: 0 microversion: 2.1 time: 0.991655 Sep 03 20:57:42.971703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1202/2363] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:41 2022] DELETE /compute/v2.1/os-security-groups/f361df02-a429-4014-84ff-e3b24eb57abb => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:42.981423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9bfd295-ae66-4aaa-b86c-8d42718a95bc tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae66908dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:43.092722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:43.110554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:43.112488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:43.127720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16907456-621a-4a84-8950-7741ca9fa2dd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.199948 Sep 03 20:57:43.157659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1162/2364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:42 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:43.164222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:43.165560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:43.174962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:43.176234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:43.177425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:43.178453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:43.179274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:43.179862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:43.398059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:43.412064 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88da474e-6713-4778-8896-41981fcd6d13 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.252410 Sep 03 20:57:43.412988 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1163/2365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:43 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:43.955649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:43.957179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:43.965712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:43.967502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:43.969832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:43.970404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:43.970920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:43.971706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:43.972274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:43.972790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:44.133434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:44.147447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e4ce3299-9184-428a-8aad-edeb2d40b98c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.200291 Sep 03 20:57:44.148380 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1164/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:43 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:44.162089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:44.163641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:44.174846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:44.175902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:44.176514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:44.178020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:44.178643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:44.179224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:44.191273 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9bfd295-ae66-4aaa-b86c-8d42718a95bc tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39405143-f4cd-40b7-98c8-6785824c1dca" status: 202 len: 0 microversion: 2.1 time: 1.214135 Sep 03 20:57:44.191961 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1203/2367] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:42 2022] DELETE /compute/v2.1/os-security-groups/39405143-f4cd-40b7-98c8-6785824c1dca => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:44.199759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1fec152-bdb3-4978-bef5-a273983c67c0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae66956c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:44.255232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:44.268449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:44.270133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:44.273185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:44.277007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-433beb34-db44-4568-b9e0-0c7fd513e9e5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.120592 Sep 03 20:57:44.277863 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1165/2368] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:44 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:44.436399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:44.437244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:44.446135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:44.446714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:44.447532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:44.448710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:44.449281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:44.449777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:44.630838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:44.643123 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a6b15d62-cf9d-4027-8215-dd86019f7767 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.210850 Sep 03 20:57:44.644430 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1166/2369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:44 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:44.949626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1fec152-bdb3-4978-bef5-a273983c67c0 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34d51c98-c3cc-46fd-861c-db838d22caff" status: 202 len: 0 microversion: 2.1 time: 0.753483 Sep 03 20:57:44.953577 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1204/2370] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:44 2022] DELETE /compute/v2.1/os-security-groups/34d51c98-c3cc-46fd-861c-db838d22caff => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:44.959419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32932cba-1bab-4c0f-9fdc-f0325a5f40a8 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae6b8ada60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:45.173116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:45.174630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:45.186739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.188485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.190035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.190968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.193381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.194425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.617431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:45.629266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0f6cec6-e049-4aea-b6db-cdcf66057476 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.462745 Sep 03 20:57:45.632021 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1205/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:45 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:57:45.652560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:45.653481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:45.663364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.664691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.665459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.666445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.667147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.667807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.676307 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32932cba-1bab-4c0f-9fdc-f0325a5f40a8 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b1f0fa83-bff9-4b7f-9cde-9de445a43a5c" status: 202 len: 0 microversion: 2.1 time: 0.721534 Sep 03 20:57:45.677337 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1167/2372] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:44 2022] DELETE /compute/v2.1/os-security-groups/b1f0fa83-bff9-4b7f-9cde-9de445a43a5c => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:45.682793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:45.683612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:45.711930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.717121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.719783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.720757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:45.724989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:45.726853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:45.832524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:45.846686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:45.852132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:45.877778 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4979c7a-0f0b-4324-bb72-4b00732ad04c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.227870 Sep 03 20:57:45.895100 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1206/2373] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:45 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:45.928236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bae18554-bc09-4dc9-b3b1-9ff2a72861d2 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] Calling method '.version_select at 0x7fae66a04700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:46.399797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:46.414926 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1309878b-9c6d-4a55-8a27-8e518b6a94b3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1370 microversion: 2.1 time: 0.733270 Sep 03 20:57:46.415689 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1168/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:45 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1370 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:46.660246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:46.661445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:46.690772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:46.691563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:46.692169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:46.693118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:46.694054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:46.695226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.054743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:47.081394 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa29d8a2-17c0-46bb-bd83-8c3d0187b5ec tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.427878 Sep 03 20:57:47.089360 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1169/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:46 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:47.100164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:47.101404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:47.107880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:47.108631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:47.109262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.110152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:47.110971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:47.111561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.164705 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bae18554-bc09-4dc9-b3b1-9ff2a72861d2 tempest-SecurityGroupRulesTestJSON-1032619023 tempest-SecurityGroupRulesTestJSON-1032619023-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9b1ea990-da18-4865-a203-b9d75cd0dce3" status: 202 len: 0 microversion: 2.1 time: 1.257597 Sep 03 20:57:47.166110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1207/2376] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:57:45 2022] DELETE /compute/v2.1/os-security-groups/9b1ea990-da18-4865-a203-b9d75cd0dce3 => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:47.421143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:47.442692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:47.444392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:47.471873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:47.475584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:47.476089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:47.477420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:47.479741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.483384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:47.485132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:47.486889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.506399 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a366f69-2b1d-49b5-bc24-59577f856712 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.412966 Sep 03 20:57:47.507954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1170/2377] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:47 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:47.918098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:47.942471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-713cfdc2-a587-4a37-a22f-de63e15c9df1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1564 microversion: 2.1 time: 0.503178 Sep 03 20:57:47.946793 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1208/2378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:47 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1564 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:47.973513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:47.974008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:47.988690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:47.997726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:47.997726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:47.998365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.006155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.008088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.105653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:48.106579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:48.125787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.126390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.127638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.129710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.131055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.132672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.525795 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c35f3b0f-c2d6-4078-87e2-870590ecc70a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.556674 Sep 03 20:57:48.526995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1171/2379] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:57:47 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1/os-interface => generated 284 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:48.535177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f418a14-c2a7-4495-85ca-22f600a66d65", "name": "network-vif-plugged", "status": "completed", "tag": "434c214a-3a8a-4c83-ae50-679a35739a55"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:48.562711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.565024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.565489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.619808 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] Creating event network-vif-plugged:434c214a-3a8a-4c83-ae50-679a35739a55 for instance 9f418a14-c2a7-4495-85ca-22f600a66d65 on nch2-master-1 Sep 03 20:57:48.660939 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4189029b-f75f-4d3d-aa14-fd1babc3ecd2 req-31cb15b8-c92e-498d-824b-c9d340619bec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128973 Sep 03 20:57:48.670667 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1172/2380] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:48.681774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:48.682373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:48.714747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.716148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.718613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.720761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:48.724332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:48.725082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:48.890001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:48.902298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:48.906457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:48.918610 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a52545f-8f0a-4924-93cc-b7868d2af353 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.245980 Sep 03 20:57:48.921595 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1173/2381] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:48 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:49.113782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:49.121796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e4187f9e-3bdd-4341-93f9-7a9cd26f0259 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 1.022004 Sep 03 20:57:49.125630 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1209/2382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:48 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:49.952915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:49.954344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:49.965359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:49.966119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:49.966728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:49.967607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:49.968217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:49.969329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:50.053520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:50.058793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:50.070189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:50.077621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:50.087421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-faca5e01-7ec7-4767-adda-44ce36cefdeb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.139133 Sep 03 20:57:50.088628 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1174/2383] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:49 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:50.155844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:50.158357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:50.181175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:50.181927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:50.182543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:50.183439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:50.184062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:50.184500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:50.819868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:50.828807 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d85ecfd-4599-4d78-972c-71f11a807a7f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.679728 Sep 03 20:57:50.830778 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1210/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:50 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:51.122105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:51.128000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:51.159313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:51.161394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:51.162651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:51.164172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:51.171353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:51.171982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:51.310458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:51.320787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:51.328578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:51.340265 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4bb07c90-cf2a-45a1-8de0-00143183895e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.223704 Sep 03 20:57:51.341865 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1175/2385] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:51 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:51.555706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55cce66-5224-49ba-95a4-33f77168d196", "name": "network-vif-plugged", "status": "completed", "tag": "bd2e12f1-ea0c-410e-adc0-8a5a6b38a160"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:51.570703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:51.573562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:51.593799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:51.618438 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] Creating event network-vif-plugged:bd2e12f1-ea0c-410e-adc0-8a5a6b38a160 for instance f55cce66-5224-49ba-95a4-33f77168d196 on nch1-master-1 Sep 03 20:57:51.624314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d18cc660-f4e1-4767-9f16-9ba27b70b5d7 req-05b810bc-1989-4050-928b-c6a41bbc0d53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072556 Sep 03 20:57:51.625177 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1211/2386] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:51.853041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:51.854269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:51.868933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:51.874783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:51.875436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:51.876890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:51.877763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:51.878375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:52.023891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17226c20-a6fa-4512-bd9c-8692f96952b2 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Action: 'create', calling method: .version_select at 0x7fae66dc8b80>, body: {"pool": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:52.469396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:52.491486 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46b89375-e3b5-4a5d-9cd9-6371b8b506cf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.642663 Sep 03 20:57:52.491974 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1212/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:51 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:52.503054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcade07-def5-44a5-a548-8f7c952914f1", "tag": "ba1680a6-779b-4252-a9c6-0f65c700406f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:52.534260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:52.536698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:52.538058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:52.565760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] Creating event network-changed:ba1680a6-779b-4252-a9c6-0f65c700406f for instance cbcade07-def5-44a5-a548-8f7c952914f1 on nch1-master-1 Sep 03 20:57:52.574482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-237131dc-48a3-4a81-864f-e05d843c2143 req-5e844d14-9767-4f20-86ef-1fd52700cafb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077927 Sep 03 20:57:52.576341 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1213/2388] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:52.586014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:52.588137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:52.596350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:52.597150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:52.597783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:52.598837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:52.599490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:52.600112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:52.703857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:52.720993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:52.723018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:52.739745 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e3377f6d-536e-4652-8b43-4aed30c5226c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.161839 Sep 03 20:57:52.744365 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1214/2389] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:52 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:53.514895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:53.515524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:53.523461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:53.523935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:53.528403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:53.533888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:53.534581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:53.535174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:54.312986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:54.328453 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da5a2fa1-f360-43fa-8a09-38081226d8be tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1314 microversion: 2.1 time: 0.817459 Sep 03 20:57:54.329423 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1215/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:53 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:54.336726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:54.337397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:54.362834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:54.363422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:54.363872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:54.364603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:54.367058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:54.367562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:54.546821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:54.558746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:54.560280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:54.567440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c53e42af-3cb4-48a0-99e3-3384028933ff tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.236880 Sep 03 20:57:54.596918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1216/2391] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:54 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:55.164156 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17226c20-a6fa-4512-bd9c-8692f96952b2 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.362858 Sep 03 20:57:55.165456 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1176/2392] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:57:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:55.178219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e9c61fb-4f06-446a-aaba-8b60072e32a7 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae66936040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.351985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.352609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:55.364175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.366692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.367455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.369436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.372155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.372814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.469565 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e9c61fb-4f06-446a-aaba-8b60072e32a7 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/12fbf3b2-d2cc-472b-b4c7-021b3b61f4de" status: 200 len: 142 microversion: 2.1 time: 0.295195 Sep 03 20:57:55.471455 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1217/2393] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:57:55 2022] GET /compute/v2.1/os-floating-ips/12fbf3b2-d2cc-472b-b4c7-021b3b61f4de => generated 142 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:55.484451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b2a8b63a-10d0-4966-b402-6b21342b8b95 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae6698adc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.598413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:55.613241 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-291c2c44-d3b6-45e4-a1db-9f6239a4813b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1462 microversion: 2.1 time: 0.264968 Sep 03 20:57:55.625193 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1177/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:55 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1462 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:55.628868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.634027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:55.645030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.645544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.646002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.646737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.647205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.647646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.727155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:55.736294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:55.737802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:55.744275 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0f0cff6-0d35-4837-9d6f-d6002f9d0b02 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.122259 Sep 03 20:57:55.745207 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1178/2395] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:55 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:55.750111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.751257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:55.757906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.758675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.759377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.760313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:55.761155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:55.761807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:55.788606 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b2a8b63a-10d0-4966-b402-6b21342b8b95 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.308606 Sep 03 20:57:55.789784 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1218/2396] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 20:57:55 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:57:55.804786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74813385-13ca-49ef-aa83-cc124f0fc3b6 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae669d0f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:55.997187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:56.008669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8135040-2f7d-4596-8002-8ba174d4ae59 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1464 microversion: 2.1 time: 0.261954 Sep 03 20:57:56.010966 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1179/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:55 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1464 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:56.169253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2040142001", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9f418a14-c2a7-4495-85ca-22f600a66d65"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:56.238495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:57:56.723908 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74813385-13ca-49ef-aa83-cc124f0fc3b6 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/12fbf3b2-d2cc-472b-b4c7-021b3b61f4de" status: 202 len: 0 microversion: 2.1 time: 0.922965 Sep 03 20:57:56.724501 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1219/2398] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:57:55 2022] DELETE /compute/v2.1/os-floating-ips/12fbf3b2-d2cc-472b-b4c7-021b3b61f4de => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:57:56.836255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:57:56.836667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:57:56.837129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:57:56.837783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:57:56.838209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:57:56.848328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:56.848823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:56.849361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:56.850097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:56.850569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:56.851023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:56.871653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:57:56.880850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Getting quotas for user 0c77fca40dbc430db41e4a30639b28b5 and project 9bf7c2d797a74562993d8605bda80ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:57:56.894480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:57:56.896877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:57:56.934135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:56.935866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:56.936360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:56.936809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:56.937576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:56.938028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:56.940048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:56.941842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f08a23d4-4c1e-4271-a314-2c1698f5612e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777147 Sep 03 20:57:56.942504 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1180/2399] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:57:56.998282 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2dc2038-5471-4aba-a11d-cbe0699458af tempest-AZV2TestJSON-581686054 tempest-AZV2TestJSON-581686054-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.272681 Sep 03 20:57:56.999196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1220/2400] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Sep 3 20:57:56 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:57:57.006065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0893fb10-ddbe-4dc6-a126-81991a7c4914 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Action: 'create', calling method: .version_select at 0x7fae669365e0>, body: {"pool": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:57.031720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3be13684-e14f-48c5-8808-6d17522bf0ed tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] Calling method '.version_select at 0x7fae6b855940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:57.048487 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3be13684-e14f-48c5-8808-6d17522bf0ed tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.104704 Sep 03 20:57:57.049100 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1181/2401] 10.222.0.16 () {60 vars in 1226 bytes} [Sat Sep 3 20:57:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:57:57.064732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:57.065752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:57.073313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:57.074110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:57.074759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:57.075574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:57.076116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:57.076629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:57.162431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:57.172876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:57.174901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:57.181127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4edde8e7-a1f6-486d-8d0e-a763c1256d4d tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.127521 Sep 03 20:57:57.182013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1182/2402] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:57 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:57.186595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f611789-59ae-4b2c-8d42-1d8dc273d621 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:57.187215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f611789-59ae-4b2c-8d42-1d8dc273d621 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:57.247210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f611789-59ae-4b2c-8d42-1d8dc273d621 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:57.255201 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f611789-59ae-4b2c-8d42-1d8dc273d621 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1214 microversion: 2.1 time: 0.071994 Sep 03 20:57:57.256161 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1183/2403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:57 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:57.261154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e703a24-fc6e-4167-985d-52f4238fa91b tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] Action: 'update', calling method: .version_select at 0x7fae66dc8280>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:57.379638 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e703a24-fc6e-4167-985d-52f4238fa91b tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.122138 Sep 03 20:57:57.380479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1184/2404] 10.222.0.16 () {62 vars in 1247 bytes} [Sat Sep 3 20:57:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:57:57.391265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00238481-e5fe-4b12-9120-4db92c89753e tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] Calling method '.version_select at 0x7fae66f11550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:57.406991 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00238481-e5fe-4b12-9120-4db92c89753e tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.018893 Sep 03 20:57:57.408119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1185/2405] 10.222.0.16 () {60 vars in 1226 bytes} [Sat Sep 3 20:57:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:57:57.419990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f9e8e633-0e5a-42d7-a5cd-e56af35d10b9 tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] Action: 'update', calling method: .version_select at 0x7fae66dc8430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:57:57.530036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:57.547759 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f9e8e633-0e5a-42d7-a5cd-e56af35d10b9 tempest-QuotaClassesAdmin257Test-1344302306 tempest-QuotaClassesAdmin257Test-1344302306-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.132275 Sep 03 20:57:57.549366 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1186/2406] 10.222.0.16 () {62 vars in 1247 bytes} [Sat Sep 3 20:57:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 20:57:58.211742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:58.212608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:58.221374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:58.222126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:58.222786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:58.223844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:58.224511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:58.225214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:58.302516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:58.318273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:58.319866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:58.326535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc71c968-2192-48f8-9cb3-98791a4473d5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.120863 Sep 03 20:57:58.328597 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1187/2407] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:58 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:57:58.338372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:58.345043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:58.365960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:58.366670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:58.367286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:58.368201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:58.368987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:58.374169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:58.539047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:58.549272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f499255-4ac2-425a-9c0e-577615dbd281 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1266 microversion: 2.1 time: 0.218130 Sep 03 20:57:58.550054 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1188/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:58 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:57:58.873790 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0893fb10-ddbe-4dc6-a126-81991a7c4914 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.873508 Sep 03 20:57:58.874940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1221/2409] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 20:57:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:57:58.887428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65c6d581-9cd4-40ad-b035-a926a81edca2 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae66f11af0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:59.365378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:59.365998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:59.374603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:59.375152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:59.375602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:59.376909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:59.377373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:59.377970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:59.474723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:59.485209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:59.488115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:59.494208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e383241-9787-4a31-8a2f-54ef59d593c5 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.133694 Sep 03 20:57:59.509584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1222/2410] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:57:59 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:57:59.579351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:57:59.580998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:57:59.587920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:59.588637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:59.589329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:59.590262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:57:59.590885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:57:59.591319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:57:59.664372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:57:59.675251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85012ec6-869f-4fe9-a60b-43ee5c37d390 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1272 microversion: 2.1 time: 0.100480 Sep 03 20:57:59.676735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1223/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:57:59 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:00.526340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:00.527139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:00.536136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:00.537538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:00.539627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:00.540854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:00.541926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:00.543098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:00.635267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:00.651370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:00.653683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:00.664439 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c3ccafa-55f5-4207-8c72-4cacca3fd797 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.142766 Sep 03 20:58:00.665487 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1224/2412] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:00 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:00.712975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:00.713901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:00.722826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:00.724404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:00.725533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:00.726423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:00.727239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:00.727857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:01.017077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:01.031547 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-276df6e0-58ae-4ff4-a66b-60fe86801e56 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.325238 Sep 03 20:58:01.036337 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1225/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:00 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:01.218813 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65c6d581-9cd4-40ad-b035-a926a81edca2 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822" status: 202 len: 0 microversion: 2.1 time: 2.334820 Sep 03 20:58:01.219690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1189/2414] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:57:58 2022] DELETE /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822 => generated 0 bytes in 2337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:58:01.232346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae66876430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:01.306574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5ebddb49-79f8-4f0a-825f-0bb5156fa822 could not be found", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:58:01.307289 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] HTTP exception thrown: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Request method failure captured: Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822 HTTP/1.1 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_PvfuKsmAyb2QuYth_Her4-OqleOmqTgP2xF9KjIkbx3n3yUMG7HjSeaYsVm1zS5WrrUtR7YHu2hmvSxdb-KKRKJ73l2r-2qZp-iKfoGq0Ykvk38XmPmFa6556DYMuUHHTtXurR_T5Jc17O-6KcjWPN_Fz9_DSEEpqIoap5uxMtaM Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 713d2a60596b4d2d9701779c1d414ed1 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 713d2a60596b4d2d9701779c1d414ed1 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-FloatingIPsTestJSON-1169883622-project Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 999db58fc81f4a9ab60bdd21674ec8c2 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-FloatingIPsTestJSON-1169883622-project Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: exception: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '5ebddb49-79f8-4f0a-825f-0bb5156fa822'} Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5ebddb49-79f8-4f0a-825f-0bb5156fa822 could not be found Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8067773d-35d2-4744-baac-7e8f81a21d1b'] Sep 03 20:58:01.309290 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822. Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Returning 404 to user: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:58:01.312966 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-051a208c-52d7-41da-b256-d6e52bfaa614 tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822" status: 404 len: 111 microversion: 2.1 time: 0.084807 Sep 03 20:58:01.318628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1226/2415] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:01 2022] GET /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:58:01.327028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Calling method '.version_select at 0x7fae6b8ade50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:01.429249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5ebddb49-79f8-4f0a-825f-0bb5156fa822 could not be found", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:58:01.430254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] HTTP exception thrown: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Request method failure captured: Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822 HTTP/1.1 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_PvfuKsmAyb2QuYth_Her4-OqleOmqTgP2xF9KjIkbx3n3yUMG7HjSeaYsVm1zS5WrrUtR7YHu2hmvSxdb-KKRKJ73l2r-2qZp-iKfoGq0Ykvk38XmPmFa6556DYMuUHHTtXurR_T5Jc17O-6KcjWPN_Fz9_DSEEpqIoap5uxMtaM Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 713d2a60596b4d2d9701779c1d414ed1 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/713d2a60596b4d2d9701779c1d414ed1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 713d2a60596b4d2d9701779c1d414ed1 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1169883622 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-FloatingIPsTestJSON-1169883622-project Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 999db58fc81f4a9ab60bdd21674ec8c2 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-FloatingIPsTestJSON-1169883622-project Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: exception: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5ebddb49-79f8-4f0a-825f-0bb5156fa822'} Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5ebddb49-79f8-4f0a-825f-0bb5156fa822 could not be found Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ff0c837-044f-4d04-87b9-6163ffa50fa7'] Sep 03 20:58:01.433735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822. Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 Sep 03 20:58:01.437040 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:58:01.439548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15dbde7b-e220-4540-a37b-184e78f4f37a tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] Calling method '.version_select at 0x7fae6689e820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:01.443323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] Returning 404 to user: Floating IP not found for ID 5ebddb49-79f8-4f0a-825f-0bb5156fa822 {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:58:01.444331 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a277754-c119-4a87-85e7-cd4bc6a5708b tempest-FloatingIPsTestJSON-1169883622 tempest-FloatingIPsTestJSON-1169883622-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822" status: 404 len: 111 microversion: 2.1 time: 0.123719 Sep 03 20:58:01.445053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1190/2416] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:58:01 2022] DELETE /compute/v2.1/os-floating-ips/5ebddb49-79f8-4f0a-825f-0bb5156fa822 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:58:01.510792 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15dbde7b-e220-4540-a37b-184e78f4f37a tempest-ServersTestBootFromVolume-544474738 tempest-ServersTestBootFromVolume-544474738-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778769616" status: 202 len: 0 microversion: 2.1 time: 0.078613 Sep 03 20:58:01.511376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1227/2417] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 20:58:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778769616 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:58:01.694244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:01.695711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:01.718998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:01.722094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:01.722797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:01.724815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:01.733101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:01.733889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:02.061661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:02.062459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:02.071760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:02.075738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:02.076549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:02.078596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:02.079109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:02.079561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:02.126399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:02.150989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:02.152458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:02.182056 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57cb22ad-d1d7-4b11-8ae4-51a657a2706c tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.493003 Sep 03 20:58:02.185570 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1191/2418] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:01 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:02.554463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:02.577181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7788501b-2913-4d0b-ae93-cf92fa8399ab tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.520046 Sep 03 20:58:02.578750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1228/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:02 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:02.747284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c143b21-ea16-4bd2-a5c0-1dae34b12894", "tag": "1bdf4625-853c-4b17-9e4b-aac230c9c104"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:02.770867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:02.771918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:02.772563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:02.809141 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] Creating event network-changed:1bdf4625-853c-4b17-9e4b-aac230c9c104 for instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 on nch2-master-1 Sep 03 20:58:02.819699 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0699bf2a-0470-473c-9ff6-8bf6da7f0403 req-f0bb0d4d-aeeb-4e50-91c4-478de8d5f859 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077224 Sep 03 20:58:02.823250 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1192/2420] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:03.216157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:03.216999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:03.231859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:03.233286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:03.234534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:03.237818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:03.238403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:03.239187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:03.265253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-51285530", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:03.307853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:03.381214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:03.442292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:03.456859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:03.458346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:03.476920 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1509b877-ea4e-40fb-a8a0-32de4bd1860a tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.265131 Sep 03 20:58:03.477526 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1193/2421] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:03 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:03.605853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:03.606665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:03.618200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:03.622536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:03.623020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:03.627299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:03.629694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:03.630356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:04.024294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:04.035761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0039657f-7733-4e62-9ea8-4c37d2a9add7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.434330 Sep 03 20:58:04.047871 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1194/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:03 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:04.367859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:04.368376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:04.368764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:04.369276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:04.369950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:04.398302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:04.399054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:04.399753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:04.418094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:04.419252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:04.425575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:04.484918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:04.503422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:04.505929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:04.506627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:04.520474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:04.522548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:04.523008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:04.524723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:04.525722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:04.525920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:04.526994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:04.528081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:04.643104 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7109d727-d972-4bf9-9b1c-6ce6fbfa530c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716769 Sep 03 20:58:04.645683 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1229/2423] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:58:04.670045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24bab7d6-72dc-4fa0-a26c-8ea0f1ab5e7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:04.674456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24bab7d6-72dc-4fa0-a26c-8ea0f1ab5e7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:04.788682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:04.800996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:04.803024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:04.812396 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e88546d-b30b-4d83-b152-539f6d599acd tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1447 microversion: 2.75 time: 0.311573 Sep 03 20:58:04.829751 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1195/2424] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:04 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:05.061258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:05.066078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:05.079804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:05.080338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:05.080793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:05.081585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:05.082081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:05.082538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:05.112756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24bab7d6-72dc-4fa0-a26c-8ea0f1ab5e7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:05.129993 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24bab7d6-72dc-4fa0-a26c-8ea0f1ab5e7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1215 microversion: 2.1 time: 0.470119 Sep 03 20:58:05.135636 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1230/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:04 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1215 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:05.325274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:05.338761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98e661f9-56ac-4001-a3d7-f58c7e977dfc tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.283167 Sep 03 20:58:05.354339 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1196/2426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:05 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:05.841981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:05.843060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:05.870901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:05.871959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:05.872635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:05.874789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:05.875613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:05.876683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:05.947330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:06.158450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:06.159079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:06.170973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:06.171816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:06.172473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:06.173506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:06.174182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:06.174821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:06.331177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:06.345328 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7d4e26a0-ee02-4c95-a09c-e9e1d7330f85 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1267 microversion: 2.1 time: 0.188454 Sep 03 20:58:06.348932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1197/2427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:06 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:06.367915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:06.368612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:06.376343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:06.377380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:06.378066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:06.379912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:06.380607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:06.381289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:06.435610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:06.444912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:06.459019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:06.485784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5fd26cb1-42e1-482d-9be9-413175754a0f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1453 microversion: 2.75 time: 0.648074 Sep 03 20:58:06.497737 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1231/2428] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:05 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1453 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:06.863961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:07.374103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:07.374776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:07.386839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:07.390656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:07.392863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:07.393831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:07.394286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:07.394715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:07.542383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=22,nova_cell0:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:07.587482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:07.600791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57f87af6-461d-4ce8-927f-ecf90ea824e7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1273 microversion: 2.1 time: 0.228951 Sep 03 20:58:07.601608 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1232/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:07 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:07.616451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:07.617625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:07.630925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:07.637320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:07.638054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:07.640019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:07.641238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:07.642575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:07.643186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:07.643784 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3be79bc5-cc9e-4ab2-9eb3-90dfeed31ccb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 1.280490 Sep 03 20:58:07.659333 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1198/2430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:06 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:08.060871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:08.081532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:08.083193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:08.106980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2f46fc79-1446-4d98-af23-dd9e9f829e71 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1453 microversion: 2.75 time: 0.502800 Sep 03 20:58:08.109189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1233/2431] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:07 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1453 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:08.629527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:08.630163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:08.640949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:08.642446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:08.643060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:08.643827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:08.644576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:08.645247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:08.675040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:08.675710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:08.700809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:08.706242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:08.707540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:08.709497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:08.714480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:08.716411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:08.956264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:08.974133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f643e4c2-e3bc-4b87-9e9d-c8f8a70e926e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1273 microversion: 2.1 time: 0.348381 Sep 03 20:58:08.989613 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1199/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:08 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:09.052609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:09.066357 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11535336-39fa-4f3f-8a2a-f610a27adb95 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.393984 Sep 03 20:58:09.067131 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1234/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:08 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:09.140973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:09.141909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:09.148366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:09.149189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:09.149882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:09.150860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:09.151533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:09.152189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:09.252343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:09.258990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:09.278425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:09.279984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:09.287039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b14673cf-791d-42e3-bae6-51a9d100a35e tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1438 microversion: 2.75 time: 0.149968 Sep 03 20:58:09.288350 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1200/2434] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:09 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:09.621065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:09.624098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:09.642425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:09.643119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:09.647424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9fe3de48-d3a5-414c-86b6-99229b83200c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Action: 'create', calling method: .version_select at 0x7fae6b769550>, body: {"keypair": {"name": "tempest-keypair-872135995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNqPpqG41/qGUZoqR3QJ19qGjOsRTId1pFmuWPEqtBey4jxD5Wd7rPbvtiSPU3X8X7A62Hi2k1pa4Bns4UrMwbLke128VKP7ygCBwsQJvZAIZqm7N9cozeB4MmjZik26w=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:09.648472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:09.649485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:09.650201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:09.650854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:09.687252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9fe3de48-d3a5-414c-86b6-99229b83200c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Getting quotas for project fb7084c9131a4f77b9688e10cd4c84de. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:09.699425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9fe3de48-d3a5-414c-86b6-99229b83200c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Getting quotas for user 322d75aacb244323b79f7f0e2ac464b8 and project fb7084c9131a4f77b9688e10cd4c84de. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:09.763042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9fe3de48-d3a5-414c-86b6-99229b83200c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.198511 Sep 03 20:58:09.763671 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1201/2435] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:58:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:58:09.841762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:09.842302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:09.842765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:09.843257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:09.843750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:09.997357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:10.002231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:10.003052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:10.015193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.015700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.017295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.017446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.017874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.018336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.018664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.018798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.019242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.019837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.020447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.021060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.215210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:10.251756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:10.267401 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3433cf5e-ea60-49b6-b2d4-6a96873e42eb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1273 microversion: 2.1 time: 0.269377 Sep 03 20:58:10.268053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1202/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:09 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:10.287586 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-77faad4d-697a-4414-90db-0540f4f390cc tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c/action" status: 202 len: 1942 microversion: 2.75 time: 0.972257 Sep 03 20:58:10.294140 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1235/2437] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 20:58:09 2022] POST /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c/action => generated 1942 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 03 20:58:10.311662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:10.317719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:10.321327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c143b21-ea16-4bd2-a5c0-1dae34b12894", "name": "network-vif-plugged", "status": "completed", "tag": "1bdf4625-853c-4b17-9e4b-aac230c9c104"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:10.333958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.334712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.336598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.337725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.338386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.339005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.348705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.351516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.353575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.386166 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] Creating event network-vif-plugged:1bdf4625-853c-4b17-9e4b-aac230c9c104 for instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 on nch2-master-1 Sep 03 20:58:10.397116 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0012ed19-ce5e-4c33-b4d7-8f7968193bef req-466e61db-1ddd-40c5-89b8-c81e0fae70c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091521 Sep 03 20:58:10.398471 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1203/2438] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:10.404619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:10.405622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:10.414494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.415317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.416214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.417236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:10.417932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:10.418592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:10.612986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:10.656042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4ebb42f-2995-4c27-961c-052b707d3b86 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.256042 Sep 03 20:58:10.669680 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1204/2439] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:10 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:11.011664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:11.033518 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e9d8292d-5939-46f0-93ea-8390a9c54a60 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1314 microversion: 2.1 time: 0.737858 Sep 03 20:58:11.053763 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1236/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:10 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:11.295898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:11.296543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:11.309256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:11.309744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:11.310202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:11.310948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:11.311442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:11.311884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:11.704335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:11.705244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:11.720160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:11.721007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:11.723751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:11.725807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:11.726314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:11.726781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:12.043150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:12.100414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73b12880-ac2c-4eae-9e51-6d9a02baa33b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.400649 Sep 03 20:58:12.101737 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1237/2441] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:11 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:12.107861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:12.108753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:12.118549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:12.119307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:12.119918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:12.121010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:12.121663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:12.122243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:12.429892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:12.438429 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a2f43aa-89eb-4b49-a8c5-33e99000a6a6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 1.146787 Sep 03 20:58:12.450708 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1205/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:11 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:12.627389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:12.639030 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-578b1f50-7947-4aed-9d99-6bb02d73fb8d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1462 microversion: 2.1 time: 0.535850 Sep 03 20:58:12.643518 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1238/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:12 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1462 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:12.858975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:12.868502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'deleted': False, 'project_id': 'e941437cffc54d9b9a8b2257c0c23bd9'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:12.882702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:12.885707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:12.887641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:12.888593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:12.890596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:12.891221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.002975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d9ba95-551c-4316-94bb-bb83ba4bd615", "tag": "2773b822-6a18-4e34-8b3f-43fc3cb4c804"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:13.026060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.026542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.035559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.051030 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] Creating event network-changed:2773b822-6a18-4e34-8b3f-43fc3cb4c804 for instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 on nch1-master-1 Sep 03 20:58:13.059191 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0538d37b-38e6-42b3-8c6e-036a1a8065e0 req-872264e2-b4f0-46e7-b31e-eab6b3096837 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059798 Sep 03 20:58:13.060059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1239/2444] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:13.110866 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0ee28c41-67e5-41f8-b5b9-e7ac748adcc0 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.441790 Sep 03 20:58:13.138011 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1206/2445] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:58:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:13.141178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:13.142422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:13.145073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:13.153437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'deleted': False} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:13.155841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.156494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.157013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.157808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.158265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.158694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.162633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.165127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.167780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.168830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.169610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.170613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.341935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:13.400505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:13.442971 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e94394e-28a8-4507-9177-b8491b4d0048 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.305823 Sep 03 20:58:13.445061 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1240/2446] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:13 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:13.470939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:13.471772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:13.482356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.484340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.487583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.488139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.492035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.492035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.492811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:13.497054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:13.497680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:13.874983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:13.894287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a0b4b2b9-293e-4c34-bff6-a490ad97bb43 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.430263 Sep 03 20:58:13.898903 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1241/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:13 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:14.419981 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9327ffcf-038c-4961-aebc-57fd26b8cd21 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12846 microversion: 2.1 time: 1.280597 Sep 03 20:58:14.420763 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1207/2448] 10.222.0.16 () {58 vars in 1171 bytes} [Sat Sep 3 20:58:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12846 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 20:58:14.463344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:14.478566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:14.481580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:14.513992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'deleted': False, 'project_id': 'e941437cffc54d9b9a8b2257c0c23bd9'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:14.516909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.526844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.531807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.536843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.545251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.553833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.559057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:14.565462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.566655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.567465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.580612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.581752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.586684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.769851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2448a0c8-3528-4ce4-9989-a5f23389b6eb tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=9bf7c2d797a74562993d8605bda80ae4" status: 200 len: 15 microversion: 2.1 time: 0.312506 Sep 03 20:58:14.771158 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1242/2449] 10.222.0.16 () {58 vars in 1231 bytes} [Sat Sep 3 20:58:14 2022] GET /compute/v2.1/servers/detail?tenant_id=9bf7c2d797a74562993d8605bda80ae4 => generated 15 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:14.792442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:14.795474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:14.799117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'tenant_id': '9bf7c2d797a74562993d8605bda80ae4', 'deleted': False} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:14.804297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.805027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.805633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.806376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.806835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.807266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.839698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:14.840679 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8973ac61-7c38-41a3-b353-cabbc17ad46b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.369349 Sep 03 20:58:14.841682 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1208/2450] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:14 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:14.923005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:14.923747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:14.931082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.936764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.937876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:14.940620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:14.941644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:14.943945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:15.009524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:15.010012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:15.010624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:15.434444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:15.454282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e568c85-b979-4778-aebb-8eedd03d942a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.526486 Sep 03 20:58:15.454282 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1209/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:14 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:15.458164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "50ea6327-ff30-4b68-9f8b-77fadc9d0e0c"}], "security_groups": [{"name": "tempest-securitygroup--1667607115"}], "key_name": "tempest-keypair-872135995", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:15.628924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afab0e9d-a957-4777-9402-9fe105760496 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9bf7c2d797a74562993d8605bda80ae4" status: 200 len: 4824 microversion: 2.1 time: 0.840164 Sep 03 20:58:15.637300 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1243/2452] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 3 20:58:14 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9bf7c2d797a74562993d8605bda80ae4 => generated 4824 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:15.656855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:15.668592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'tenant_id': 'e941437cffc54d9b9a8b2257c0c23bd9', 'deleted': False} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:15.680202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:15.681159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:15.681877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:15.683869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:15.684541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:15.685378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:15.726303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] validate_networks() for [('50ea6327-ff30-4b68-9f8b-77fadc9d0e0c', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:16.127401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5de6ed07-2a55-4206-822a-d09d6ac439a6 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e941437cffc54d9b9a8b2257c0c23bd9" status: 200 len: 15 microversion: 2.1 time: 0.472569 Sep 03 20:58:16.132205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1244/2453] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 3 20:58:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e941437cffc54d9b9a8b2257c0c23bd9 => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:16.136592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:16.138638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:16.149208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.150057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.153993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.154791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.155277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.155738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.303170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:16.314520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:16.335299 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-932c0dec-bfa9-4428-b8d1-67de06b5c6a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.204984 Sep 03 20:58:16.336282 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1245/2454] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:16 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:16.340948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48c4753e-8a01-473a-a1d4-f9c784558ec8 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:16.346584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48c4753e-8a01-473a-a1d4-f9c784558ec8 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009314 Sep 03 20:58:16.347307 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1246/2455] 10.222.0.16 () {58 vars in 1189 bytes} [Sat Sep 3 20:58:16 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:16.368453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:16.370928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:16.377995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.378565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.379003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.379710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.380569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.382380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.530667 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf4855b3-bc6a-4a32-8a23-a2a661b82fa1 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 0 microversion: 2.1 time: 0.166051 Sep 03 20:58:16.535154 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1247/2456] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:58:16 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 20:58:16.539741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:16.540359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:16.561767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.562311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.562717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.563923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.564442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.564809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.806411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:16.815372 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fbf75090-7ccc-45fa-ada2-0104b0453ab8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.278951 Sep 03 20:58:16.829900 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1248/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:16 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:16.831334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:16.832421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:16.832928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:16.833347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:16.833761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:16.844862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:16.850666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.851339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.851956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.852849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.857279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.857637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:16.858095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.858700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '9bf7c2d797a74562993d8605bda80ae4'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:16.874853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.875704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.876348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.877368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:16.878051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:16.878771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:16.899455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Getting quotas for project fb7084c9131a4f77b9688e10cd4c84de. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:16.918667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Getting quotas for user 322d75aacb244323b79f7f0e2ac464b8 and project fb7084c9131a4f77b9688e10cd4c84de. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:16.932175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:16.938862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:16.974680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:17.019622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a57683f2-ddfc-4ff8-b81b-7ea01dbd424c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.567389 Sep 03 20:58:17.020266 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1210/2458] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:58:17.025213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20203f42-41af-4e47-818d-1fdb33d14953 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae66fe0ee0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:17.057503 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8cfeba9-309a-4f0a-a984-450f9f087964 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.226365 Sep 03 20:58:17.064993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1249/2459] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Sep 3 20:58:16 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:17.073362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-162a7296-c4ef-4537-9120-f8e732c214c7 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:17.074314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-162a7296-c4ef-4537-9120-f8e732c214c7 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:17.104175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20203f42-41af-4e47-818d-1fdb33d14953 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b" status: 200 len: 636 microversion: 2.1 time: 0.082604 Sep 03 20:58:17.109641 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1211/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 3 20:58:17 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b => generated 636 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:17.119083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:17.121946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:17.130087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.131323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.132062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:17.133072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.134311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.135253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:17.192408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-162a7296-c4ef-4537-9120-f8e732c214c7 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:17.224175 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-162a7296-c4ef-4537-9120-f8e732c214c7 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1225 microversion: 2.1 time: 0.143566 Sep 03 20:58:17.236951 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1250/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:17 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:17.249546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d49500a3-1b2c-4974-949b-b4c2f3dba726 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae668700d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:17.327635 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a59db8b7-d5f5-488e-abe0-1b4180b60145 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 0 microversion: 2.1 time: 0.214341 Sep 03 20:58:17.330957 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1212/2462] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:58:17 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:58:17.342554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:17.343227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:17.361515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.366254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.367339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:17.368786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.369586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.370444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:17.386886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d49500a3-1b2c-4974-949b-b4c2f3dba726 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:17.402952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d49500a3-1b2c-4974-949b-b4c2f3dba726 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:17.887695 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d49500a3-1b2c-4974-949b-b4c2f3dba726 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.655731 Sep 03 20:58:17.888927 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1251/2463] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:17 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:17.900481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:17.901645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:17.910719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.911689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.912526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:17.913504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:17.914168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:17.914783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.014311 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-79341e5f-03d9-4d6b-873d-88103b634fd7 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1615 microversion: 2.1 time: 0.678642 Sep 03 20:58:18.021406 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1213/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:17 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1615 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:18.021815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:18.027955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.028854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:18.036999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.037834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.038533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.041826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.042962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.043675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.051075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8a1d5c1-6f2e-4fd8-a3ea-45d1bd2b82e3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.155533 Sep 03 20:58:18.051897 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1252/2465] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:17 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:18.061024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b072ba2-afb9-4f1f-84bd-20c0f294562f tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae668445e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.590224 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6b072ba2-afb9-4f1f-84bd-20c0f294562f tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "DELETE /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.537466 Sep 03 20:58:18.590977 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1253/2466] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Sep 3 20:58:18 2022] DELETE /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_version => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:58:18.597070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.597748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:18.608363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.609008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.609411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.611190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.611388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.611887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.697282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:18.707636 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f231e0a9-d357-4d8c-9693-7e105db438a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.684391 Sep 03 20:58:18.708659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1214/2467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:18 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:18.713355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.714160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:18.727371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.728121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.728742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.729748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.731170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.731795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.811650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:18.820592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-96b1a34b-2605-4dc3-aa47-d81a0b04b3d5 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1615 microversion: 2.1 time: 0.228385 Sep 03 20:58:18.821709 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1254/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:18 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1615 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:18.823432 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aec95107-8e00-4698-ad7f-b342d8409b4c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1277 microversion: 2.1 time: 0.113562 Sep 03 20:58:18.838174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1215/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:18 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:18.839146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0549f79f-d87f-44e5-b6a4-23e05cb44795 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae669075e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.854167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:18.863315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:18.869391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.870187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.870973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.871941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:18.873096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:18.873790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:18.894962 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0549f79f-d87f-44e5-b6a4-23e05cb44795 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.071777 Sep 03 20:58:18.896474 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1255/2470] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:18 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:18.908765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4436e66e-4c98-40cb-aed9-f793490d0799 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae6689eb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:19.026451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4436e66e-4c98-40cb-aed9-f793490d0799 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:19.043104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4436e66e-4c98-40cb-aed9-f793490d0799 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:19.047895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:19.080533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:19.187165 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-574cc2f1-29e0-49cf-8b07-2ff7431ed671 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1324 microversion: 2.1 time: 0.347619 Sep 03 20:58:19.188287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1216/2471] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Sep 3 20:58:18 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:19.214765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:19.217115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:19.225186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:19.237232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.239864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.242711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.247300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.248771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.248771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.447450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:19.457483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:19.490744 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a3b2b549-1a1d-4ebe-bc2a-d0e73e931534 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.300879 Sep 03 20:58:19.495054 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1217/2472] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:19 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:19.500783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:19.527310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:19.543307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.545898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.546537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.551270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.551872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.554908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.577498 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4436e66e-4c98-40cb-aed9-f793490d0799 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.674552 Sep 03 20:58:19.578325 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1256/2473] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:18 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:58:19.583398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d9ba95-551c-4316-94bb-bb83ba4bd615", "name": "network-vif-plugged", "status": "completed", "tag": "2773b822-6a18-4e34-8b3f-43fc3cb4c804"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:19.601387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.601914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.602365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.611889 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0488475b-6777-49cc-ae70-02341cb4a818 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.115610 Sep 03 20:58:19.614946 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] Creating event network-vif-plugged:2773b822-6a18-4e34-8b3f-43fc3cb4c804 for instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 on nch1-master-1 Sep 03 20:58:19.615948 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1218/2474] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Sep 3 20:58:19 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:19.627284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dda44789-822e-4c9f-bdc1-3b183dfef924 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae66842040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:19.629271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6e1af125-f6b5-4780-a692-4043ef0cc007 req-22b12081-f3f5-40e4-89ba-1ee1c369383b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049385 Sep 03 20:58:19.630478 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1257/2475] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:19.636221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:19.638939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:19.658902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.659563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.660199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.661168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.661914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.665379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.695844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dda44789-822e-4c9f-bdc1-3b183dfef924 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.078691 Sep 03 20:58:19.696788 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1219/2476] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Sep 3 20:58:19 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_distro => generated 33 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:19.711346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bde6f68f-2fbd-4a02-9389-f198a455c3fc tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae66803a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:19.794515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bde6f68f-2fbd-4a02-9389-f198a455c3fc tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:19.802307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bde6f68f-2fbd-4a02-9389-f198a455c3fc tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:19.823940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99187f3d-ba6e-4d72-8d14-049a41e10c94 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 0 microversion: 2.1 time: 0.191978 Sep 03 20:58:19.824827 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1258/2477] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:58:19 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:58:19.838903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:19.839597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:19.859958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.860579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.861214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:19.865953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:19.867343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:19.868306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.034285 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bde6f68f-2fbd-4a02-9389-f198a455c3fc tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.329987 Sep 03 20:58:20.035031 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1220/2478] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:19 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:58:20.042702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:20.046039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:20.055342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.056051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.056696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.057812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.059137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.059984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.156699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:20.177561 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1bded0d-e22c-4075-9848-cd099e93ac9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.349099 Sep 03 20:58:20.178485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1259/2479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:19 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:20.188710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:20.193696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:20.199936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.200440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.201430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.201721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.202363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.202774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.204117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:20.209748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:20.210468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:20.210986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:20.211510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:20.281621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:20.292579 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad4916e2-d9e8-41bd-97ff-acf6071767f5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1283 microversion: 2.1 time: 0.112480 Sep 03 20:58:20.293353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1260/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:20 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:20.298545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6119dd28-dfa4-4044-92f5-6e9a6ba07ce9 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae6688df70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:20.334247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:20.342795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.343308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.343846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.345591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.346059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.346895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.353312 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6119dd28-dfa4-4044-92f5-6e9a6ba07ce9 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.058663 Sep 03 20:58:20.354398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1261/2481] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:20 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:20.367303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-957a3fd1-a897-48e7-9048-4a050322e66b tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae66844d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:20.378621 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed2d703b-9694-4d28-b0f9-c635d5f1d880 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 1068 microversion: 2.1 time: 0.341863 Sep 03 20:58:20.392749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1221/2482] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:58:20 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 1068 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 03 20:58:20.401754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:20.402629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:20.410917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.411824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.412960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.413697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.414163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.414604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.436981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-957a3fd1-a897-48e7-9048-4a050322e66b tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:20.445811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-957a3fd1-a897-48e7-9048-4a050322e66b tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:20.675920 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-957a3fd1-a897-48e7-9048-4a050322e66b tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.314376 Sep 03 20:58:20.677226 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1262/2483] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:20 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:20.682541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:20.683372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:20.690962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.691725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.692345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.693620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:20.694237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:20.694872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:20.811643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:20.831868 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d13a8dcf-d461-4c85-82c7-d9d78278dee3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.153320 Sep 03 20:58:20.832687 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1263/2484] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:20 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:20.837923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca91751d-82c2-47bf-ba0f-8699d65cffca tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae66908940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:20.901454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ca91751d-82c2-47bf-ba0f-8699d65cffca tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:20.907614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ca91751d-82c2-47bf-ba0f-8699d65cffca tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:20.999630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:21.012947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f858591-5676-4ed3-af28-93faf2082e05 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.617693 Sep 03 20:58:21.013477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1222/2485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:20 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:21.199659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:21.200296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:21.208973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.211710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.212281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:21.213589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.217154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.217732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:21.308337 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca91751d-82c2-47bf-ba0f-8699d65cffca tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.473903 Sep 03 20:58:21.309256 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1264/2486] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:20 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 64 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:21.323651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:21.326707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:21.337862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.338766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.338894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:21.340189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.340739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.341419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:21.440426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:21.449393 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e26e0ff0-e94f-41c0-98a2-c7430b59e533 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1283 microversion: 2.1 time: 0.134851 Sep 03 20:58:21.464945 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1265/2487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:21 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1283 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:21.464945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1ddb82f-bd3b-4e2d-836f-411241123b36 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae66907dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:21.522899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1ddb82f-bd3b-4e2d-836f-411241123b36 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.064049 Sep 03 20:58:21.525604 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1266/2488] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:21 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 64 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:21.539682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3979f24a-2e82-46d4-bf2a-ecb4d57b263a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae6688d550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:21.601497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3979f24a-2e82-46d4-bf2a-ecb4d57b263a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:21.607079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3979f24a-2e82-46d4-bf2a-ecb4d57b263a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:21.701899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:21.717594 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d08728a-45a9-4e21-8427-49351237523c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1315 microversion: 2.1 time: 0.521057 Sep 03 20:58:21.733634 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1223/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:21 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:21.861993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:21.862864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:21.876338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.878384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.878870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:21.879620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:21.880091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:21.880527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.036226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3979f24a-2e82-46d4-bf2a-ecb4d57b263a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.502174 Sep 03 20:58:22.041621 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1267/2490] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:21 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:22.047035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:22.049705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:22.064519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.072977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.073600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.074392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.074881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.075324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.163870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:22.206223 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-462a9baf-420e-4765-ae8b-3935fa89dcc6 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.350184 Sep 03 20:58:22.225838 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1224/2491] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:21 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:22.232149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e87a8ac6-6114-45dc-98ce-52fec5a08516 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update', calling method: .version_select at 0x7fae66514f70>, body: {"meta": {"os_version": "alt"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:22.297021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e87a8ac6-6114-45dc-98ce-52fec5a08516 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:22.304459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e87a8ac6-6114-45dc-98ce-52fec5a08516 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:22.360146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:22.377251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c2a7a8f-ab2c-4e7c-a8a6-589d32af00bd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.334215 Sep 03 20:58:22.379886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1268/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:22 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:22.474616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:22.478049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:22.499262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.501667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.503708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.505301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.507890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.508444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.802900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:22.812302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:22.817941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e87a8ac6-6114-45dc-98ce-52fec5a08516 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.590117 Sep 03 20:58:22.819490 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1225/2493] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Sep 3 20:58:22 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata/os_version => generated 31 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:22.819899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0fd5cc1d-cbeb-4579-97f0-699872541369 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.349123 Sep 03 20:58:22.820668 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1269/2494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:22 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:22.837877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:22.838981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bbb2a64-cf12-4572-afbc-a8878b8ab4b3 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae66907310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:22.839852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:22.869678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.870390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.870967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.871831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:22.872438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:22.873058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:22.900585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9bbb2a64-cf12-4572-afbc-a8878b8ab4b3 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.074569 Sep 03 20:58:22.902066 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1270/2495] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:22 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 58 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:22.915172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2ee9ee3-891c-4655-bf1e-920d8a59277a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'update_all', calling method: .version_select at 0x7fae6688d790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:22.987718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d2ee9ee3-891c-4655-bf1e-920d8a59277a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:22.994139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d2ee9ee3-891c-4655-bf1e-920d8a59277a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:23.150125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:23.159152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e58d8c6-7845-472e-9c09-4c8a44c06f04 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1464 microversion: 2.1 time: 0.338367 Sep 03 20:58:23.159592 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1226/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:22 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:23.495378 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2ee9ee3-891c-4655-bf1e-920d8a59277a tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.584338 Sep 03 20:58:23.502440 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1271/2497] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:22 2022] PUT /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 61 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 20:58:23.508977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:23.511104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:23.534907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.535835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.536538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.537531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.538215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.538868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.549019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:23.549633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:23.558378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.559135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.559745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.560655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.561287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.561859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.681622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:23.709033 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9bcca94f-b3e8-4700-8ffc-5c733789b03e tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.204773 Sep 03 20:58:23.724941 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1272/2498] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:23 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:23.724941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:23.724941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:23.743686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.744313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.744847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.745849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:23.746501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:23.747147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:23.919193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:23.932928 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7005d8b2-ec9c-4d4e-bd5c-68c0bf740340 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.220213 Sep 03 20:58:23.934594 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1273/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:23 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:23.940530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4920d408-6327-44da-9d54-17157f90f7b1 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Action: 'create', calling method: .version_select at 0x7fae66870a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:24.005026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4920d408-6327-44da-9d54-17157f90f7b1 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:24.018145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4920d408-6327-44da-9d54-17157f90f7b1 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Getting quotas for user fb89866055274ae1b0855f89e7b520cc and project db2b0543b40d486dac0aaa8426afd3d6. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:24.325544 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0de3d1c-207e-4e61-abab-916159b9ec82 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1615 microversion: 2.1 time: 1.146935 Sep 03 20:58:24.343247 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1227/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:23 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1615 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:24.352646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:24.354032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:24.363580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:24.364483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:24.365040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:24.366407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:24.366975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:24.369167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:24.381454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4920d408-6327-44da-9d54-17157f90f7b1 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "POST /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.445552 Sep 03 20:58:24.382724 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1274/2501] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Sep 3 20:58:23 2022] POST /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 85 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:24.388314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: .version_select at 0x7fae66870f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1596338641", "policies": ["affinity"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:24.430305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:24.452515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:24.512605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:24.520453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:24.537274 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9227be8-fd8a-4ce0-8e0b-1127a43161fc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.153416 Sep 03 20:58:24.538645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1275/2502] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Sep 3 20:58:24 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:24.543759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b1b3549-b893-4354-a3c7-36482f5e22c5 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] Calling method '.version_select at 0x7fae66963430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:24.606549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b1b3549-b893-4354-a3c7-36482f5e22c5 tempest-ImagesMetadataTestJSON-688327281 tempest-ImagesMetadataTestJSON-688327281-project] 10.222.0.16 "GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.066814 Sep 03 20:58:24.607134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1276/2503] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 20:58:24 2022] GET /compute/v2.1/images/4502c780-cb32-40d6-9eaa-feae6f41136b/metadata => generated 85 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:58:24.711564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-29669440", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "66e52705-5c0b-448d-a7f7-678d58b2e2e5"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:24.812395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:24.817377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:24.826630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3084a758-aea3-4dc9-a98d-1558c547750b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.481982 Sep 03 20:58:24.837338 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1228/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:24 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:24.850345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:24.856467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:24.869759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:24.874108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:24.874108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:24.874896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:24.875385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:24.884694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.024330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:25.057003 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-980f1610-767f-43cd-a09e-01f9e2cccd1c tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.208547 Sep 03 20:58:25.069675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1229/2505] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:24 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:25.087991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aed6c85-7b16-4509-a569-5197641ec082", "tag": "19bffd6e-ec17-4c8e-bc49-ac030cf6cab9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:25.108830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.109695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.110895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.146190 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] Creating event network-changed:19bffd6e-ec17-4c8e-bc49-ac030cf6cab9 for instance 0aed6c85-7b16-4509-a569-5197641ec082 on nch1-master-1 Sep 03 20:58:25.153074 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-48e80323-1a41-4ddf-b764-b272526952d7 req-62f9fa0f-9614-4fb6-adf5-d3b52702e170 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081645 Sep 03 20:58:25.154257 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1230/2506] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:25.161654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:25.162907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:25.170767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.171297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.173305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.175109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.176168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.176681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.195391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:25.196079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:25.196828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:25.197527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:25.198158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:25.214058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:25.230102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.230561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.231002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.231939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.232402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.232883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.255270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:25.261411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:25.275954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 2 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:25.278456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:25.349446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:25.356394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:25.407911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:25.419375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:25.438426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=dc74374f-f448-47a6-b7d1-643804422c02,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:25.491794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:25.507239 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14fe30af-b1ed-4142-8767-c0b088be064e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.351405 Sep 03 20:58:25.507828 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1231/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:25 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:25.521561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:25.530112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:25.642811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:25.648765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:25.700200 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d638cf6-ec08-499c-b75a-722117268295 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.993239 Sep 03 20:58:25.701342 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1277/2508] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 03 20:58:25.710155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:25.717180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:25.718720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Searching by: {'deleted': False, 'project_id': '5a2f3c186f88497181cf6a1d806631b1'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:25.742516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.743769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.744456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.745939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.746674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.747281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.802006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:25.854276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:25.854917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:25.865282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-52454a6f-d41a-4fe3-b499-54488ba8c8c7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 998 microversion: 2.1 time: 0.158009 Sep 03 20:58:25.874538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.875441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1232/2509] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:58:25 2022] GET /compute/v2.1/servers => generated 998 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:25.880816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.881384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:25.882158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:25.882816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5e0b6e2-a478-415e-a57b-f43dc288d544 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:25.883465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5e0b6e2-a478-415e-a57b-f43dc288d544 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:25.885645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:25.887817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:26.008051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e5e0b6e2-a478-415e-a57b-f43dc288d544 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:26.020149 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5e0b6e2-a478-415e-a57b-f43dc288d544 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1217 microversion: 2.1 time: 0.139145 Sep 03 20:58:26.033858 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1233/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:25 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:26.102479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:26.105574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:26.126113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:26.126794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:26.127485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:26.128991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:26.130260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:26.133029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:26.213083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:26.222750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-903c8689-0b8a-4d99-8bb9-7f63c2011aad tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.372549 Sep 03 20:58:26.228197 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1278/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:25 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:26.294754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:26.348393 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-150c0214-a447-4079-8da6-fffc743887a8 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.262039 Sep 03 20:58:26.349610 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1234/2512] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:26 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:26.537039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:26.538461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:26.571619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:26.572061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:26.577989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:26.581831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:26.584986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:26.585674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:26.892907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:26.904621 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8fb9c39c-4270-4d56-81ac-362bd0d770f5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.373566 Sep 03 20:58:26.907506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1279/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:26 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:27.051304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:27.051934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:27.066062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.066575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.067603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.072462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.073018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.073476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.211073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:27.221187 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a73bfaf1-b230-41e4-a745-9cc7a0ef543d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1221 microversion: 2.1 time: 0.176061 Sep 03 20:58:27.224469 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1235/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:27 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1221 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:27.254577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:27.255208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:27.267282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.268578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.269578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.270901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.272713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.274457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.382767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:27.383376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:27.397331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.397846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.400467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.402440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.402928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.404531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.440079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:27.541403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:27.552583 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eae41bf5-376d-4c6e-9762-12b6946c62c4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.302045 Sep 03 20:58:27.553380 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1280/2515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:27 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:27.585046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:27.622827 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87ddd02f-1cef-4895-8571-6099093ad035 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.244068 Sep 03 20:58:27.635878 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1236/2516] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:27 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:27.933435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:27.934432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:27.948716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.949256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.949712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:27.950452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:27.950916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:27.951347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.248308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:28.249693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:28.258471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.259300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.260245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.261276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.262445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.263087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.449070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:28.461711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f233b99-753f-4602-b60e-c3c13767c7ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1221 microversion: 2.1 time: 0.218699 Sep 03 20:58:28.462597 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1237/2517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:28 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:28.579824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:28.580430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:28.592521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.596937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.598426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.599546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.606022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.606493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.688805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:28.702392 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5cf815e7-ae1d-49e1-bcac-ed1de9b790eb tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.772868 Sep 03 20:58:28.731036 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1281/2518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:27 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:28.741031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:28.749509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:28.774365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.775215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.775833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:28.777840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:28.786473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:28.790388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:29.556739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:29.580834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-987a91f1-ca9d-4b30-95e4-ef10cd0fabf4 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 1.002928 Sep 03 20:58:29.583495 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1238/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:28 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:29.598839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:29.599851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:29.610385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:29.612411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:29.613397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:29.614912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:29.615729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:29.617218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:29.630370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:29.675611 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07e93b4d-6322-4f56-8f56-bd91d8567db1 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.942942 Sep 03 20:58:29.676429 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1282/2520] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:28 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:29.739146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:29.740599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:29.749781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:29.751177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:29.751865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:29.752826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:29.753548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:29.754201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:29.782475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:29.798412 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2dbdea89-bde2-43ef-9079-78adc1205072 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1269 microversion: 2.1 time: 0.206626 Sep 03 20:58:29.799413 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1239/2521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:29 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:30.488058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:30.499513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a6a2811d-8601-4c6f-87ff-7a8a3156b4c7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.764818 Sep 03 20:58:30.501386 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1283/2522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:29 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:30.611117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:30.611990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:30.621787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:30.627272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:30.627973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:30.628924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:30.631568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:30.632093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:30.734082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-750962242", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8d7d4726-3020-4a25-9f94-09aa147262dc"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:30.820013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] validate_networks() for [('8d7d4726-3020-4a25-9f94-09aa147262dc', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:31.103786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:31.130973 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7d97456-b3f4-49e9-bec1-0e2c27f7a4ef tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.526268 Sep 03 20:58:31.133184 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1284/2523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:30 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:31.147492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:31.151819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:31.167750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.175816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.176431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:31.177942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.179158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.181060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:31.374062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:31.427630 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9adf87c7-fadc-4480-8b05-2914c7cb81bf tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.292229 Sep 03 20:58:31.431924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1285/2524] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:31 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:31.469938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:31.472960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:31.493518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.494088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.495883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:31.497172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.502771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.502771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:31.621590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:31.630204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5437f2b-6c47-4470-bbf9-ef74b5a09f8d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1275 microversion: 2.1 time: 0.182806 Sep 03 20:58:31.630788 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1286/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:31 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:31.647806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:31.648602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:31.657281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.657789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.658239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:31.658974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:31.659437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:31.659862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.189982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:32.191099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:32.191840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:32.192885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:32.193469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:32.217599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.223888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.224476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.225425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.226009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.226613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.233071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:32.246709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80b90f9f-d477-4c4c-9e9b-925d08c8deb5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.603110 Sep 03 20:58:32.266540 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1287/2526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:31 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:32.269274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Getting quotas for project 7262d6f38eee4c1184a6b471cf69b008. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:32.273706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aed6c85-7b16-4509-a569-5197641ec082", "name": "network-vif-plugged", "status": "completed", "tag": "19bffd6e-ec17-4c8e-bc49-ac030cf6cab9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:32.285102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Getting quotas for user 336a280254b44d5e9c99abbce6fb88d5 and project 7262d6f38eee4c1184a6b471cf69b008. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:32.287742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.288413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.289065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.307339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] Creating event network-vif-plugged:19bffd6e-ec17-4c8e-bc49-ac030cf6cab9 for instance 0aed6c85-7b16-4509-a569-5197641ec082 on nch1-master-1 Sep 03 20:58:32.313704 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ac49ea1c-bbbf-4f33-940e-f1b438d34bd6 req-c1298f26-f4b6-468d-9d83-9abbe8d87072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045347 Sep 03 20:58:32.314745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1288/2527] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:32.321998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:32.322635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:32.323465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Going to run 3 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:32.328009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:32.331807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.332748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.333498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.334594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.335138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.335607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.485232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=66982bab-3959-42f5-8f17-3af0d4445435,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:32.534149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=634febfe-8c24-4b5b-b3a4-69d50188e6a5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:32.648353 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-571a5f0b-8a7a-45a4-95f2-7274a2f467d2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206161 Sep 03 20:58:32.649409 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1240/2528] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:58:32.661811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:32.663972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:32.690920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.691638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.693149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:32.694269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:32.695147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:32.696299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.011547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:33.027454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-110a15f2-a6a4-4384-93f0-2851d06c1ed8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.710730 Sep 03 20:58:33.028051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1289/2529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:32 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:33.041369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:33.042215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:33.067724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.070656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.071288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.080074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.080744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.081364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.140452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:33.197125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65b5ec3e-b63d-4279-86ad-e41e7aace007 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.544054 Sep 03 20:58:33.199336 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1241/2530] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:32 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:33.205389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:33.210659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:33.218808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:33.222818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:33.263474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.275755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.276501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.278939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.279573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.281327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.334812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:33.343534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a32c82e-b5a1-4558-aecd-84da127a5ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.142991 Sep 03 20:58:33.349129 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1242/2531] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:58:33 2022] GET /compute/v2.1/servers => generated 1015 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:33.359461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:33.360153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:33.367666 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20ef84b2-5b3c-48f0-8c49-ed7b3445d2d6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1275 microversion: 2.1 time: 0.337604 Sep 03 20:58:33.382869 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1290/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:33 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:33.383040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.383472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.384096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.385039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:33.385659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:33.386248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:33.401125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1c40f31-a8fd-4f5f-a69b-5f809c75ffd5 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:33.403598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1c40f31-a8fd-4f5f-a69b-5f809c75ffd5 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:33.666329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c1c40f31-a8fd-4f5f-a69b-5f809c75ffd5 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:33.670243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=71 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:33.683684 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1c40f31-a8fd-4f5f-a69b-5f809c75ffd5 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1222 microversion: 2.1 time: 0.297099 Sep 03 20:58:33.690190 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1291/2533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:33 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1222 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:34.036151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:34.050299 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-97e4177a-534d-41df-b72f-693f2c7248ff tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.699957 Sep 03 20:58:34.058661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1243/2534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:33 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:34.074149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:34.074874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:34.078228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:34.105899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.106609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.107076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.108776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.110668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.112846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.299180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:34.299904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:34.315880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.316529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.317266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.318966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.319606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.320185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.514046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:34.558081 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0a42008-9bad-4325-a0f3-b1efec9f243b tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.263981 Sep 03 20:58:34.560927 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1244/2535] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:34 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:34.572884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:34.576192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:34.594956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.598743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.599460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.601531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.602123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.606255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.685418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:34.688501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:34.700660 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9ee654d0-eacf-417b-900b-68a1f321e948 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1351 microversion: 2.1 time: 0.640482 Sep 03 20:58:34.705193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1292/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:34 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1351 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:34.722864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:34.723899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:34.751026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.751541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.751996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:34.752728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:34.753403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:34.753844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.143538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:35.160520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1135773d-6f3e-498c-b1e8-8af73f01991b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1218 microversion: 2.1 time: 0.441892 Sep 03 20:58:35.172944 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1293/2537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:34 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1218 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:35.173912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:35.178596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:35.196134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.200188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.205148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.206198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.207580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.209791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.272057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:35.288616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:35.305221 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d7bcd7f-c1a2-49a6-9422-fce7416b95d1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.740350 Sep 03 20:58:35.308747 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1245/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:34 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:35.600397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:35.601396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:35.612819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.615001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.617361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.618854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.622288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.624032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.832329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:35.879849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f93da6a9-618d-4f1e-af69-632edc4e53a0 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.289108 Sep 03 20:58:35.882196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1246/2539] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:35 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:35.893633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:35.893633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:35.905294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.906312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.915350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:35.917826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:35.918585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:35.919352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.098797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:36.112481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6f849da-38f0-4952-9f45-405fdd4fb742 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1472 microversion: 2.1 time: 0.949848 Sep 03 20:58:36.113401 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1294/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:35 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1472 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:36.127803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc74374f-f448-47a6-b7d1-643804422c02", "tag": "9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:36.153561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.154264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.154859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.186077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] Creating event network-changed:9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86 for instance dc74374f-f448-47a6-b7d1-643804422c02 on nch1-master-1 Sep 03 20:58:36.207767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c0dd3374-db66-4248-85ad-b713c51c6253 req-961521c2-118a-4852-9fc8-56a9c76b2cc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083002 Sep 03 20:58:36.208451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1295/2541] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:36.213964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:36.214936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:36.228780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.238367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.239177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.240142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.240922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.241442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.458402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:36.471513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e3445bd-56ea-4c63-b882-3d6f3e9c6e6b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1282 microversion: 2.1 time: 0.261542 Sep 03 20:58:36.472623 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1296/2542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:36 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:36.494790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:36.501537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:36.520729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.527056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.528452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.529553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.530924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.532327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.623286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:36.637479 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9041445-3f1a-4709-bdeb-07b5a4ac5cfb tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1541 microversion: 2.1 time: 0.753901 Sep 03 20:58:36.638484 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1247/2543] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:35 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1541 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:36.663100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:36.664707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:36.674545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.678341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.682721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:36.690274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:36.691063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:36.692400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.260014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:37.273296 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-807e044f-a92c-41b5-be1e-f6fc81c9790f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.782687 Sep 03 20:58:37.274129 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1297/2544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:36 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:37.282526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:37.291033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:37.303629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.305514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.306146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.311840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.312512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.317878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.380880 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc0fbdad-cffb-40e9-bfa4-ea692a5e5ea8 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.719316 Sep 03 20:58:37.385074 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1248/2545] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:58:36 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082/os-interface => generated 284 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:58:37.396847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:37.400650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:37.439961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.443692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.444200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.448404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.449033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.449487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.781984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:37.835272 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e282173-aca0-4a3a-b4dc-cdb5f6eab375 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.559879 Sep 03 20:58:37.847579 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1298/2546] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:37 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:37.867134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:37.868706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:37.889646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.890498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.892139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:37.893021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:37.893508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:37.898899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:38.184165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:38.207204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01d9daf0-d07f-40ab-b27a-c27e3103ecf0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1280 microversion: 2.1 time: 0.358194 Sep 03 20:58:38.210013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1299/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:37 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:38.252160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:38.265707 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e37ccfb-16e3-4e07-bb9e-63cb2975e44f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1490 microversion: 2.1 time: 0.878486 Sep 03 20:58:38.267855 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1249/2548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:37 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1490 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:38.299628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:38.300817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:38.316629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:38.317336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:38.322542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:38.323530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:38.324029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:38.324483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:38.434554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54311cf4-3843-466c-819b-366c0e7f1809", "tag": "fdf02620-cbc6-4d25-8409-7e73d58d6188"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:38.459373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:38.461108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:38.461783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:38.529102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] Creating event network-changed:fdf02620-cbc6-4d25-8409-7e73d58d6188 for instance 54311cf4-3843-466c-819b-366c0e7f1809 on nch1-master-1 Sep 03 20:58:38.539050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a299ffed-6dda-4702-8dcc-7707fd3729b8 req-da6537bf-054b-4de0-aee0-742f1ad5a8d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108310 Sep 03 20:58:38.541091 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1250/2549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:38.887799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:38.889121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:38.900654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:38.905855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:38.909680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:38.913845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:38.919553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:38.920233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:39.141853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:39.189905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd204eb3-f8fc-4082-8a7b-09fed596e0ac tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.316747 Sep 03 20:58:39.190518 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1251/2550] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:38 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:39.230754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:39.231436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:39.239219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:39.246468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:39.247147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:39.247704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:39.248658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:39.249539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:39.250978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:39.256427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e22e3e76-05ef-4d90-8917-2f1365b199f0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.962285 Sep 03 20:58:39.257907 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1300/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:38 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:39.301190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:39.302539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:39.321903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:39.322695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:39.323365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:39.325180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:39.327639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:39.330010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:39.483707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:39.493985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc30ce8b-3160-4587-837e-92f4abb6e828 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1280 microversion: 2.1 time: 0.267237 Sep 03 20:58:39.500002 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1252/2552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:39 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1280 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:40.058270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:40.068815 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-045b2868-fe4d-4c3b-a411-834486e76de0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.782332 Sep 03 20:58:40.070962 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1301/2553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:39 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:40.221596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:40.222226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:40.238965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.239474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.239922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.240642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.241307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.242311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.286476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:40.287466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:40.307472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.309205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.309818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.314720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.316215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.317589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.427075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:40.433380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:40.455542 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27722408-b730-4363-b5ab-d0180d260e60 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.238433 Sep 03 20:58:40.456764 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1253/2554] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:40 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:40.525417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:40.526461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:40.543348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.543866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.544347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.547434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:40.547912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:40.548353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:40.641857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:40.650527 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88d1a29b-a7b4-40e0-80b5-52c84b0dc036 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.368994 Sep 03 20:58:40.651125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1302/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:40 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:41.057068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aed6c85-7b16-4509-a569-5197641ec082", "tag": "19bffd6e-ec17-4c8e-bc49-ac030cf6cab9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:41.072378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.073616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.074577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.090444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] Creating event network-changed:19bffd6e-ec17-4c8e-bc49-ac030cf6cab9 for instance 0aed6c85-7b16-4509-a569-5197641ec082 on nch1-master-1 Sep 03 20:58:41.105827 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0365464c-c051-48b3-a507-0ca115b16c46 req-625bd59e-558d-4145-8dec-adfb88aa209a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056282 Sep 03 20:58:41.107511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1303/2556] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:41.116000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:41.118896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:41.143002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.143810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.144807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.145799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.146801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.148321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.414883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:41.427377 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7977e28d-f69a-47b8-ad20-748bb9c932a4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1280 microversion: 2.1 time: 0.907458 Sep 03 20:58:41.428603 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1254/2557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:40 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1280 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:41.444570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:41.459242 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-896a554e-6c90-4e5d-9186-8ff6283b25cd tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.349691 Sep 03 20:58:41.466334 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1304/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:41 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:41.489868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:41.490690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:41.497376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.498149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.498752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.499729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.500278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.500906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.675410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:41.676201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:41.684655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.695905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.696590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.697661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:41.699840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:41.700413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:41.751415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:41.805761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1fc2439e-ef97-4dc0-8010-e2f08be449a3 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1929 microversion: 2.75 time: 0.317798 Sep 03 20:58:41.807848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1255/2559] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:41 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1929 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:42.056543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:42.069543 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b28502c-30c9-454c-b972-817822df5ad7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.398992 Sep 03 20:58:42.070739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1305/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:41 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:42.455363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:42.455999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:42.471996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=28 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:42.473891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:42.479285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:42.483060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:42.484009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:42.484674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:42.492762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:42.493941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:42.497994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:42.502018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:42.513499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:42.517006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:42.517959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:42.529700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:42.530174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:42.867439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:42.876227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70df00c9-f3fc-4e4d-8940-9667dffa4a8e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.388163 Sep 03 20:58:42.876825 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1306/2561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:42 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:43.001043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-169958598", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "997056ce-178c-47cb-9487-493aaba31e81"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:43.095023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] validate_networks() for [('997056ce-178c-47cb-9487-493aaba31e81', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:43.189595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:43.200244 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54dcec19-d5af-4d67-9afc-964b4091c6df tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.749156 Sep 03 20:58:43.203460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1256/2562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:42 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:43.212863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:43.219821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:43.231114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:43.233490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:43.234124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:43.236811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:43.237475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:43.238068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:43.309648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:43.473427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:43.528246 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f4569a2-a079-418c-8bae-eccfba1f8426 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1935 microversion: 2.75 time: 0.323226 Sep 03 20:58:43.531772 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1257/2563] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:43 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1935 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:43.569328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:43.569963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:43.576582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:43.577121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:43.577569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:43.584066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:43.584634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:43.585105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:44.061759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:44.115503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:44.131048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-82ccab4c-0ca8-4e54-a8af-102bec702b0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.581898 Sep 03 20:58:44.132032 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1258/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:43 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:44.139070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6", "tag": "b4646074-79e7-4798-a6ce-8236bb0a0182"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:44.163491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:44.163981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:44.164412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:44.202789 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] Creating event network-changed:b4646074-79e7-4798-a6ce-8236bb0a0182 for instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 on nch2-master-1 Sep 03 20:58:44.214696 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c3a2e57b-dc75-4996-b629-f2ccf90b93e6 req-b87a816f-b78a-457f-a47b-d51d4c75e004 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081314 Sep 03 20:58:44.221354 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1259/2565] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:44.228196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66982bab-3959-42f5-8f17-3af0d4445435", "tag": "ab4988d5-5312-4540-b35a-26ec8297cc02"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:44.255376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:44.258695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:44.259177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:44.291116 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] Creating event network-changed:ab4988d5-5312-4540-b35a-26ec8297cc02 for instance 66982bab-3959-42f5-8f17-3af0d4445435 on nch2-master-1 Sep 03 20:58:44.304645 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-45076fb1-63f0-40b9-ab8a-b0a089e20927 req-eec88fbc-e785-4fa4-ad86-38eef0f022f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079951 Sep 03 20:58:44.305343 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1260/2566] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:44.317124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:44.321601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:44.340096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:44.340668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:44.341986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:44.344784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:44.346668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:44.347184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.024109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:45.034832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d6308cb-2cca-4fdc-96d0-f378490f241f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.722826 Sep 03 20:58:45.049534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1261/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:44 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:45.056840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:45.057754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:45.067790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.068842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.069826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.070731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.071540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.072241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.371995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:45.372469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:45.372920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:45.373338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:45.373768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:45.394857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.395594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.396198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.397174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.397787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.398398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.436018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:45.442993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for user 859a4503b4d84a4e8c3213e2de02492d and project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:45.471613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:45.474013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:45.550837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ee8e12df-4f24-4b13-b209-b823a56fbc1e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.668191 Sep 03 20:58:45.552196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1307/2568] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:58:45.557468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:45.558367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:45.565195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.566260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.566851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:45.567983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:45.568591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:45.569312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.031029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] Lazy-loading 'services' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:46.105822 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95b66ec1-0ec4-4834-835f-89c3877b1bb4 tempest-ServersAdmin275Test-413964678 tempest-ServersAdmin275Test-413964678-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1920 microversion: 2.75 time: 0.552238 Sep 03 20:58:46.108871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1308/2569] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:45 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1920 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:46.135357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:46.135999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:46.162659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.164637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.165141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.167072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.167549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.167994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.206368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:46.220991 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5bba4cc-2cc7-4af4-ba54-4d2851821fb7 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 1.170131 Sep 03 20:58:46.222724 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1262/2570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:45 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:46.234132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9baf2e9-be19-412c-b5a8-a164879a2d82 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:46.236107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9baf2e9-be19-412c-b5a8-a164879a2d82 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:46.592281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:46.608774 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4206fcfa-f141-4b24-8181-efed90830dde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.484101 Sep 03 20:58:46.610118 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1309/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:46 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:46.625019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f418a14-c2a7-4495-85ca-22f600a66d65", "name": "network-vif-plugged", "status": "completed", "tag": "434c214a-3a8a-4c83-ae50-679a35739a55"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:46.627925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9baf2e9-be19-412c-b5a8-a164879a2d82 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:46.635905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9baf2e9-be19-412c-b5a8-a164879a2d82 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1217 microversion: 2.1 time: 0.412135 Sep 03 20:58:46.636479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1263/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:46 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1217 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:46.651409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:46.658256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:46.661167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.663806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.664462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.672126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.672667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.676351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.677191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.677683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.678131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.693389 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] Creating event network-vif-plugged:434c214a-3a8a-4c83-ae50-679a35739a55 for instance 9f418a14-c2a7-4495-85ca-22f600a66d65 on nch2-master-1 Sep 03 20:58:46.705463 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-28357022-ddc0-4516-9e0e-d806e61f7555 req-e35a450d-2399-497c-809d-b82b8f7bb46d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093829 Sep 03 20:58:46.708810 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1310/2573] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:46.721859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:46.723038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:46.747568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.750303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.750922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.752917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:46.754886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:46.755487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:46.788521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:46.806998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:58:46.935926 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d4e8f2a-d344-4cc0-b7d2-52f133392f14 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 204 len: 0 microversion: 2.75 time: 0.225454 Sep 03 20:58:46.936785 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1311/2574] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 20:58:46 2022] DELETE /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 20:58:47.013551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1258793494", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "d1f5d216-964e-4a37-8231-dd7cfd0bae0c"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:47.084617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] validate_networks() for [('d1f5d216-964e-4a37-8231-dd7cfd0bae0c', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:47.299264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:47.314236 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8e3bba2-7697-401d-8478-14692b7cb93d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.667701 Sep 03 20:58:47.315452 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1264/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:46 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:47.320913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:47.321698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:47.329329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.330040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.330650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.331526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.332682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.333341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.654214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:47.655204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:47.656190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:47.657398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:47.658257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:47.658855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:47.674480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.675132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.675803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.677862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.678528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.679618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.680863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:47.682467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:47.702987 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4033692a-7097-45db-8baf-51ba33894bbb tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1444 microversion: 2.75 time: 0.385919 Sep 03 20:58:47.705712 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1265/2576] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:47 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1444 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:47.716030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Getting quotas for project 6047f3a5056d43549f602b273ad8eab3. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:47.724448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:47.729193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:47.732964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Getting quotas for user fba464c031484398bf568f091e5018a4 and project 6047f3a5056d43549f602b273ad8eab3. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:47.748962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:47.752368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:47.753274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.753797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.754242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.754968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.759116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.759604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.812255 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9fb3715a-046c-4969-8bc4-69a982b8d953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873813 Sep 03 20:58:47.813660 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1312/2577] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:58:47.819532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634febfe-8c24-4b5b-b3a4-69d50188e6a5", "tag": "ad4cbf56-ad6b-49a2-a335-192805e77853"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:47.830522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.831142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.831794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.845159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] Creating event network-changed:ad4cbf56-ad6b-49a2-a335-192805e77853 for instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 on nch1-master-1 Sep 03 20:58:47.851883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-24ff6be3-475d-4e15-bab9-cc4348a03e9a req-356cc5c9-2ce2-4cbb-a79d-8e867cdd925c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035522 Sep 03 20:58:47.852875 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1313/2578] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:47.864565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:47.865532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:47.872636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.874044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.874608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:47.875698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:47.876320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:47.876934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.132673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.142741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-be130333-8ad9-48f7-948b-6d568fbec0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.288435 Sep 03 20:58:48.143726 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1314/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:47 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:48.149962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:48.151434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:48.175871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.176682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.177551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.178462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.179080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.179664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.195912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.208014 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08bf609f-ec36-4f28-bc1b-40afcbb55525 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.500150 Sep 03 20:58:48.211166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1266/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:47 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:48.225308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-375644d4-102f-4878-be00-fefc68b74576 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:48.226116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-375644d4-102f-4878-be00-fefc68b74576 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:48.310175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.320298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa27ce6a-945a-4a3f-bfd7-b477b7788db8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1213 microversion: 2.1 time: 0.175259 Sep 03 20:58:48.321319 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1315/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:48 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:48.339146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:48.339490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:48.346026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.346621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.347132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.347957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.348495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.349034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.365335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-375644d4-102f-4878-be00-fefc68b74576 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.373050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-375644d4-102f-4878-be00-fefc68b74576 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1216 microversion: 2.1 time: 0.159513 Sep 03 20:58:48.374170 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1267/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:48 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:48.652570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.661236 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-018ca3c1-a98a-41cb-8311-6ff93b5c860c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.326664 Sep 03 20:58:48.661819 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1316/2583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:48 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:48.732949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:48.733579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:48.750623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.751484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.751623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.752275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.752763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.783579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.789637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc74374f-f448-47a6-b7d1-643804422c02", "name": "network-vif-plugged", "status": "completed", "tag": "9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86"}, {"server_uuid": "54311cf4-3843-466c-819b-366c0e7f1809", "name": "network-vif-plugged", "status": "completed", "tag": "fdf02620-cbc6-4d25-8409-7e73d58d6188"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:48.807057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:48.807551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:48.808041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:48.842767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Creating event network-vif-plugged:9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86 for instance dc74374f-f448-47a6-b7d1-643804422c02 on nch1-master-1 Sep 03 20:58:48.845378 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] Creating event network-vif-plugged:fdf02620-cbc6-4d25-8409-7e73d58d6188 for instance 54311cf4-3843-466c-819b-366c0e7f1809 on nch1-master-1 Sep 03 20:58:48.878012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-87611021-7c01-40e1-be1f-795ef802ea90 req-ccd149d1-be66-43b1-923d-ac52166eed09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082404 Sep 03 20:58:48.878922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1317/2584] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:48.977656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.987735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.989576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:48.996428 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8958429c-5ce4-4add-8723-4e152c7be828 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1444 microversion: 2.75 time: 0.267310 Sep 03 20:58:49.010077 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1268/2585] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:48 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1444 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:49.166473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:49.167191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:49.173905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.174409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.174902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.175623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.176086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.176627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.235938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:49.236639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:49.243659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.244154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.244595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.245359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.245815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.246417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.404644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:49.414370 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-025866f1-cc97-4637-a790-3b8d2933625c tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.182141 Sep 03 20:58:49.415477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1269/2586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:49 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:49.435549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:49.436413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:49.452130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.458724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.459364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.460141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.460615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.461124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.542896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:49.552855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47ac9cbd-106c-4f8f-b589-e9ec6a4ed3e6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1269 microversion: 2.1 time: 0.126794 Sep 03 20:58:49.554153 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1270/2587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:49 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:49.559272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:49.560188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:49.574519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.575483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.576054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.576917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.577705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.578409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.635897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:49.645071 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e7de7dd-cc09-4c68-b44c-e852c113ea05 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.482505 Sep 03 20:58:49.657161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:49.657657 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1318/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:49 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:49.662242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5db2caa6-62a9-45fe-9d82-7e2671682b79 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1268 microversion: 2.1 time: 0.104647 Sep 03 20:58:49.662242 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1271/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:49 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:49.691190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:49.691809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:49.698532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.699053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.699532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.700453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:49.700934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:49.701370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:49.850571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:49.859200 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-468a396d-90e3-42ae-86b5-884b728faf15 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.172686 Sep 03 20:58:49.861176 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1319/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:49 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:50.025934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.026554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.034290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.034785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.035221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.036136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.036598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.037088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.104758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.108453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:50.114036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.115497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.120543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a5a43c5-2914-4b97-9f93-b46bebb795c9 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1444 microversion: 2.75 time: 0.098764 Sep 03 20:58:50.121152 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1272/2591] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:50.439438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.440109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.446180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.446664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.447108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.447799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.448257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.448706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.575702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.576503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.584112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.591152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.591656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.592096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.592821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.593303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.593765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.598335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bba88f5d-8749-4a7b-a45f-3283576807d0 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.163365 Sep 03 20:58:50.599234 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1320/2592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:50.669731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.670355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.679286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.683794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.686587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.687228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.688951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.689563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.690144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.693210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2c74022-b212-4cbd-9b04-64af42fd460c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1269 microversion: 2.1 time: 0.118825 Sep 03 20:58:50.693917 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1273/2593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:50.705142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.705142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.722867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.724942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.726329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.727427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.727966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.728540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.854475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.864951 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc7202ad-09cf-4a08-a46c-313cf8066151 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1268 microversion: 2.1 time: 0.169449 Sep 03 20:58:50.865721 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1274/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:50.883470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:50.884188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:50.891476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.891955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.892520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.893465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:50.893962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:50.894407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:50.932737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:50.955399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8798710c-fb7d-4b1e-9679-c6ac8f0ae15f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.289449 Sep 03 20:58:50.956115 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1321/2595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:51.065212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.074147 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c61afca-f5d2-4ae2-bfd9-6d6ea433fab2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1478 microversion: 2.1 time: 0.194493 Sep 03 20:58:51.074756 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1275/2596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:50 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:51.150409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:51.150409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:51.157111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.157404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.157930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.158646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.159114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.159558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.309654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.323600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.327550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.338930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:51.342685 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-17cc10b8-0263-4681-9814-365b1067e485 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1444 microversion: 2.75 time: 0.196195 Sep 03 20:58:51.346475 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1322/2597] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:51 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 20:58:51.623680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:51.629862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:51.637298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.638004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.638624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.639361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.640946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.642520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.720532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:51.721360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:51.743077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.744004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.744711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.745785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.746697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.747346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.860267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.871730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-acd7c9dd-34f1-435f-9f8d-54c14557da24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1287 microversion: 2.1 time: 0.155652 Sep 03 20:58:51.872994 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1323/2598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:51 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:51.891162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:51.892776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:51.902025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.902517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.903013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.903737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:51.904238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:51.904740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:51.971624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.991094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:51.999833 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aa75eac3-82c6-4b69-a8d6-88e9d40b36bf tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1276 microversion: 2.1 time: 0.112942 Sep 03 20:58:52.000408 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1324/2599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:51 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:52.005843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:52.006127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-abd3f19f-1358-4be2-8114-2b0a22385ece tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.387770 Sep 03 20:58:52.013868 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1276/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:51 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:52.021256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.029600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.030319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.030942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.033277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.034011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.034728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.098056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:52.099339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.119222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.119827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.120338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.121336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.123942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.124599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.225160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.234040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4167eca-0114-4f7b-aacb-b9cd09e8cfa3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.231680 Sep 03 20:58:52.235162 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1325/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:52 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:52.243289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66982bab-3959-42f5-8f17-3af0d4445435", "name": "network-vif-plugged", "status": "completed", "tag": "ab4988d5-5312-4540-b35a-26ec8297cc02"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:52.255036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.256075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.256977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.271514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] Creating event network-vif-plugged:ab4988d5-5312-4540-b35a-26ec8297cc02 for instance 66982bab-3959-42f5-8f17-3af0d4445435 on nch2-master-1 Sep 03 20:58:52.276846 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0998509a-e6ac-47ad-a2f4-dbe6e0fa83bf req-06a704f4-e0e9-4ddd-b6a3-3199fb05f226 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038346 Sep 03 20:58:52.277801 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1326/2602] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:52.379651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:52.380455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.396782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.397302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.397750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.398817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.398981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.399352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.451678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.452190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.452640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.453695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lazy-loading 'fault' on Instance uuid 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:58:52.496568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.518102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e036cd6-4e4d-4abb-aca3-b251725ab408 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1464 microversion: 2.1 time: 0.424639 Sep 03 20:58:52.519573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1277/2603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:52 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1464 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:52.541329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:52.542249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.543541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.549966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.550843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.551752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.552807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.553517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.554148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.556984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.560853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9baf371d1c0942eda0b4ea9466b03b79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c65af796be74447b2bbba4e8b9d4f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.575903 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12efc518-f337-4d77-a3ff-c4a3db3cd88f tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 200 len: 1449 microversion: 2.75 time: 0.201758 Sep 03 20:58:52.576498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1327/2604] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:52 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 1449 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 20:58:52.824420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:52.833122 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f9821678-5a14-49a6-af2f-553ab776c668 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1464 microversion: 2.1 time: 0.295702 Sep 03 20:58:52.834036 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1278/2605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:52 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:52.856674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:52.859709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.866752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.867331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.867845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.868636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.869131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.869562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.895964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:52.896761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:52.903497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.904199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.905157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.905701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:52.907325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:52.907694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:52.946687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:52.961897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:52.962411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:52.962966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:52.963558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:52.963985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:52.995200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:53.004173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea3bb4b6-d899-4177-be65-5968b9520473 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1275 microversion: 2.1 time: 0.112522 Sep 03 20:58:53.004966 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1279/2606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:52 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:53.029000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:53.030452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.036913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.037626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.038260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.039211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.039873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.040473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.040885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.047972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.048736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.049218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.050121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.050580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.051206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.085892 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08d5bc5e-57b2-4192-bded-6db813ec7714 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 1068 microversion: 2.1 time: 0.232944 Sep 03 20:58:53.086991 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1328/2607] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:58:52 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 1068 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 03 20:58:53.092596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:53.093524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.100610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.101785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.102631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.103637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.104244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.104922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.172049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:53.180530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ea57dde-097f-4771-87e3-ea74b918c953 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1274 microversion: 2.1 time: 0.158059 Sep 03 20:58:53.181488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1280/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:53 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:53.186739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:53.188153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.202102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:53.209617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.210231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.211019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.212128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.213909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.214585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.265288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:53.276671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a885b64a-ed7e-4b97-aeeb-57110e2ff23f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.188016 Sep 03 20:58:53.285139 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1329/2609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:53 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:53.293511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:53.294137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.300619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.301163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.301635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.302345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.302797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.303225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.488037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:53.496534 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-892a40aa-f519-4438-b544-7772ca1aa6f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1317 microversion: 2.1 time: 0.217609 Sep 03 20:58:53.497548 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1330/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:53 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:53.564701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:53.576030 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46dcb777-6d64-47fa-b504-3695abd69472 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.393115 Sep 03 20:58:53.577233 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1281/2611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:53 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:53.613305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:53.613928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] [instance: 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:53.620230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.620943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.621635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.622205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:53.622675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:53.623123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:53.649392 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] HTTP exception thrown: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Request method failure captured: Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c HTTP/1.1 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-47FomBUYwH0XRyxUeLFUJiXfYLZ2pPItGHHbOmmVo93oquuGXRjZmRs247VuPy-IwEdojyHY5gEmOz7y_AeP_7ORzKl72MWbMrPw9HOLREUUByCQi0NIhet2KH-iDma_zl5FMhy72VBc0pxKfmsqFPYp24ZMTJzi99jCWO-Q6U4E Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.75 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0c65af796be74447b2bbba4e8b9d4f35 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdmin275Test-732349635 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c65af796be74447b2bbba4e8b9d4f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c65af796be74447b2bbba4e8b9d4f35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c65af796be74447b2bbba4e8b9d4f35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c65af796be74447b2bbba4e8b9d4f35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdmin275Test-732349635 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0c65af796be74447b2bbba4e8b9d4f35 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdmin275Test-732349635 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdmin275Test-732349635-project Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9baf371d1c0942eda0b4ea9466b03b79 Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdmin275Test-732349635-project Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '21bf8f88-f1ad-43c3-ad6b-82c13b65f52c'} Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:58:53.650952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] Returning 404 to user: Instance 21bf8f88-f1ad-43c3-ad6b-82c13b65f52c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2e2eca68-1b67-4bb7-8dff-a8dfddea3ba1 tempest-ServersAdmin275Test-732349635 tempest-ServersAdmin275Test-732349635-project] 10.222.0.16 "GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c" status: 404 len: 111 microversion: 2.75 time: 0.044377 Sep 03 20:58:53.658701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1331/2612] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 20:58:53 2022] GET /compute/v2.1/servers/21bf8f88-f1ad-43c3-ad6b-82c13b65f52c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:58:54.030690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:54.036599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:54.040098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.040604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.041080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.041802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.042259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.042685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.206381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:54.207273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:54.214751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.215486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.216020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.216784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.217465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.218181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.449963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:54.460673 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-923609e8-cb3c-4aad-8b29-6a9df52e1c94 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.258974 Sep 03 20:58:54.462322 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1332/2613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:54 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:54.470075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:54.470955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:54.483757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.485320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.485961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.486955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.487594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.488311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.652974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:54.665425 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25c40e85-ea73-479e-865b-57ffbb370fc9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.201486 Sep 03 20:58:54.683059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1333/2614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:54 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:54.688758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6", "name": "network-vif-plugged", "status": "completed", "tag": "b4646074-79e7-4798-a6ce-8236bb0a0182"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:54.698985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.699400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.699860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.714471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] Creating event network-vif-plugged:b4646074-79e7-4798-a6ce-8236bb0a0182 for instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 on nch2-master-1 Sep 03 20:58:54.719748 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3bce49e5-3d8f-42ff-bb0a-e45793943907 req-96b5a0a1-6b48-4c0e-8deb-bb78d50019ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035096 Sep 03 20:58:54.720466 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1334/2615] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:54.725845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:54.726680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:54.733357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.734085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.734755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.735737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.736395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.736875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.891349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:54.900155 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f11bc03-a43e-445a-a0fb-d203b6740156 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.873308 Sep 03 20:58:54.900962 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1282/2616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:54 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:54.948445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:54.952360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:54.963994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.965982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.969006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:54.970402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:54.972824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:54.973439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.005086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.013076 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7fd6380-58a7-46ad-91be-4dba778e33de tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1467 microversion: 2.1 time: 0.291212 Sep 03 20:58:55.030973 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1335/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:54 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1467 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:55.039066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.040178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:55.048079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.048845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.049876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.050986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.051725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.052375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.285841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.293917 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8d1a976-1970-466a-a4a5-b12fa6fd336f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1466 microversion: 2.1 time: 0.258946 Sep 03 20:58:55.294619 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1336/2618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:55.318169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.323268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.324157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Searching by: {'reservation_id': 'r-kftku74y', 'deleted': False, 'project_id': '5a2f3c186f88497181cf6a1d806631b1'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:55.329549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.330039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.330657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.331419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.332148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.332929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.405976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.415492 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a62a068f-a8d1-4713-bc26-254886d726d9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.475594 Sep 03 20:58:55.416199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1283/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:54 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:55.482667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:55.492143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.492770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:55.499519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.500005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.500438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.501184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.501662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.502205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.556019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.563540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.564037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.564681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.695623 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c63d81df-7889-4bdc-8668-54f1f9208350 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-kftku74y" status: 200 len: 2926 microversion: 2.1 time: 0.381724 Sep 03 20:58:55.698615 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1337/2620] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-kftku74y => generated 2926 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:55.713083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a", "tag": "79ca652d-8a93-487e-9b4e-7df80b9fd1f2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:55.744651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.745161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.745598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.763031 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] Creating event network-changed:79ca652d-8a93-487e-9b4e-7df80b9fd1f2 for instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a on nch2-master-1 Sep 03 20:58:55.774179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-40f6c2d8-4bd2-4db0-ad24-b8f2fe54e250 req-43c2bb9e-281e-433a-b452-68a32fe81199 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064519 Sep 03 20:58:55.776189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1338/2621] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:55.783755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.785134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:55.791412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.791907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.792346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.793253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.793862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.794438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.846823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.855159 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18860008-bf3b-44fa-b494-211377d13d1a tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.369167 Sep 03 20:58:55.856245 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1284/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:55.861950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.887605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_groups [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Querying cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) for 2 instances {{(pid=140519) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 03 20:58:55.889016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.889749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.890956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.915267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-44d04a52-b7d3-416a-a19f-e43f9223ca55 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/66e52705-5c0b-448d-a7f7-678d58b2e2e5" status: 200 len: 266 microversion: 2.1 time: 0.057554 Sep 03 20:58:55.917558 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1285/2623] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/os-server-groups/66e52705-5c0b-448d-a7f7-678d58b2e2e5 => generated 266 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:55.927133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.929513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:55.936799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.937646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.938306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.939217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.939854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.940494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.968265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:55.979844 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29215441-9e3a-4c93-93e6-9082695f4bd6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1322 microversion: 2.1 time: 0.202418 Sep 03 20:58:55.980623 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1339/2624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:55.986645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:55.987473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:55.993762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.994847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:55.995303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:55.998881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:55.999370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.000545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.190456 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4bf11e1-638e-4a9c-aaf5-475cf02dc661 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 200 len: 1618 microversion: 2.1 time: 0.208584 Sep 03 20:58:56.206545 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1340/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 1618 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:56.219899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:56.220515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:56.237574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.238004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.238451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.239251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.239721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.240154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.289977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:56.302029 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4eb525bc-7f2b-4b99-b98c-a59e88b49d2c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.381015 Sep 03 20:58:56.302958 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1286/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:55 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:56.397188 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a775035c-2e44-4af8-ab5c-494c8f595c67 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1617 microversion: 2.1 time: 0.186986 Sep 03 20:58:56.397780 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1341/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:56 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1617 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:56.422117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: .version_select at 0x7fae66498e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2028049204", "policies": ["anti-affinity"]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:56.442656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:56.449308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:56.451323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:56.451955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:56.458882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.460133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.461005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.461812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.462279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.462714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.557931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:56.565340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:56.583965 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d9644f7-5ece-45cb-9d3d-1ec4d6291feb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.166196 Sep 03 20:58:56.584701 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1287/2628] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Sep 3 20:58:56 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:56.711992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:56.720784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f6c40b5f-3c45-4a75-aeb0-738fa9a3bea1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.284271 Sep 03 20:58:56.737149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1050909962", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3a315ac1-45b1-4cba-943a-ad1ad1273ce6"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:56.738221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1342/2629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:56 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:56.747731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634febfe-8c24-4b5b-b3a4-69d50188e6a5", "name": "network-vif-plugged", "status": "completed", "tag": "ad4cbf56-ad6b-49a2-a335-192805e77853"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:56.758174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.759006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.759604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.773044 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] Creating event network-vif-plugged:ad4cbf56-ad6b-49a2-a335-192805e77853 for instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 on nch1-master-1 Sep 03 20:58:56.779761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6c17a757-706b-401f-9611-85acf90dda5b req-2d81c049-18aa-44aa-8e39-0fc68347b23a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 Sep 03 20:58:56.780923 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1343/2630] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:56.789665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:58:56.883790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:56.885255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:56.893759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.894609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.895225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:56.896129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:56.896594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:56.897368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.063047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.074990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0c8469f-45e8-41e6-9a10-e4f9468ac274 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.195812 Sep 03 20:58:57.076299 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1344/2631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:56 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:57.082167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.082960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:57.096403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.097214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.097939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.099952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.100556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.101170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.122332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:57.281858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.291776 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c6aea3f-d373-43ed-9c2a-de0e19eba00e tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 200 len: 1516 microversion: 2.1 time: 0.212409 Sep 03 20:58:57.292643 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1345/2632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:57.314073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.314696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:57.320858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.321396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.321841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.322557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.323025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.323457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.367592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:58:57.368320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:58:57.369302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:58:57.369923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:58:57.373276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:58:57.391558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.392301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.394042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.395127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.395690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.396991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.423811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:57.429973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:57.443281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 2 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:58:57.446035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:57.483396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.487720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140519) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 03 20:58:57.494927 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d437b6e-62d4-44a4-861c-2b0c35f8e0ab tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1322 microversion: 2.1 time: 0.184651 Sep 03 20:58:57.495522 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1346/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:57.502889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.503726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:57.509811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:57.510176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.511025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.511624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.512486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.513173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.513843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.516625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:57.564259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:57.571123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:57.587567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=510591bb-0231-4c0d-a54a-d403336b6cdb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:58:57.639829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:57.645707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:57.660815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:57.661268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.669194 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0b67653-d3c5-43c7-a8d5-f490aaedb369 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.172494 Sep 03 20:58:57.669943 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1347/2634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:57.682014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:58:57.687839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'server_group_members'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:58:57.723937 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-69441bb9-fc68-4641-86dd-b3919da8b0c0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.006895 Sep 03 20:58:57.727375 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1288/2635] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:58:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 03 20:58:57.732965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.737838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.738608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Searching by: {'deleted': False, 'project_id': '5a2f3c186f88497181cf6a1d806631b1'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:58:57.755965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.756464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.756935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.757677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.758140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.758575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.786398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:58:57.816071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.816845 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-979cf904-0e19-4336-85b8-4e2c9c066d10 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.088221 Sep 03 20:58:57.825025 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1289/2636] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers => generated 1660 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.825155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.829734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.830466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:57.836654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.837364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.837773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.839147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.839684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.840188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.848730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e32109a3-50b0-4a26-9e2c-6a229cf055b2 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.177925 Sep 03 20:58:57.849426 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1348/2637] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/os-services => generated 947 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:57.861029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9322b2-56c1-474b-8557-753d8c727874", "tag": "05422449-ac98-44f2-bb4f-e3ddc53b0866"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:58:57.874185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.875372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.875820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.889008 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] Creating event network-changed:05422449-ac98-44f2-bb4f-e3ddc53b0866 for instance cf9322b2-56c1-474b-8557-753d8c727874 on nch2-master-1 Sep 03 20:58:57.894673 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c65d6fe6-0cc3-418a-bc79-05925b310907 req-fcb3814f-29e7-4278-a419-bfbd5051fce1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043890 Sep 03 20:58:57.895542 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1349/2638] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:57.900576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-039b88c0-b527-4902-830c-9f4cd084143e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.901320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-039b88c0-b527-4902-830c-9f4cd084143e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:57.965334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-039b88c0-b527-4902-830c-9f4cd084143e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.974148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-039b88c0-b527-4902-830c-9f4cd084143e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1219 microversion: 2.1 time: 0.077422 Sep 03 20:58:57.974857 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1350/2639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:57.985361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:57.985518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:57.989500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.990075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.990601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.991585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:57.992122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:57.992629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:57.995119 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-31eebd12-775b-4c5f-a1b5-f2d8f88b51e5 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.176619 Sep 03 20:58:57.995688 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1290/2640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:58.017936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3aee08bd-9661-4ba7-8601-91dc62e6b343 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.042119 Sep 03 20:58:58.018630 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1351/2641] 10.222.0.16 () {58 vars in 1174 bytes} [Sat Sep 3 20:58:57 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:58.032201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.045293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.045940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.046396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.047132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.047574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.048003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.053119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:58.073008 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0a2b816-24c9-4f1c-ad90-f76c7723c8d6 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045071 Sep 03 20:58:58.073739 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1291/2642] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:58.087364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.090944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.091461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.091904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.092657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.093358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.094427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.099273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.099900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:58.106444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.106939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.107563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.108419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.109172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.109837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.123216 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ca67ac7-305d-47f7-9bd7-4b7becaa7491 tempest-ServicesAdminTestJSON-127546994 tempest-ServicesAdminTestJSON-127546994-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039710 Sep 03 20:58:58.124146 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1352/2643] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/os-services => generated 947 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:58:58.326249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:58.336310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02acef22-2ef0-4f8e-8372-6b9f4806085f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.240952 Sep 03 20:58:58.337755 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1292/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:58:58.522844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.524055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:58.531079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.531564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.531998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.532690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.533289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.533727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.694473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.695103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:58.701517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.702207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.702655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.703416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:58.703881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:58.704315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:58.720286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:58.729665 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-103427a9-677c-434e-a248-3d88a3ed0b74 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1322 microversion: 2.1 time: 0.210845 Sep 03 20:58:58.730238 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1353/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:58.849652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:58.859390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa435eea-8c30-4eeb-beb9-f5c7bfe55944 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.169424 Sep 03 20:58:58.860063 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1293/2646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:58.996280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:58.996955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:59.004091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.004840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.005327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.006040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.006498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.006930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.021336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:59.028538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:59.045308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.045841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.046905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.047622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.050042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.050494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.111786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:59.127303 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06a2d7e5-a5b0-464d-9f76-81828157978d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1271 microversion: 2.1 time: 0.134705 Sep 03 20:58:59.129249 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1354/2647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:58 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:59.295088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:59.309904 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c947094-dac8-4afc-bf1f-b8492209b09b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.292225 Sep 03 20:58:59.310554 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1294/2648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:59 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:59.365151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:59.366050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:59.373850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.374525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.375333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.376437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.377392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.378065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.628072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:58:59.636524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75fd1c59-cdd2-402c-ab39-683bee404e56 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.275661 Sep 03 20:58:59.653271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1355/2649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:59 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:58:59.752149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:59.752771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:59.768705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.769242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.769690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.770407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.770871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.771438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.884087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:58:59.884938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:58:59.891611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.892112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.892556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:58:59.893481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:58:59.894168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:58:59.894834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.054889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:00.065150 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12cc48c9-45af-4ce8-87e1-5996c66f2637 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.184803 Sep 03 20:59:00.066350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1356/2650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:59 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:00.158865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:00.159668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:00.167026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.167608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.168615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.169438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.170122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.170632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.258944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:00.270138 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48bc40a4-d22a-4f3b-bf06-4c06ef2502ea tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1271 microversion: 2.1 time: 0.116040 Sep 03 20:59:00.271483 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1357/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:00 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:00.345321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:00.346491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:00.361930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.363093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.364535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.365984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.367159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.370299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.469394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:00.484736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a8137d9-1096-433f-b492-b26c3736b2cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1516 microversion: 2.1 time: 0.736391 Sep 03 20:59:00.487736 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1295/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:58:59 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1516 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:00.514483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:00.515415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:00.525730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.526989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.528513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.531509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.532157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.534046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.658814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:00.666085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ddfc625-5ed7-4d40-b51f-61959ebcc528 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.332311 Sep 03 20:59:00.666669 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1358/2653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:00 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:00.673738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:00.674592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:00.680979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.681777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.682441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.683236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:00.683836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:00.684348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:00.932202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:00.951901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b559b0d-9ee2-4763-840e-f3580fbb0345 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.282385 Sep 03 20:59:00.968536 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1359/2654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:00 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:01.009077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:01.018245 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed463e5c-7975-4ab8-bfed-d66c675c64f6 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 200 len: 1515 microversion: 2.1 time: 0.508003 Sep 03 20:59:01.019404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1296/2655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:00 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:01.042444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.043382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:01.051908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.052733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.053205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.054941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.055413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.056666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.085694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:01.091142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.092048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:01.099660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.100562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.101290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.102221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.102893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.103543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.201058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:01.212074 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e139b1c9-65a9-4108-a85a-1c6cbf195cac tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 204 len: 0 microversion: 2.1 time: 0.172848 Sep 03 20:59:01.213321 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1360/2656] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:01 2022] DELETE /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:01.222158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.222883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:01.230479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.231089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.231645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.232406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.233074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.233589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.470483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:01.479932 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22db67ab-e86c-472f-a9c3-5dabc807e87b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.392539 Sep 03 20:59:01.480857 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1297/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:01 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:01.493466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.494443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:01.502234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.503015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.503699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.504802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.505515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.506173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.551403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:01.559466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b751223-d44d-4ed1-8dca-643fbe7d7394 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 200 len: 1521 microversion: 2.1 time: 0.342087 Sep 03 20:59:01.560532 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1361/2658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:01 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:01.574816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:01.585656 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9790b18-3d1f-42ed-aba6-36eaeedfa49b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1277 microversion: 2.1 time: 0.103530 Sep 03 20:59:01.586263 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1298/2659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:01 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:01.691367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.691984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:01.700830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.701359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.701801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.702512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:01.705655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:01.707993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:01.983939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:01.988729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:02.006427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.011903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.016673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:02.019479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.020875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.024032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:02.083922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:02.097042 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-03a1d08c-daed-4e5f-b0df-924e05590ccf tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.410877 Sep 03 20:59:02.101447 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1362/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:01 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:02.426919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:02.450323 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9419d028-a19c-4e3d-a303-a74dad9c2017 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.473284 Sep 03 20:59:02.454369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1299/2661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:01 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:02.506006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:02.506551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:02.539966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.540610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.541105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:02.541873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.542399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.542769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:02.584090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:02.584705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:02.599225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.601059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.601512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:02.607191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:02.607729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:02.608441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.025425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:03.037942 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89b8a038-64d9-43f9-a578-daf20185b77f tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 200 len: 1521 microversion: 2.1 time: 0.456425 Sep 03 20:59:03.038932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1300/2662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:02 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:03.050306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:03.054353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:03.069420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.069979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.070433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.071160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.071623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.072058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.289311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:03.313956 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ab89c50-9b6c-4f33-a303-4edd93046dc6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.810309 Sep 03 20:59:03.322573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:03.324888 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1363/2663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:02 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:03.334052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9322b2-56c1-474b-8557-753d8c727874", "name": "network-vif-plugged", "status": "completed", "tag": "05422449-ac98-44f2-bb4f-e3ddc53b0866"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:03.345550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-686b77e1-499d-4d00-b287-5f43144e08a8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.299152 Sep 03 20:59:03.346139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1301/2664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:03 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:03.353882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:03.354697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:03.366283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.366837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.367280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.367580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.368841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.371008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.371996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.373162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.375574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.398597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:03.403012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] Creating event network-vif-plugged:05422449-ac98-44f2-bb4f-e3ddc53b0866 for instance cf9322b2-56c1-474b-8557-753d8c727874 on nch2-master-1 Sep 03 20:59:03.411288 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-922b9da7-c7c5-4261-be14-a1b38a5cb9e3 req-a925d70f-365e-46fa-aa3e-7fe775ac8d7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084843 Sep 03 20:59:03.412570 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1364/2665] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:03.481533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:03.482668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:03.501267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.501775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.502238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.511257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.511963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.512425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.793074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:03.806843 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-797356d5-1c8f-4dbf-92b1-0d33910b6361 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.457491 Sep 03 20:59:03.807914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1302/2666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:03 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:03.817865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66982bab-3959-42f5-8f17-3af0d4445435", "name": "network-vif-deleted", "tag": "ab4988d5-5312-4540-b35a-26ec8297cc02"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:03.842097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:03.842409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:03.842998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:03.873822 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] Creating event network-vif-deleted:ab4988d5-5312-4540-b35a-26ec8297cc02 for instance 66982bab-3959-42f5-8f17-3af0d4445435 on nch2-master-1 Sep 03 20:59:03.883236 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e23eeeb1-0da5-4041-88b0-a802091ccd37 req-037cac0c-be8b-4245-9207-01c3f4464915 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073822 Sep 03 20:59:03.884501 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1303/2667] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:04.065377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:04.066784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:04.075926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.081222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.081868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.085155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.085857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.086474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.124030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:04.141596 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3db34c44-069f-4174-bb8a-c67465d68292 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.665087 Sep 03 20:59:04.145776 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1365/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:03 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:04.166108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.167534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.168205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.169071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lazy-loading 'fault' on Instance uuid 66982bab-3959-42f5-8f17-3af0d4445435 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:04.258290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:04.271386 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0594682c-8def-46f9-bb56-2b93b647c5e3 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 200 len: 1312 microversion: 2.1 time: 0.211168 Sep 03 20:59:04.273910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1304/2669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:04 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:04.359649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:04.362980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:04.382613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:04.384177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:04.393289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.393819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.394361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.395099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.395467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.396039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.396657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.396833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.397399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.398189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.398888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.399397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.610060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:04.618623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2773d9f0-9663-470f-994e-27e0189a96a2 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.246288 Sep 03 20:59:04.629282 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1305/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:04 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:04.645234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d09915-197d-436d-9e4e-1d16d7efbc4c", "tag": "4d6cb81a-21f6-4aa5-8457-63545b5d7cd9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:04.655035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.655516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.655999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.679079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] Creating event network-changed:4d6cb81a-21f6-4aa5-8457-63545b5d7cd9 for instance e6d09915-197d-436d-9e4e-1d16d7efbc4c on nch1-master-1 Sep 03 20:59:04.681557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:04.685985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5fd499c0-fdd7-4847-8810-b76aa0849da3 req-bc9cf8ed-351a-4cf1-9b7f-6a02756977e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055052 Sep 03 20:59:04.688306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1306/2671] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:04.699682 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-362ab9de-406c-497d-b83c-2a9efa7ae215 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.352237 Sep 03 20:59:04.700816 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1366/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:04 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:04.840409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:04.841162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:04.854189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.854885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.855468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:04.856344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:04.856977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:04.857562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.006695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:05.016544 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a734ca9d-3821-4664-8a18-3a4270afc040 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.188702 Sep 03 20:59:05.020729 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1307/2673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:04 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:05.183131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:05.184693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:05.204832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.207280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.208850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.210571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.216376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.217177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.296179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:05.297784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:05.307748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.308335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.308845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.309964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.310483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.310979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.360791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.361813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.362897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.363382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lazy-loading 'fault' on Instance uuid 66982bab-3959-42f5-8f17-3af0d4445435 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:05.449754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:05.459320 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a74939c3-f388-45d8-953c-6b0bc8c37ded tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 200 len: 1312 microversion: 2.1 time: 0.167348 Sep 03 20:59:05.476717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1308/2674] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:05 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:05.647364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:05.649007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:05.660641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.662186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.662993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.663963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.664672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.665454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.684628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:05.840733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:05.856767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cbb79c2-0155-4d58-bb66-62b1f40bea7f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.213290 Sep 03 20:59:05.857541 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1309/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:05 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:05.877487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:05.879482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:05.886733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.887654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.888219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.889035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.889668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.891482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.898444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:05.909509 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7338b824-0a70-40dd-afa3-6235810ace8f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1316 microversion: 2.1 time: 0.742647 Sep 03 20:59:05.915241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1367/2676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:05 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:05.925366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510591bb-0231-4c0d-a54a-d403336b6cdb", "tag": "e4dfcddc-eed7-463b-b3bd-77a017e4614b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:05.944875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:05.954004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:05.954465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:05.966586 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] Creating event network-changed:e4dfcddc-eed7-463b-b3bd-77a017e4614b for instance 510591bb-0231-4c0d-a54a-d403336b6cdb on nch2-master-1 Sep 03 20:59:05.975492 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7bf3c117-3ca0-47b4-ace0-25c05067296b req-91a4c858-051d-4d49-b8e2-de30a269ebb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058566 Sep 03 20:59:05.976407 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1368/2677] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:06.024721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a", "name": "network-vif-plugged", "status": "completed", "tag": "79ca652d-8a93-487e-9b4e-7df80b9fd1f2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:06.036041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.036931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.038116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.057325 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] Creating event network-vif-plugged:79ca652d-8a93-487e-9b4e-7df80b9fd1f2 for instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a on nch2-master-1 Sep 03 20:59:06.064845 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c354021f-f883-4f5e-b157-7e5e1bd2b2d8 req-2e57e912-704b-4467-854b-13e25697b11d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043922 Sep 03 20:59:06.066628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1369/2678] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:06.073531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.074267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:06.075054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:06.085487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.085801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d984e5be-8561-4551-b989-26adfd858c52 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.227061 Sep 03 20:59:06.086720 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1310/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:05 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:06.087765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.088134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.088876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.089370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.089833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.331266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:06.340025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38fdcc0c-123e-4b86-9126-e1102de9294f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.271814 Sep 03 20:59:06.349171 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1370/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:06.484120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.484796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:06.491610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.492144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.492591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.493491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.493990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.494425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.510607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] HTTP exception thrown: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 HTTP/1.1 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '66982bab-3959-42f5-8f17-3af0d4445435'} Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.512278 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 404 to user: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:06.516485 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-226900d5-46a3-4fb5-8cd1-5de4133f2850 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 404 len: 111 microversion: 2.1 time: 0.034325 Sep 03 20:59:06.519356 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1311/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:06.525039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.530953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:06.532090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:06.537695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.538615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.539064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.539803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.540261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.540684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.615938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c1b4a46-e61e-4a8b-ae66-0be67cc1d2d1"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:06.619492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:06.626919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.627562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.628265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.629762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.630457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.631282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.649703 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ca8d786-10dc-49a3-905f-802823bde7ca tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.129123 Sep 03 20:59:06.654771 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1371/2682] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:59:06.670135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4734da1a-136a-4f71-98b5-51fdd1274734 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4734da1a-136a-4f71-98b5-51fdd1274734 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 03 20:59:06.675448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 03 20:59:06.679992 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:06.681962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4734da1a-136a-4f71-98b5-51fdd1274734 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:06.683380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4734da1a-136a-4f71-98b5-51fdd1274734 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.020184 Sep 03 20:59:06.684491 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1372/2683] 10.222.0.16 () {58 vars in 1182 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:06.695871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.707236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:06.708077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:06.714924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.716174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.716808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.717756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.718466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.719201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.831880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:59:06.902498 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6f6147da-610e-41d8-b97b-8c452a0944dc tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.212270 Sep 03 20:59:06.909092 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1373/2684] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers => generated 681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:06.918047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:06.919786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:06.927104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.927836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.928449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:06.929363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:06.929969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:06.930549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.172254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:07.190197 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c887e391-ead1-44ce-8247-2700e0f9c411 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.279465 Sep 03 20:59:07.192985 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1374/2685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:06 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:07.200395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:07.206393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:07.208072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.servers [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Removing options 'limit' from query {{(pid=140520) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 03 20:59:07.208997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:07.216319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.217222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.217865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.219275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.220055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.220537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.247972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:59:07.277444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3240c1c0-7874-43f6-a913-a2738e8cc5f8 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.080684 Sep 03 20:59:07.278345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1375/2686] 10.222.0.16 () {58 vars in 1144 bytes} [Sat Sep 3 20:59:07 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:07.290138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:07.290759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:07.297451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.298079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.298524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.299236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.299696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.300127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.543913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:07.553184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7c5453a-13b4-40fd-a596-a13af436d1ee tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1504 microversion: 2.1 time: 0.273557 Sep 03 20:59:07.565379 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1376/2687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:07 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:07.576118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:07.576826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:07.583307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.583918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.584620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.585187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.585722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.586222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.695975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=34 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:07.853700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:07.884259 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08308e5a-1ff0-41c3-8021-9f54aac79699 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1317 microversion: 2.1 time: 0.317577 Sep 03 20:59:07.888294 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1377/2688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:07 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:07.907527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc54d5fc-49e2-41d1-adfb-e03f10c27025 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc54d5fc-49e2-41d1-adfb-e03f10c27025 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '-1' Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 03 20:59:07.912828 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc54d5fc-49e2-41d1-adfb-e03f10c27025 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cc54d5fc-49e2-41d1-adfb-e03f10c27025 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025649 Sep 03 20:59:07.917554 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1378/2689] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Sep 3 20:59:07 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:07.923727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:07.924368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:07.935002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.935993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.936591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.938350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:07.939244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:07.939586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:07.976978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:08.052580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:08.151784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:08.164044 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4459eccb-68b7-452e-bb73-78ed447b9784 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.245151 Sep 03 20:59:08.182811 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1379/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:07 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:08.187954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:08.188980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:08.196615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.197466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.198109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:08.199016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.199507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.200469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:08.239526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:08.381066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a875d42a-e27f-4dbf-b925-f76e41110257 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 204 len: 0 microversion: 2.1 time: 0.195358 Sep 03 20:59:08.386387 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1380/2691] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:08 2022] DELETE /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:08.399860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8389fade-c9b5-42ba-b9fc-4b337f840154 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8389fade-c9b5-42ba-b9fc-4b337f840154 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: action_args: {} Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'testing' Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 03 20:59:08.407578 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 03 20:59:08.411711 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:08.416105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8389fade-c9b5-42ba-b9fc-4b337f840154 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:08.417650 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8389fade-c9b5-42ba-b9fc-4b337f840154 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027948 Sep 03 20:59:08.418424 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1381/2692] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 20:59:08 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:08.423297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:08.424228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:08.435047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.436404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.436969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:08.437744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.438221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.438676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:08.722413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:08.731549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5158079f-f712-4816-b514-995f30d4c2af tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.311856 Sep 03 20:59:08.732147 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1382/2693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:08 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:08.762080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:08.762617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:08.772822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.773366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.773818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:08.774548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:08.775011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:08.775455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.085923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.096782 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c94ff4ee-128c-4fbf-9b95-05a2bfabdaa1 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1510 microversion: 2.1 time: 0.338640 Sep 03 20:59:09.098563 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1383/2694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:08 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:09.104312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4a938f02-ffc9-45d0-843a-7baaac74e897 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.113563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4a938f02-ffc9-45d0-843a-7baaac74e897 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.115120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4a938f02-ffc9-45d0-843a-7baaac74e897 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:09.127958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.servers [None req-4a938f02-ffc9-45d0-843a-7baaac74e897 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Flavor 'non_existing_flavor' could not be found {{(pid=140520) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 03 20:59:09.129092 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4a938f02-ffc9-45d0-843a-7baaac74e897 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.028731 Sep 03 20:59:09.150019 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1384/2695] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:59:09.165981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.168012 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b242310c-046e-4464-ac6c-118e9ec276ba tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.555875 Sep 03 20:59:09.172888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:09.176246 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1312/2696] 10.222.0.16 () {60 vars in 1323 bytes} [Sat Sep 3 20:59:06 2022] POST /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1/os-volume_attachments => generated 194 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:09.191220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.198516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.209494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.210561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.211020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.211775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.212400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.212843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.221705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:09.231306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.232209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.233034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.234558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.235866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.236385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.248444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:09.423312 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d91ef5d-3546-4395-a602-77c11c3b9162 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.243822 Sep 03 20:59:09.426619 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1313/2697] 10.222.0.16 () {58 vars in 1174 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:59:09.436629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.438118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:09.462819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.463292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.464164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.464923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.465401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.465845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.625604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.636999 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3073d517-a36f-4a62-9d0f-cbbd8fd650ce tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1508 microversion: 2.1 time: 0.485197 Sep 03 20:59:09.639716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1385/2698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:09.664935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.671650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.672511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:09.680340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.681091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.681795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.682841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.683314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.684016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.721230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.735001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f270ade1-68d8-4c52-8a23-122a65275e3c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.305325 Sep 03 20:59:09.736363 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1314/2699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:09.741672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.742494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:09.754256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.755665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.756282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.757427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.758755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.759800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.819444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78327113-7519-4a75-829a-1b9d2f0f927a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.157936 Sep 03 20:59:09.820564 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1386/2700] 10.222.0.16 () {58 vars in 1184 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:59:09.826365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.827365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:09.834925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.836491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.837193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.838180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.838844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.839479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.939753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.952142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1787c52c-5a11-4c15-9f35-d98a414f67b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1508 microversion: 2.1 time: 0.214506 Sep 03 20:59:09.954068 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1315/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:09.958736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:09.963761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:09.964510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:09.970145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.971172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.971678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:09.972497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:09.973066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:09.973537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.006627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:59:10.112473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.127429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.127919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.128360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.136043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.147909 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39e58360-5fad-4270-b190-b9195dfedeee tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.325860 Sep 03 20:59:10.148695 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1387/2702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:10.160792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:10.164880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.174793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.175317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.175771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.176808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.177415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.177928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.276685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:10.277726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:10.278436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:10.278848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:10.279271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:10.349730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.356485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.357195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.357892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.358834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.359518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.360322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.396386 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e04686d-5f28-4fe5-bb7d-ff934933bcd9 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.441042 Sep 03 20:59:10.413508 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1316/2703] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 20:59:09 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:10.428385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510591bb-0231-4c0d-a54a-d403336b6cdb", "name": "network-vif-plugged", "status": "completed", "tag": "e4dfcddc-eed7-463b-b3bd-77a017e4614b"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:10.448096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.451765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.452362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.477295 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1a587940-43a0-44bb-95e1-793627b767a2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "POST /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a/action" status: 202 len: 1110 microversion: 2.1 time: 0.321049 Sep 03 20:59:10.478005 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1388/2704] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:59:10 2022] POST /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a/action => generated 1110 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 03 20:59:10.480709 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] Creating event network-vif-plugged:e4dfcddc-eed7-463b-b3bd-77a017e4614b for instance 510591bb-0231-4c0d-a54a-d403336b6cdb on nch2-master-1 Sep 03 20:59:10.489210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-63149deb-3aab-4ba6-9c00-37c09fb12a1f req-bdde9939-1c97-4f3e-8408-0c5843de64ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074567 Sep 03 20:59:10.490580 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1317/2705] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:10.502581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dddf65ec-581f-42d4-a947-b826fed2779a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.503613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.505332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.514364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dddf65ec-581f-42d4-a947-b826fed2779a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.515639 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dddf65ec-581f-42d4-a947-b826fed2779a tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.023741 Sep 03 20:59:10.516382 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1318/2706] 10.222.0.16 () {58 vars in 1178 bytes} [Sat Sep 3 20:59:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 20:59:10.518395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.519649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.526363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.530619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.531862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.532468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.535415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.537859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.553481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.554409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.557371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.558367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.559279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.560693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.846248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.854623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-96097a14-bc2d-4ddd-8a90-49dfe659e0cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.328544 Sep 03 20:59:10.856233 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1319/2707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:10 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:10.859988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.864868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.866039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Searching by: {'deleted': False, 'project_id': '7262d6f38eee4c1184a6b471cf69b008'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:10.872753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.873636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.874150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.875378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.875862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.876411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.900137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:10.904056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:59:10.908428 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5beb1286-5526-4e80-a0f0-68472db8ec68 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1510 microversion: 2.1 time: 0.429426 Sep 03 20:59:10.927463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1389/2708] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:10 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:10.932530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.933421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-43da3a2b-06c6-459a-907b-aba1173cad2b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.076987 Sep 03 20:59:10.935382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.941981 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1320/2709] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 20:59:10 2022] GET /compute/v2.1/servers => generated 681 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:10.947337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.947916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.948456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.949189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:10.949326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.949743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.950173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.950341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:10.959325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.961432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.963192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.964033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:10.965496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:10.966069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:10.998716 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] HTTP exception thrown: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 HTTP/1.1 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '66982bab-3959-42f5-8f17-3af0d4445435'} Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:11.001160 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.005514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 404 to user: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:11.007630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b90c1b6-ba9e-44dd-9e7f-1b5f1548bf66 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 404 len: 111 microversion: 2.1 time: 0.063769 Sep 03 20:59:11.008082 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1321/2710] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:10 2022] DELETE /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:11.017436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.018048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.028688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.029367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.029927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.031095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.031688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.032351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.089106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:11.217664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:11.233089 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95384532-3a12-44b3-b2b8-fc06733a6b2b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.304197 Sep 03 20:59:11.238847 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1390/2711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:10 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:11.243798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9322b2-56c1-474b-8557-753d8c727874", "name": "network-vif-deleted", "tag": "05422449-ac98-44f2-bb4f-e3ddc53b0866"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:11.249988 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da7b7b31-00da-4ae7-b9ff-6ea46e420c94 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "DELETE /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 204 len: 0 microversion: 2.1 time: 0.235847 Sep 03 20:59:11.251199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1322/2712] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:11 2022] DELETE /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:11.261079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.264258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.274877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.275740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.276486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.277442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.278770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.279436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.292096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.292580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.293039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.337759 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] Creating event network-vif-deleted:05422449-ac98-44f2-bb4f-e3ddc53b0866 for instance cf9322b2-56c1-474b-8557-753d8c727874 on nch2-master-1 Sep 03 20:59:11.346816 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b304c335-8b15-42b9-b306-b97469ab820c req-065aae43-9517-4a82-827b-d0ee0108150e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106251 Sep 03 20:59:11.347739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1391/2713] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:11.356801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.357424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.374901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.375296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.375742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.380699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.381317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.381761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.440454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:11.577083 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06049a22-bffd-4c9d-9d64-ddb58bfa1ec2 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 204 len: 0 microversion: 2.1 time: 0.227548 Sep 03 20:59:11.581275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:11.581805 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1392/2714] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:11 2022] DELETE /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:11.587567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.588502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 66982bab-3959-42f5-8f17-3af0d4445435] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.590127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c97e5e38-ec8a-4ca0-aa37-92bef52d15a4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.337508 Sep 03 20:59:11.593096 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1323/2715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:11 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:11.611013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.611571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.612018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.612766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.613255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.613732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.631894 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] HTTP exception thrown: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 HTTP/1.1 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '66982bab-3959-42f5-8f17-3af0d4445435'} Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.633520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 404 to user: Instance 66982bab-3959-42f5-8f17-3af0d4445435 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:11.638481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd342e2f-434c-4590-905c-20600643932b tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435" status: 404 len: 111 microversion: 2.1 time: 0.051840 Sep 03 20:59:11.647229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.648042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.651250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1393/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:11 2022] GET /compute/v2.1/servers/66982bab-3959-42f5-8f17-3af0d4445435 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:11.654791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.655349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.656371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.657118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.657635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.658204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.888166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:11.892051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:11.903672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.904638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.905271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:11.906277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:11.906895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:11.907673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.089817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:12.101038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b9649ce-aeb5-40f0-9e53-92f9cbd746f6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.221252 Sep 03 20:59:12.102317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1394/2717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:11 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:12.107378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:12.108279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:12.115358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.116133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.122463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.125286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.126005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.126638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.171274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.172087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.172783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.173464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lazy-loading 'fault' on Instance uuid cf9322b2-56c1-474b-8557-753d8c727874 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:12.222142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:12.231371 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf404737-8145-4264-bd7c-9c3a31f603f0 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1306 microversion: 2.1 time: 0.127784 Sep 03 20:59:12.232736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1395/2718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:12 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1306 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:12.265642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:12.266511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:12.273177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.273899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.274606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.276035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.276653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.277257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.410335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:12.418413 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c35c217-de72-4687-9d2a-62fe94070709 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1522 microversion: 2.1 time: 0.777135 Sep 03 20:59:12.435181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:12.435392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1324/2719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:11 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:12.445925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ae92c3c-c131-4675-8a4a-1f0a87c63c0e tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.184578 Sep 03 20:59:12.446754 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1396/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:12 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:12.620954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:12.622276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:12.634560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.635712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.637231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.639681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:12.641569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:12.642682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:12.686154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:12.913007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:12.935110 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-148677e6-8bec-4e74-a354-0974188481d0 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.320608 Sep 03 20:59:12.945639 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1325/2721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:12 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:13.135560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:13.136183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:13.155046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.159842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.160308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.161092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.161554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.161985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.260111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:13.261895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:13.282877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.283383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.283824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.284704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.285197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.285645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.357586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:13.370313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.371049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.371661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.372317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lazy-loading 'fault' on Instance uuid cf9322b2-56c1-474b-8557-753d8c727874 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:13.476531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fba464c031484398bf568f091e5018a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6047f3a5056d43549f602b273ad8eab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:13.500383 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc4f70c6-290a-45ed-8671-3a6d37928125 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 200 len: 1306 microversion: 2.1 time: 0.235858 Sep 03 20:59:13.500383 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1326/2722] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:13 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:13.505848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:13.506542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:13.533228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.533976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.534918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:13.535883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:13.536351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:13.536935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.010477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:14.019301 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-091b8bf8-a670-49db-9165-34eabe90a61a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.894809 Sep 03 20:59:14.028267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1397/2723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:13 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:14.036731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:14.045843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:14.070640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.071345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.075014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.077479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.080129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.086870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.097864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:14.114424 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66381566-0ef1-47e8-97e9-bc410e55b71d tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1522 microversion: 2.1 time: 0.620651 Sep 03 20:59:14.120101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1327/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:13 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:14.135599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:14.136555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:14.150131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.150640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.151090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.151814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.152283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.152719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.585763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:14.600191 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cc4eb0f5-fbcc-4168-8a9d-ecb751b66744 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.570548 Sep 03 20:59:14.604086 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1398/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:14 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:14.613131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:14.617350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:14.621514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:14.628915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.632253 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5adcc5c1-e772-4468-a986-bfb7f5ea40c1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.508454 Sep 03 20:59:14.636304 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1328/2726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:14 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:14.649081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.649081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.649081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.649081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.649081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.695199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 HTTP/1.1 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'cf9322b2-56c1-474b-8557-753d8c727874'} Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.710624 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.714436 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.723980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:14.730378 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2b87e15-c721-42bd-a1b9-071b09c5f7ef tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 404 len: 111 microversion: 2.1 time: 0.124048 Sep 03 20:59:14.763788 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1399/2727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:14 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:14.782897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-14235704", "metadata": {"image_type": "test"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:14.787943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:14.795775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.797213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.798041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.799027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.799778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.800448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:14.837725 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874/action HTTP/1.1 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 110 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-14235704", "metadata": {"image_type": "test"}}} Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'cf9322b2-56c1-474b-8557-753d8c727874', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-14235704', 'metadata': {'image_type': 'test'}}}} Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 20:59:14.840556 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:14.845086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.849907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:14.851407 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e129e6f-4c07-4147-aa37-2e6c55fe868e tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "POST /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874/action" status: 404 len: 111 microversion: 2.1 time: 0.082472 Sep 03 20:59:14.852595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1400/2728] 10.222.0.16 () {60 vars in 1279 bytes} [Sat Sep 3 20:59:14 2022] POST /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:14.873330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1449214507", "metadata": {"image_type": "test"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:14.879530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Failed to fetch instance by id tempest-invalid-1045581882 {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 20:59:14.880078 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance tempest-invalid-1045581882 could not be found. Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/tempest-invalid-1045581882/action HTTP/1.1 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 112 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1449214507", "metadata": {"image_type": "test"}}} Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance tempest-invalid-1045581882 could not be found. Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'tempest-invalid-1045581882', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1449214507', 'metadata': {'image_type': 'test'}}}} Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1045581882 could not be found. Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:14.886932 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1045581882 could not be found. Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1045581882 could not be found. Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance tempest-invalid-1045581882 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:14.891364 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e3cf47cf-cc05-46e6-87b5-2f561c77d35f tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-1045581882/action" status: 404 len: 101 microversion: 2.1 time: 0.029395 Sep 03 20:59:14.896038 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1401/2729] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Sep 3 20:59:14 2022] POST /compute/v2.1/servers/tempest-invalid-1045581882/action => generated 101 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:14.905322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-523896421"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:14.916810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 20:59:14.917616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 56 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-test-snap-523896421"}} Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-523896421'}}} Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.925632 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.930119 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.932316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:14.933884 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d529fc02-55f1-437f-83fc-ccd8b835eb80 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.034916 Sep 03 20:59:14.934616 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1402/2730] 10.222.0.16 () {60 vars in 1275 bytes} [Sat Sep 3 20:59:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:14.949625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-548757148"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:14.951938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 20:59:14.952510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 56 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: {"createImage": {"name": "tempest-test-snap-548757148"}} Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-548757148'}}} Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.954142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:14.959659 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55392b7a-7f23-4474-996f-9a175159d546 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011147 Sep 03 20:59:14.961193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1403/2731] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Sep 3 20:59:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:14.969990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:14.969990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:14.983013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:14.993631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:14.994102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.004407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.005066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.005610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.028312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:15.063493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 HTTP/1.1 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'cf9322b2-56c1-474b-8557-753d8c727874'} Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:15.069643 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.073704 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.075817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:15.076841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d0a4a65-f7f7-4961-b83e-618164881636 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 404 len: 111 microversion: 2.1 time: 0.114578 Sep 03 20:59:15.079392 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1404/2732] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:14 2022] DELETE /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:15.089145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:15.090180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:15.101327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.102083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.102693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.104323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.115493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.116299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.419416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634febfe-8c24-4b5b-b3a4-69d50188e6a5", "name": "network-vif-deleted", "tag": "ad4cbf56-ad6b-49a2-a335-192805e77853"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:15.434919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.435695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.437702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.458396 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] Creating event network-vif-deleted:ad4cbf56-ad6b-49a2-a335-192805e77853 for instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 on nch1-master-1 Sep 03 20:59:15.467996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b29010f3-d8f4-4957-a685-4061528e8f22 req-54b7e50c-3966-40b5-b7bc-211f24f14998 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.716978 Sep 03 20:59:15.472508 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1329/2733] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:15.477395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:15.482048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:15.483104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] [instance: cf9322b2-56c1-474b-8557-753d8c727874] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:15.491709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0b8131e-b2ff-4233-b211-e14e6d7333e2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.411085 Sep 03 20:59:15.493308 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1405/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:15 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:15.500322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6", "name": "network-vif-deleted", "tag": "b4646074-79e7-4798-a6ce-8236bb0a0182"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:15.506654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.507027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.507561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.512052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.512674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.512921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.513547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.513732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.514498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.529950 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] HTTP exception thrown: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Request method failure captured: Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 HTTP/1.1 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8AGIPx8svn5-Rjdbyyg5AMwLJOksV6MWo4hRBQZby5ufcdOlf39ftjdrvuEZQ-SfUPfKmDcqllMiZ3NO2rzeYqVgBwTksntlLggCGKZGDcjMkI_aSaIMfcgVS1Hn5k4ga6ggacyskgfWCGTwW9YsRuqHocroPT-bA6pGWrv8X4bYkg Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6047f3a5056d43549f602b273ad8eab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 6047f3a5056d43549f602b273ad8eab3 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1632627187 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: fba464c031484398bf568f091e5018a4 Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesNegativeTestJSON-1632627187-project Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'cf9322b2-56c1-474b-8557-753d8c727874'} Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:15.533370 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. Sep 03 20:59:15.538137 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:15.539782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] Returning 404 to user: Instance cf9322b2-56c1-474b-8557-753d8c727874 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:15.541033 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0a4fecb-2605-4df3-b0ce-0368c417ef93 tempest-ImagesNegativeTestJSON-1632627187 tempest-ImagesNegativeTestJSON-1632627187-project] 10.222.0.16 "GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874" status: 404 len: 111 microversion: 2.1 time: 0.065802 Sep 03 20:59:15.543715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] Creating event network-vif-deleted:b4646074-79e7-4798-a6ce-8236bb0a0182 for instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 on nch2-master-1 Sep 03 20:59:15.546079 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1330/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:15 2022] GET /compute/v2.1/servers/cf9322b2-56c1-474b-8557-753d8c727874 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:15.554347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:15.555116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:15.563268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.563811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.564272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.565043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.566225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.566836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.571042 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8e3b0ac1-0e9f-41bd-acb7-5b2f6f1e878f req-03e78318-19f5-4ba6-9d30-f6f858966d4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074907 Sep 03 20:59:15.582342 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1406/2736] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:15.611138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.611638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.612266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.612914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lazy-loading 'fault' on Instance uuid 634febfe-8c24-4b5b-b3a4-69d50188e6a5 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:15.624506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:15.625247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:15.628441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:15.648396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.654592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.655372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.656917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.657543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.658243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.725016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336a280254b44d5e9c99abbce6fb88d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7262d6f38eee4c1184a6b471cf69b008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:15.737094 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25d1e78e-bc73-4ad4-8834-f7ae1bdc6940 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 200 len: 1312 microversion: 2.1 time: 0.189240 Sep 03 20:59:15.755043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1331/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:15 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:15.766048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:15.766771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:15.781627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.782133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.786948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:15.787812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:15.789371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:15.789838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.042746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:16.054237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-641e05e1-4b1a-4bf2-8b58-faef7a71844d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.434448 Sep 03 20:59:16.054830 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1407/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:15 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:16.060312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d09915-197d-436d-9e4e-1d16d7efbc4c", "name": "network-vif-plugged", "status": "completed", "tag": "4d6cb81a-21f6-4aa5-8457-63545b5d7cd9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:16.097030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.097524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.097969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.116826 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] Creating event network-vif-plugged:4d6cb81a-21f6-4aa5-8457-63545b5d7cd9 for instance e6d09915-197d-436d-9e4e-1d16d7efbc4c on nch1-master-1 Sep 03 20:59:16.138587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0e340fd9-337d-4aec-9ade-71aa801040de req-7996ebaa-6a6a-4722-9447-8cfbc7a5cfed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076171 Sep 03 20:59:16.139764 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1408/2739] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:16.209640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:16.217494 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9b6c06d0-7f14-4f29-a2de-f0efc119729a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.462427 Sep 03 20:59:16.233863 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1332/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:15 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:16.519881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:16.520841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:16.529857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.531110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.531713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.532612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.533272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.533856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.759702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:16.761072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: 634febfe-8c24-4b5b-b3a4-69d50188e6a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:16.769283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.769977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.770588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.771480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.772112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.773283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.798860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:16.814139 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce9ba641-e68c-4561-bc22-d2464cfaaf7b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.298659 Sep 03 20:59:16.815289 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1409/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:16 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:16.830806 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] HTTP exception thrown: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 HTTP/1.1 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '634febfe-8c24-4b5b-b3a4-69d50188e6a5'} Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.834042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. Sep 03 20:59:16.838443 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.840410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 404 to user: Instance 634febfe-8c24-4b5b-b3a4-69d50188e6a5 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:16.841491 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3476419e-9e72-4954-b189-f2c2e782b7c4 tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5" status: 404 len: 111 microversion: 2.1 time: 0.085688 Sep 03 20:59:16.846171 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1333/2742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:16 2022] GET /compute/v2.1/servers/634febfe-8c24-4b5b-b3a4-69d50188e6a5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:16.851557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:16.852320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] [instance: fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:16.862152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.863150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.864041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.865072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:16.865478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:16.865899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:16.917788 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] HTTP exception thrown: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Request method failure captured: Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 HTTP/1.1 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_2NH_HtOQKwDtjXgwRg8rGpUuU2FpmIErGNIHKIRapZgtcZSU6GgCFc5ERc_30XRD7ZpPkAFa0pTf2PLMtMtD6jyxH3wj_BTbU__prqHiiw4zjqTOUiVjngsyO-QE6_AV-pY7omS1f6aE2F35HjRqDgE7BxKQERDfJMxqMDJ_rRPg Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7262d6f38eee4c1184a6b471cf69b008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7262d6f38eee4c1184a6b471cf69b008 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2089274871 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 336a280254b44d5e9c99abbce6fb88d5 Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServersNegativeTestJSON-2089274871-project Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6'} Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.919487 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:16.923979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] Returning 404 to user: Instance fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:16.924559 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6579c4cc-c183-4de5-a740-6ba0c4cc40cd tempest-ListServersNegativeTestJSON-2089274871 tempest-ListServersNegativeTestJSON-2089274871-project] 10.222.0.16 "GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6" status: 404 len: 111 microversion: 2.1 time: 0.074702 Sep 03 20:59:16.930529 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1410/2743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:16 2022] GET /compute/v2.1/servers/fa0da2c1-3c0b-4190-b37e-d1b206ee5dc6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:17.086198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:17.087387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:17.098545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.099315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.101286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:17.104715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.105455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.106084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:17.243577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:17.244855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:17.252559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.253439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.254062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:17.256485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.257357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.257992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:17.465815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:17.476551 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dcfe5a12-4b54-475c-96c9-151efc48bc64 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.402967 Sep 03 20:59:17.482649 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1334/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:17 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:17.753884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:17.767381 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9b8d020-799b-43a9-b794-f1775a77db40 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1319 microversion: 2.1 time: 0.527552 Sep 03 20:59:17.771109 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1411/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:17 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:17.840114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:17.841341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:17.854778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.865843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.866313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:17.867067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:17.867697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:17.868310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:18.076873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:18.103577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4ea8c2c1-b4db-4dbb-af4f-d8314e6c1a80 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.258852 Sep 03 20:59:18.115357 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1335/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:17 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:18.274200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d903c896-c782-4240-9f1a-2a9702056a68 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Action: 'create', calling method: .version_select at 0x7fae670ea8b0>, body: {"keypair": {"name": "tempest-keypair-1915557563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1Vs5GY2oaAlaGF//qYFAA6AQ0Z441XWO6sEimId8siNNTFzy3Tqr7S4pRoJbxoV3PunLUZHfv8s8LFJoxqCUsoHNR+OGUB2voPNP/2NDGVka1edwkdepcRZ9iBpb04gQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:18.302130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d903c896-c782-4240-9f1a-2a9702056a68 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for project b0fbc0c573fc45b58137b43959b57034. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:18.308287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d903c896-c782-4240-9f1a-2a9702056a68 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for user 50bba3c790c44425a9786b8d1404df28 and project b0fbc0c573fc45b58137b43959b57034. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:18.335510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d903c896-c782-4240-9f1a-2a9702056a68 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.223981 Sep 03 20:59:18.336743 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1412/2747] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 20:59:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:18.514014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:18.518050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:18.538509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:18.539098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:18.540114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:18.540921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:18.541421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:18.541863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:18.690796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:18.700486 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ed441d0-4506-4aa4-b8aa-64bcab093fb4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.193089 Sep 03 20:59:18.701213 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1336/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:18 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:18.793675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:18.794442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:18.802884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:18.803528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:18.804162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:18.804889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:18.805442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:18.805883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.104102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:19.128328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:19.128979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:19.139773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.150858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.151331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.152097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.152567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.153033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.192591 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67be873d-f971-4abf-838b-1a3e1254684b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1468 microversion: 2.1 time: 0.398926 Sep 03 20:59:19.195576 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1413/2749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:18 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:19.259243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:19.259895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:19.280390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.284322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.284799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.286979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.287819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.288448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.580554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:19.590859 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38f87c3a-5c62-485a-8bb1-b7e1f268a503 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1469 microversion: 2.1 time: 0.372670 Sep 03 20:59:19.592248 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1414/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:19 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:19.615301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:19.620798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:19.621970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Searching by: {'reservation_id': 'r-45sx1urd', 'deleted': False, 'project_id': '5a2f3c186f88497181cf6a1d806631b1'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 20:59:19.637116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.638052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.638697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.639637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.641197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.641810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:19.647192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=21 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:19.766544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 20:59:19.853615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:19.863275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:19.864097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:19.864948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.026045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:20.050163 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-172003b5-d74d-49fa-8acc-c34277924278 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.926912 Sep 03 20:59:20.051329 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1337/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:19 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:20.056234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:20.057344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:20.066334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.067075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.067681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.069509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.070131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.070710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.104545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:20.144233 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00ada626-e140-4235-822d-f4a1a443faec tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-45sx1urd" status: 200 len: 2930 microversion: 2.1 time: 0.532565 Sep 03 20:59:20.145230 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1415/2752] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Sep 3 20:59:19 2022] GET /compute/v2.1/servers/detail?reservation_id=r-45sx1urd => generated 2930 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:20.170961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:20.201606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.server_groups [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Querying cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) for 2 instances {{(pid=140520) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 03 20:59:20.202846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.204652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.205544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.247443 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23dfbc35-34c1-42f8-bf78-ca5197f4fb6a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/3a315ac1-45b1-4cba-943a-ad1ad1273ce6" status: 200 len: 271 microversion: 2.1 time: 0.080311 Sep 03 20:59:20.253927 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1416/2753] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:59:20 2022] GET /compute/v2.1/os-server-groups/3a315ac1-45b1-4cba-943a-ad1ad1273ce6 => generated 271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:20.259801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:20.260556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:20.270806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.271681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.272338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.273412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.274091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.274794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.436263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:20.458839 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9484d793-e90f-42c0-9d60-b0874faf5b62 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.406143 Sep 03 20:59:20.459462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1338/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:20 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:20.696126 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6304d62-6bcb-46af-9663-4a623a9ec5f1 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1620 microversion: 2.1 time: 0.440610 Sep 03 20:59:20.699241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1417/2755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:20 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1620 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:20.723900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:20.724866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:20.737944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.738456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.738903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.739628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:20.742738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:20.743506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:20.883885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:21.075062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:21.076804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:21.096286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:21.097102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:21.097703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:21.098609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:21.099224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:21.099843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:21.278362 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3efc3e7f-871d-46de-befa-17cf57764072 tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1619 microversion: 2.1 time: 0.561686 Sep 03 20:59:21.279034 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1339/2756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:20 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1619 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:21.364448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:21.377730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0922215-500e-40de-a2ab-2c02cb3a2bcf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.307486 Sep 03 20:59:21.380121 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1418/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:21 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:21.461588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-401164735", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b4d9ba95-551c-4316-94bb-bb83ba4bd615"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:21.489512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:21.490480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:21.506681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:21.507254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:21.509324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:21.511155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:21.513539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:21.517217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:21.597694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:22.114572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:22.133264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ba6c797-330a-46c6-b92d-15bc8b64d86b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.649385 Sep 03 20:59:22.134051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1419/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:21 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:22.172880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-281368804", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "3a319c91-17bf-4587-bd66-d3e41c369cd6"}], "security_groups": [{"name": "tempest-securitygroup--1438038322"}], "key_name": "tempest-keypair-1915557563", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:22.179943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:22.180370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:22.181154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:22.181820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:22.182240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:22.227742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:22.228231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:22.250703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:22.251541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:22.252019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:22.263937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:22.316546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:22.333058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:22.369719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:22.374792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] validate_networks() for [('3a319c91-17bf-4587-bd66-d3e41c369cd6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:22.388293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:22.545154 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7463be47-1bfb-4676-a18a-184bc55737aa tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088066 Sep 03 20:59:22.546945 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1340/2759] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:59:22.556670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:22.558211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:22.578429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:22.590157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:22.595499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:22.596280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:22.596784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:22.597258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:23.013001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:23.031898 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee60505b-9478-4296-baa8-bd1604256789 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.481840 Sep 03 20:59:23.033924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1341/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:22 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:23.051266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff026962-95e7-484b-87af-baf2a6644f66 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:23.053959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff026962-95e7-484b-87af-baf2a6644f66 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:23.300153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff026962-95e7-484b-87af-baf2a6644f66 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:23.316879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff026962-95e7-484b-87af-baf2a6644f66 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1216 microversion: 2.1 time: 0.277723 Sep 03 20:59:23.328928 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1342/2761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:23 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:23.343554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:23.344199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:23.364717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:23.365257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:23.370405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:23.371181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:23.372374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:23.373537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:23.461798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:23.462325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:23.462718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:23.463720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:23.464316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:23.481690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:23.482415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:23.487119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:23.488145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:23.488810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:23.490593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:23.539352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for project b0fbc0c573fc45b58137b43959b57034. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:23.556786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for user 50bba3c790c44425a9786b8d1404df28 and project b0fbc0c573fc45b58137b43959b57034. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:23.595976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:23.602359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:23.720087 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0aba07e1-48b7-4476-a428-ade53302f6b3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.552182 Sep 03 20:59:23.731555 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1420/2762] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:59:23.740454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c1058e3-a368-4667-8227-bdf4c6bd7dbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:23.741164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c1058e3-a368-4667-8227-bdf4c6bd7dbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:23.760233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:23.774684 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-514b9e69-2885-4a73-b4a1-e66794dc624b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.447689 Sep 03 20:59:23.775278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1343/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:23 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:23.870826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c1058e3-a368-4667-8227-bdf4c6bd7dbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:23.881726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c1058e3-a368-4667-8227-bdf4c6bd7dbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1241 microversion: 2.1 time: 0.148730 Sep 03 20:59:23.895245 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1421/2764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:23 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:24.059915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:24.061049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:24.082419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.086096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.089943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.093950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.095736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.096731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.342262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:24.342996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:24.373563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.375045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.375497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.380761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.383682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.385312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.433886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:24.443978 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8692259-028e-420a-9e16-8ec2c9359d42 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.392188 Sep 03 20:59:24.453411 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1344/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:24 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:24.547707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:24.558051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23c5733b-556f-43c5-8d1f-bf2e853143b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1220 microversion: 2.1 time: 0.219833 Sep 03 20:59:24.559160 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1422/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:24 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1220 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:24.803227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:24.806785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:24.821523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.823423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.824528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.826339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.829101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.831030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.857610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:24.909532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:24.910322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:24.921933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.922447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.923132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:24.923767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:24.924236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:24.924672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:25.015671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:25.030792 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-acba190a-b6c5-494c-bf01-5437ef5ddf21 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1237 microversion: 2.1 time: 0.126295 Sep 03 20:59:25.047117 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1423/2767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:24 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1237 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:25.063856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:25.073179 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21960cf8-ebb3-4edc-8b77-e7860acc3bc7 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1473 microversion: 2.1 time: 0.278185 Sep 03 20:59:25.073850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1345/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:24 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:25.477611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:25.478874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:25.494830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:25.495700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:25.497470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:25.503015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:25.505607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:25.506169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:25.586125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:25.587407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:25.601929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:25.602432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:25.606825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:25.612856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:25.613682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:25.614506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:25.721815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:25.741669 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12712c80-913d-40c9-a43f-c492de223048 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.276892 Sep 03 20:59:25.742256 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1424/2769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:25 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:25.758134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:25.768563 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ccdb441-ef18-4379-a32b-e7f54e7e3cb8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1268 microversion: 2.1 time: 0.189523 Sep 03 20:59:25.769356 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1346/2770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:25 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:26.058494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:26.059805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:26.085260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.085862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.086322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.087072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.087900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.091481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.097553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:26.098402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:26.111180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.111956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.112551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.113502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.114138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.114719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.229268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:26.232964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:26.243167 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75b6b123-b7fe-4e21-aae2-aa5c9e8c3a93 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1311 microversion: 2.1 time: 0.190025 Sep 03 20:59:26.244391 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1425/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:26 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:26.339176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:26.349595 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c94d5680-ec7d-45d0-8d1f-103c40ef657f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.256960 Sep 03 20:59:26.350185 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1347/2772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:26 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:26.771412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:26.772766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:26.782550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.783452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.784255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.785213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.785826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.786409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.793986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:26.794681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:26.808377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.810405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.811000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.813487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:26.814195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:26.816096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:26.893805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:26.901643 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06390b24-c155-4686-901d-4ddaa53f1959 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1268 microversion: 2.1 time: 0.112025 Sep 03 20:59:26.902206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1348/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:26 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1268 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:27.203526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:27.234925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b6fc9f5-78c2-434a-b536-8708f0c0c5bd tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.471921 Sep 03 20:59:27.237318 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1426/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:26 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:27.269058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:27.269676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:27.279687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.280186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.281218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:27.282317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.282938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.283520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:27.374405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:27.375272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:27.384186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.385012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.385615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:27.386491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.388136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.388741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:27.721904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:27.731281 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fde3b9dc-a12c-40bf-8329-2e5c476b1c9f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.467349 Sep 03 20:59:27.736055 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1349/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:27 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:27.756021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:27.767096 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-230f40ff-e353-4f6a-a6a7-1fe4657a3212 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.396757 Sep 03 20:59:27.782322 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1427/2776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:27 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:27.929337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:27.931125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:27.946635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.947559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.948753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:27.952546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:27.955074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:27.956020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.116173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:28.134582 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7bf4f3c5-b566-4fcd-a984-c4c6b41e8ee8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1274 microversion: 2.1 time: 0.213967 Sep 03 20:59:28.156300 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1350/2777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:27 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:28.259733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:28.260363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:28.272250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.273335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.273971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.274864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.275518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.276452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.721456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:28.735366 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67c5d86c-e644-40b9-9380-2231cb788621 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.479499 Sep 03 20:59:28.750719 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1428/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:28 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:28.764687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:28.766048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:28.774530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.775373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.776139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.777344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.778099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.779206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.795328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:28.797930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:28.810710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.814535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.815391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:28.816430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:28.818238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:28.818911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:29.227935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:29.243375 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9abdbf07-d4b8-4885-bd75-2faca8e08cbe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.484815 Sep 03 20:59:29.261349 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1351/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:28 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:29.261349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:29.261349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:29.275961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:29.276587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:29.277168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:29.278283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:29.279195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:29.280008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:29.337434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:29.348263 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b195338a-61bd-4481-986f-39508f0cf382 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.559018 Sep 03 20:59:29.362427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1429/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:28 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:29.486326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a2ace1-f683-4a53-898d-90132c063bf7", "tag": "29a7f5f4-3ef0-4798-912d-b2972c9d925a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:29.504508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:29.509595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:29.510325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:29.538357 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] Creating event network-changed:29a7f5f4-3ef0-4798-912d-b2972c9d925a for instance 33a2ace1-f683-4a53-898d-90132c063bf7 on nch1-master-1 Sep 03 20:59:29.550694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-632d6318-d13d-4cca-8655-485e95dce2f3 req-00042ba3-6ce5-4e53-8934-f0e657fd606e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069343 Sep 03 20:59:29.554524 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1430/2781] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:29.581559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:29.592522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e1a5eb3-1e34-474c-86a4-befc40adcffc tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.340406 Sep 03 20:59:29.593247 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1352/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:29 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:29.762881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:29.763608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:29.776434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:29.776980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:29.777433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:29.778480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:29.779154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:29.779534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.209095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:30.238909 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ead68bd8-e04a-4ed9-b409-86b8a0d31be6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.481578 Sep 03 20:59:30.241744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1431/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:29 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:30.273689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:30.274986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:30.287325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.287611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.288056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.288786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.290371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.290371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.375422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:30.376260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:30.420155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.423854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.424335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.425146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.427053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.427665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.719562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:30.732424 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8be91b7-e87e-4f68-96d6-402b08a46323 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.361604 Sep 03 20:59:30.746456 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1432/2784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:30 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:30.757860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:30.759268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:30.767747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.768506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.769345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.770267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:30.771034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:30.771708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:30.966602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:30.980020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a2be851-b3a1-4c32-8dd6-79e8b952b4db tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.711855 Sep 03 20:59:30.980648 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1353/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:30 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:31.092305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:31.111241 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e083d62-7300-4f17-bc4a-43a217ada6b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.363342 Sep 03 20:59:31.112174 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1433/2786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:30 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:31.263632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:31.264248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:31.270952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:31.271483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:31.271946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:31.272848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:31.273485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:31.274095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:31.334033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123bb02c-0a54-4b48-b0a6-1fc382d7caa7", "tag": "7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:31.355841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:31.356581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:31.357625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:31.375371 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] Creating event network-changed:7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c for instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 on nch2-master-1 Sep 03 20:59:31.383656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fee10391-c997-4fb8-bbe4-245cb494abe2 req-8ffbc193-17b4-4c41-a608-d0f255a8ba46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054239 Sep 03 20:59:31.385494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1434/2787] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:31.764212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:31.766113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:31.785171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:31.792964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:31.793864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:31.794940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:31.795536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:31.796145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:31.840028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:31.851344 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ff09207-c9a2-42ee-9816-c23abb6de66d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.591545 Sep 03 20:59:31.852681 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1354/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:31 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:32.007924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:32.008825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:32.026902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.027667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.028276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:32.029274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.029895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.030586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:32.100547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:32.109583 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5cee44d-2a9b-4179-8f21-cdaafe3998b1 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.350778 Sep 03 20:59:32.125223 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1435/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:31 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:32.138317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:32.143243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:32.160368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.161090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.161800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:32.162771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.163709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.164492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:32.289343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:32.352300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:32.397607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d77c3c5e-4eba-434b-9ef0-9c3a3d29054f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.394519 Sep 03 20:59:32.398870 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1355/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:31 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:32.589845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:32.602176 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af20956c-8fcf-42e9-b24d-39fb1db2b032 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.467431 Sep 03 20:59:32.607264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1436/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:32 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:32.889029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:32.889898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:32.902270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.906317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.907365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:32.909726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:32.910642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:32.912705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.290468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f418a14-c2a7-4495-85ca-22f600a66d65", "name": "network-vif-plugged", "status": "completed", "tag": "434c214a-3a8a-4c83-ae50-679a35739a55"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:33.305800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:33.306394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.306745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.311748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.341102 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] Creating event network-vif-plugged:434c214a-3a8a-4c83-ae50-679a35739a55 for instance 9f418a14-c2a7-4495-85ca-22f600a66d65 on nch2-master-1 Sep 03 20:59:33.357419 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-afedb012-a633-4578-bde4-41523857b767 req-a591a292-cf3f-4c93-9c32-08c20f6f781c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384889 Sep 03 20:59:33.358619 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1437/2792] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:33.375647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:33.376542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:33.393302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.393717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.394166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.399551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.403029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.403489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.513606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:33.705318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:33.708090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:33.724215 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f8719ed-9c91-431e-9dba-87aa68f894b3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.851969 Sep 03 20:59:33.724930 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1356/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:32 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:33.727738 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5ef176eb-a089-476e-b77f-8af789d4593b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.367265 Sep 03 20:59:33.743712 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1438/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:33 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:33.745419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:33.751879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:33.753901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:33.755315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:33.761245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.762029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.764326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.765326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.766050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.768034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.775935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.777042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.784847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.785706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:33.786190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:33.786626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:33.879062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=14 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:34.151436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:34.165024 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85270f23-57f8-441b-924c-7044bbbb953a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.417991 Sep 03 20:59:34.165653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1439/2795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:33 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:34.216559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:34.228796 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13b8ff3b-4fcd-4d23-820a-2b51abe7f8fe tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.494149 Sep 03 20:59:34.229741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1357/2796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:33 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:34.755859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:34.756477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:34.759979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:34.760720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:34.769381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:34.770071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:34.773587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:34.774574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:34.775226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:34.776276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:34.777707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:34.784385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:34.785502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:34.787338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:34.788075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:34.788613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:35.361609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:35.373272 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ebcbfc3-85f7-45f2-a4d2-13770e123ade tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.625207 Sep 03 20:59:35.379190 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1440/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:34 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:35.384777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:35.386182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:35.405846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:35.415177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:35.415733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:35.419578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:35.427872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:35.429487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:35.432242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:35.440727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:35.449542 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bf22c76f-3482-4143-946f-3feacb699086 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1479 microversion: 2.1 time: 0.697464 Sep 03 20:59:35.468153 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1358/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:34 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1479 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:35.481793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:35.484947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:35.497905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:35.500336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:35.502497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:35.504055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:35.507373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:35.510836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:35.817396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:35.832417 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81b2e192-f0ca-4dd8-bd4a-fa1996272983 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.451512 Sep 03 20:59:35.832736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1441/2799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:35 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:36.015483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:36.041836 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c41ddc5a-8d6e-48c7-8f77-2e85ad6edd57 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.572107 Sep 03 20:59:36.042803 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1359/2800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:35 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:36.137201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-13770136", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:36.221384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] validate_networks() for [('6558e500-88ff-4453-8fc4-ebe415b62d51', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:36.407558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:36.408178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:36.420475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:36.422733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:36.426599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:36.428595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:36.432319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:36.433053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:36.947238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:36.947711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:36.948155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:36.953418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:36.954298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:36.975622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:36.976359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:36.977644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:36.978824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:36.979448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:36.980089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:36.996857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:37.012646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bbe4a1c2-6ba3-4bd0-baa2-d17b2b932d0f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.610125 Sep 03 20:59:37.013879 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1360/2801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:36 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:37.020510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.021819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.029300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.030191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.031541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.032491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.034202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Getting quotas for project f5cdab592b0646aaa02deff957842bc0. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:37.034626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.035508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.047573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Getting quotas for user 6b25b05106404b64adc5476924f2e69d and project f5cdab592b0646aaa02deff957842bc0. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:37.065312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:37.067836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:37.155955 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-194d98a6-1c04-4813-aef1-2db651f0af00 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144904 Sep 03 20:59:37.165564 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1442/2802] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 20:59:37.209638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.210281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.232217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.233035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.236217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.237120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.238038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.238752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.319764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:37.323883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:37.337478 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f45e9ff2-9124-4d8a-ab2e-c142624c1f9c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1464 microversion: 2.1 time: 0.318637 Sep 03 20:59:37.338262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1361/2803] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:37.356628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.357353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.383887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.384413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.384864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.385642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.386106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.386542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.515003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:37.528956 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f991e5d8-950a-4cd9-8352-226e92bef14f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.361817 Sep 03 20:59:37.529535 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1443/2804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:37.540780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-988dc736-df89-430f-95b3-a24d6c2eb97a tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.541615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-988dc736-df89-430f-95b3-a24d6c2eb97a tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.626950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-988dc736-df89-430f-95b3-a24d6c2eb97a tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:37.628302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:37.637330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b2e7c7b-5003-47a6-9cc2-2b21e1caac92 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.295053 Sep 03 20:59:37.638110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1362/2805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:37.639243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-988dc736-df89-430f-95b3-a24d6c2eb97a tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1222 microversion: 2.1 time: 0.105886 Sep 03 20:59:37.640498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1444/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:37.661371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:37.668776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.677027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.677896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.678621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.679552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.680026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.680454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.734646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:37.752420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Calling method '.version_select at 0x7fae66307430>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.785897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:59:37.786646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Neutron security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:59:37.787431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] HTTP exception thrown: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.787431 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Request method failure captured: Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/0bf1c472-1fbe-4819-94d1-bb0ef56ac52b HTTP/1.1 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8A51n5bGMhVb4RX-B-9cdb90dp3MhwVgT7Ttgod6DwoeJuf8OrbO-rVyDRDWS6_SXaXDRKYo7UbB4YZP2BA-ypPuEAexvlZrWTIt9TLXjBUx42mDgUkkaKt8-DtWRkPXtBKk6Jh1s2T_STELAR5sWMfrDNNOsB_JjjD8dQf2TIZtF4 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 31880a51f3464381bf28535f2e52d75e Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0bf1c472-1fbe-4819-94d1-bb0ef56ac52b'} Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:59:37.789775 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Returning 404 to user: Security group 0bf1c472-1fbe-4819-94d1-bb0ef56ac52b does not exist Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-04d2130b-c7ba-4ed8-a91e-260954cddedb'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9122fee4-c739-4689-ad5f-837234655a88 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0bf1c472-1fbe-4819-94d1-bb0ef56ac52b" status: 404 len: 194 microversion: 2.1 time: 0.152235 Sep 03 20:59:37.794070 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1363/2807] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:59:37 2022] DELETE /compute/v2.1/os-security-groups/0bf1c472-1fbe-4819-94d1-bb0ef56ac52b => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:37.803643 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5cf04e14-57fd-48a6-941a-d8b65602e670 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003900 Sep 03 20:59:37.804457 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1364/2808] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Sep 3 20:59:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 20:59:37.816880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00b84934-8f36-4665-b526-f4195d870b4f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 0 microversion: 2.1 time: 0.165111 Sep 03 20:59:37.820647 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1445/2809] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:59:37 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:59:37.826766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-006dada7-31d9-4513-be43-278789e675a5 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Calling method '.version_select at 0x7fae6633a550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.830910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:37.832582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:37.854383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.855134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.855771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.857047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.857718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.858870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.902689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:37.903194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:37.903638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:37.904096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lazy-loading 'fault' on Instance uuid 9f418a14-c2a7-4495-85ca-22f600a66d65 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:38.042173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-006dada7-31d9-4513-be43-278789e675a5 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.232206 Sep 03 20:59:38.043877 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1365/2810] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:38.049305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.051300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:38.064936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.065439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.066081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.067255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.067999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.068441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.085542 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7d1354d-ac69-472f-a616-2c8f8b1dedfa tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1598 microversion: 2.1 time: 0.263434 Sep 03 20:59:38.086592 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1446/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:37 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1598 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:38.107632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Calling method '.version_select at 0x7fae6b997b80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.238210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:38.250373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:59:38.251278 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d4788d6-bda8-4ade-82bb-6079828e0620 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.205951 Sep 03 20:59:38.253439 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1366/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:38 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:38.253974 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 03 20:59:38.253974 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Request method failure captured: Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-security-groups/e457c8a6-bb7a-4a42-9a7d-6bbbf8ba2c33 HTTP/1.1 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A51n5bGMhVb4RX-B-9cdb90dp3MhwVgT7Ttgod6DwoeJuf8OrbO-rVyDRDWS6_SXaXDRKYo7UbB4YZP2BA-ypPuEAexvlZrWTIt9TLXjBUx42mDgUkkaKt8-DtWRkPXtBKk6Jh1s2T_STELAR5sWMfrDNNOsB_JjjD8dQf2TIZtF4 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 31880a51f3464381bf28535f2e52d75e Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: exception: Insufficient rights for removing default security group. Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'e457c8a6-bb7a-4a42-9a7d-6bbbf8ba2c33'} Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:59:38.255967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-6b0a4ea9-50ca-49b0-ab94-51509d4ca25f'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07b995d2-49fc-43a8-a3b3-a6000d3394b2 tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e457c8a6-bb7a-4a42-9a7d-6bbbf8ba2c33" status: 400 len: 182 microversion: 2.1 time: 0.170902 Sep 03 20:59:38.261713 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1447/2813] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 20:59:38 2022] DELETE /compute/v2.1/os-security-groups/e457c8a6-bb7a-4a42-9a7d-6bbbf8ba2c33 => generated 182 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:38.275550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:38.279832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:38.283235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Calling method '.version_select at 0x7fae67066ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.286144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.286645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.287119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.287833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.288298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.288731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.341994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:59:38.342748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Neutron security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:59:38.343395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] HTTP exception thrown: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.343395 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Request method failure captured: Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-security-groups/f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca HTTP/1.1 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A51n5bGMhVb4RX-B-9cdb90dp3MhwVgT7Ttgod6DwoeJuf8OrbO-rVyDRDWS6_SXaXDRKYo7UbB4YZP2BA-ypPuEAexvlZrWTIt9TLXjBUx42mDgUkkaKt8-DtWRkPXtBKk6Jh1s2T_STELAR5sWMfrDNNOsB_JjjD8dQf2TIZtF4 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 31880a51f3464381bf28535f2e52d75e Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca'} Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:59:38.346152 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] Sep 03 20:59:38.350379 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.354550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Returning 404 to user: Security group f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca does not exist Sep 03 20:59:38.354550 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-29c67f3f-1331-4113-acb5-d7bc13e8143a'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:38.355766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5241f6f4-895b-400b-be11-c8a6a523783f tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca" status: 404 len: 194 microversion: 2.1 time: 0.076849 Sep 03 20:59:38.356338 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1448/2814] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 20:59:38 2022] GET /compute/v2.1/os-security-groups/f94a8de6-4dfb-43f5-95f0-94bc0e46f1ca => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:38.367686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Action: 'update', calling method: .version_select at 0x7fae67003e50>, body: {"security_group": {"name": "tempest-sg-1380387605", "description": "tempest-description-112853237"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:38.396057 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6edc0467-6a55-4e0e-9af9-9af6d77c760f tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action" status: 202 len: 0 microversion: 2.1 time: 0.140798 Sep 03 20:59:38.397326 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1367/2815] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 20:59:38 2022] POST /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 20:59:38.407401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.408037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:38.416315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 20:59:38.417106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Neutron security group 21f04790-32d2-4562-92eb-2c493387f27b not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 20:59:38.417536 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] HTTP exception thrown: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.417536 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Request method failure captured: Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/os-security-groups/21f04790-32d2-4562-92eb-2c493387f27b HTTP/1.1 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 101 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A51n5bGMhVb4RX-B-9cdb90dp3MhwVgT7Ttgod6DwoeJuf8OrbO-rVyDRDWS6_SXaXDRKYo7UbB4YZP2BA-ypPuEAexvlZrWTIt9TLXjBUx42mDgUkkaKt8-DtWRkPXtBKk6Jh1s2T_STELAR5sWMfrDNNOsB_JjjD8dQf2TIZtF4 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf527a7e5cbd41a1bf27d9e8cb663900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: cf527a7e5cbd41a1bf27d9e8cb663900 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-368758326 Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 31880a51f3464381bf28535f2e52d75e Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-368758326-project Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: {"security_group": {"name": "tempest-sg-1380387605", "description": "tempest-description-112853237"}} Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '21f04790-32d2-4562-92eb-2c493387f27b', 'body': {'security_group': {'name': 'tempest-sg-1380387605', 'description': 'tempest-description-112853237'}}} Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 20:59:38.419449 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] Returning 404 to user: Security group 21f04790-32d2-4562-92eb-2c493387f27b does not exist Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-8c784ec6-4c48-484d-95d3-1b557b908005'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-096d3fac-516d-454c-a66d-7af4891668ba tempest-SecurityGroupsNegativeTestJSON-368758326 tempest-SecurityGroupsNegativeTestJSON-368758326-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/21f04790-32d2-4562-92eb-2c493387f27b" status: 404 len: 194 microversion: 2.1 time: 0.058344 Sep 03 20:59:38.430116 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1449/2816] 10.222.0.16 () {60 vars in 1290 bytes} [Sat Sep 3 20:59:38 2022] PUT /compute/v2.1/os-security-groups/21f04790-32d2-4562-92eb-2c493387f27b => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.434810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.559436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.560072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:38.585563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.593708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.594185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.600823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.601358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.603542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.802210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6950ac75-9953-4813-9916-96b79a0082b4 tempest-ServersAdminTestJSON-1933343208 tempest-ServersAdminTestJSON-1933343208-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1615 microversion: 2.1 time: 0.401000 Sep 03 20:59:38.803242 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1368/2817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:38 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1615 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:38.819284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:38.820716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:38.827382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.828182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.828793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:38.829730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:38.830357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:38.830951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.096911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:39.105979 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-154c57a3-79e2-4927-bcb2-7deceaf568b9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.552702 Sep 03 20:59:39.106871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1450/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:38 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:39.112279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:39.113841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:39.121232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.121980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.122617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.123724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.124388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.125913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.216409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:39.226606 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c773847f-85dd-4caf-93b5-3084bb16eaf8 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1292 microversion: 2.1 time: 0.118470 Sep 03 20:59:39.227998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1451/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:39 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:39.233905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:39.234638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:39.246284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.247317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.247597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:39.249564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.250486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.251126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.252299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.262374 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ec51721-4e09-4666-9992-9ffd04a1367f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.452750 Sep 03 20:59:39.275533 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1369/2820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:38 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:39.282116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123bb02c-0a54-4b48-b0a6-1fc382d7caa7", "name": "network-vif-plugged", "status": "completed", "tag": "7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:39.293619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:39.296539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:39.299778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.300264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.300699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.328996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] Creating event network-vif-plugged:7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c for instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 on nch2-master-1 Sep 03 20:59:39.337147 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-09790cc4-0548-44d3-9795-14cb6fa1e258 req-251d1cef-4e97-42d0-af23-8189bd75eeeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058696 Sep 03 20:59:39.338235 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1370/2821] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:39.346242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:39.347222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:39.370870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.373427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.374585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.375533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.376020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.376547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.427408 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8c1f1f4-0118-4f5e-902d-cd0b4fa21145 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 204 len: 0 microversion: 2.1 time: 0.191481 Sep 03 20:59:39.428350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1452/2822] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:39 2022] DELETE /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:39.437579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:39.438347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:39.458053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.458844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.459463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.460499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:39.461237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:39.462075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:39.652117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:39.665691 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-69b2526e-abca-4a03-bf45-99c3d1a9c815 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1468 microversion: 2.1 time: 0.232858 Sep 03 20:59:39.666955 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1453/2823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:39 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:39.761459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:39.771550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59afc6b8-78f3-43e2-8bb3-df8f6e6b1350 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.431715 Sep 03 20:59:39.786605 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1371/2824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:39 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:40.135297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:40.136160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:40.143197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.143828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.144348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.145242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.145765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.147959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.254608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:40.255296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:40.267961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.268462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.268920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.273764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.274291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.274741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.346104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:40.355253 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4411307-9c53-469c-a890-dacee514e3f7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.224514 Sep 03 20:59:40.356081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1454/2825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:40 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:40.361216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:40.362092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:40.379455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.380108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:40.380358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.381100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.382316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.382930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.383532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.393002 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6cb49372-74cb-4877-a293-076f94c63ed5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1280 microversion: 2.1 time: 0.142196 Sep 03 20:59:40.393918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1372/2826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:40 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:40.563797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:40.581431 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2ac1f1e-4a7b-4310-af1e-87be39a14d33 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.222377 Sep 03 20:59:40.582061 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1455/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:40 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:40.695691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:40.697572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:40.719043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.721496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.722228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.723444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.724405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.725153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.803117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:40.804130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:40.813721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.814673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.815334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.816312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:40.817025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:40.817742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:40.989484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:40.999696 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e945ba61-ce88-4284-90c3-3841f8120285 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.204083 Sep 03 20:59:41.016402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1456/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:40 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:41.235373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:41.249836 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe54b877-2740-4107-91bf-9872cbd81091 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1468 microversion: 2.1 time: 0.560945 Sep 03 20:59:41.250710 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1373/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:40 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:41.365765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a2ace1-f683-4a53-898d-90132c063bf7", "name": "network-vif-plugged", "status": "completed", "tag": "29a7f5f4-3ef0-4798-912d-b2972c9d925a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:41.380137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:41.381081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.381567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:41.381699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.382119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.399150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.404378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.406000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.409492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.411139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.411754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.414498 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] Creating event network-vif-plugged:29a7f5f4-3ef0-4798-912d-b2972c9d925a for instance 33a2ace1-f683-4a53-898d-90132c063bf7 on nch1-master-1 Sep 03 20:59:41.421907 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f0f888c6-4d47-4821-b2ab-89366e79b676 req-4fba6a2f-739e-4597-9ebc-b8ddfdffba6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061457 Sep 03 20:59:41.423074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1457/2830] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:41.431126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:41.432732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:41.441209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.442087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.442882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.443822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.444467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.445130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.568507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:41.578394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a341c14c-cf91-4512-9cc1-f75bb3c7b29b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1280 microversion: 2.1 time: 0.153291 Sep 03 20:59:41.594570 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1458/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:41 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:41.604540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:41.605591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:41.612952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.613803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.614931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.615901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:41.616649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:41.617348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:41.745944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:41.755982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b57d0302-2399-4323-9fa5-3d4cea0e678d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.380384 Sep 03 20:59:41.756722 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1374/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:41 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:41.944805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:41.954107 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6dbb87d6-60d7-41b3-a24d-b017de607145 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.354252 Sep 03 20:59:41.955321 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1459/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:41 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:42.026849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:42.028270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:42.037647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.038422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.039149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.040113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.040783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.041617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.203767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:42.213063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8f73584f-49b3-4c42-9565-3f9004153351 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1515 microversion: 2.1 time: 0.190170 Sep 03 20:59:42.233843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1375/2834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:42 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:42.273374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:42.274002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:42.280884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.281400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.281855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.282566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.283072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.283531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.543606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:42.552124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88aaa024-c9b1-4a9a-8ece-434e74da4f82 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1468 microversion: 2.1 time: 0.282777 Sep 03 20:59:42.552699 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1460/2835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:42 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:42.603047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:42.603649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:42.611582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.612072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.612510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.613383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.613836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.614263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.794960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:42.796835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:42.808227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.809265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.809808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.810619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:42.811222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:42.811778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:42.900092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:42.913310 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4135fe6-fb40-43cf-ae60-716c5b76df31 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.313891 Sep 03 20:59:42.913905 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1376/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:42 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:42.960561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:42.972275 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59fe6fde-f543-4b0d-8877-5bff64116439 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1316 microversion: 2.1 time: 0.192388 Sep 03 20:59:42.980882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:42.985467 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1461/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:42 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:42.993322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:43.012606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.013207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.013838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.016103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.016736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.019026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.240746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:43.241765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:43.256043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.258385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.260854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.261901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.270989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.271761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.545375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:43.552391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:43.559031 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db63e614-db55-40fa-a079-9962e0a52cb3 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.323799 Sep 03 20:59:43.562154 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1462/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:43 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:43.583533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:43.584232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:43.591350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.591875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.595221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.601723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.602572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.603211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.617265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:43.630492 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-062d86ce-fbf2-464c-856f-0593284d70f3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1367 microversion: 2.1 time: 0.651024 Sep 03 20:59:43.633287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1377/2839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:42 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1367 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:43.742536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:43.753637 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f733ea49-9131-43b2-bdb4-377f81df2fb9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1426 microversion: 2.1 time: 0.174527 Sep 03 20:59:43.769250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1463/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:43 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1426 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:43.771349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c143b21-ea16-4bd2-a5c0-1dae34b12894", "name": "network-vif-deleted", "tag": "1bdf4625-853c-4b17-9e4b-aac230c9c104"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:43.782191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.782683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.783115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.796554 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] Creating event network-vif-deleted:1bdf4625-853c-4b17-9e4b-aac230c9c104 for instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 on nch2-master-1 Sep 03 20:59:43.802196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3c09c2a5-b871-490e-b75b-6d4583a85d42 req-10136905-bb3b-44e5-8c99-6c515a17ad6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Sep 03 20:59:43.803460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1378/2841] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:43.938309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:43.940208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:43.956333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.957240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.957702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:43.960319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:43.960857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:43.963602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.005381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:44.006195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:44.030963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.031484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.031934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.032662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.033153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.033589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.190867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:44.199083 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14da12fa-626e-4c86-aedc-9d9796fe04cb tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.267173 Sep 03 20:59:44.200026 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1464/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:43 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:44.519697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d809ca-7e78-4ee9-8541-dfe079c91896", "tag": "6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:44.534932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:44.536204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.537590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.538216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.542849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8635be7-8805-4270-8360-e99a4f51ca80 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1466 microversion: 2.1 time: 0.542600 Sep 03 20:59:44.545953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1379/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:43 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1466 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:44.560190 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] Creating event network-changed:6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340 for instance 79d809ca-7e78-4ee9-8541-dfe079c91896 on nch2-master-1 Sep 03 20:59:44.565237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b431cd61-5db3-4e5b-a57d-190098272d47 req-543deffe-b20f-4bfe-ae3a-983b5c9bda9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155800 Sep 03 20:59:44.571145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:44.572315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:44.576379 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1465/2844] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:44.587352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.587855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.588299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.589043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.594700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.596269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:44.597176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.602404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:44.618941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.619457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.619894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.620617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.621093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.621762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.807036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:44.817186 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0f2b6e2c-63b8-435e-ace2-3372306743c6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.232280 Sep 03 20:59:44.818431 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1466/2845] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:44 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:44.823411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:44.824325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:44.834551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.835335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.836028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.837346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.838026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.838664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.953142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0606bdd2-47a6-413a-8992-ec0c4d13be0a tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1617 microversion: 2.1 time: 0.385562 Sep 03 20:59:44.955754 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1380/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:44 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1617 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:44.969204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:44.970458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:44.986387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.986984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.987436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:44.988257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:44.988814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:44.989273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.036497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:45.072271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.073046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.073643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.074400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lazy-loading 'fault' on Instance uuid 2c143b21-ea16-4bd2-a5c0-1dae34b12894 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:45.127486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:45.143916 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8680676b-e10f-4a2d-928b-10b2e1ac652e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1557 microversion: 2.1 time: 0.324221 Sep 03 20:59:45.144494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1467/2847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:44 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1557 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:45.149196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2102507270", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b4d9ba95-551c-4316-94bb-bb83ba4bd615"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:45.168813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:45.179864 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffe76649-7f85-4dab-a4fa-0521ea84ee89 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 200 len: 1304 microversion: 2.1 time: 0.220401 Sep 03 20:59:45.180578 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1381/2848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:44 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 1304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:45.190365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:45.190979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:45.197853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.198551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.198995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.199700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.200156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.201071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.230032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:45.290171 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3934a089-a917-44eb-b8e4-758ad2ef45e2 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105009 Sep 03 20:59:45.291684 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1382/2849] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 20:59:45 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:45.297347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:45.298313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:45.306556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.307049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.307487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.308215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.308667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.309132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.586029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:45.586543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:45.587000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:45.587420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:45.587868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:45.600211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.601037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.601695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.602857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.603978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.604713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.628745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:45.636827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:45.650874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:45.655681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:45.657360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:45.673060 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b5e6718-a504-478b-bec8-8a71fccb090e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.380082 Sep 03 20:59:45.675424 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1383/2850] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:45 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:45.725813 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e42e3aed-a24e-47c9-a99d-48aa92eb6349 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580087 Sep 03 20:59:45.726899 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1468/2851] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:59:45.738482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18af234a-080e-4884-bf73-218893184b42 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:45.739404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18af234a-080e-4884-bf73-218893184b42 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:45.841272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18af234a-080e-4884-bf73-218893184b42 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:45.843945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:45.844593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:45.852062 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18af234a-080e-4884-bf73-218893184b42 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1217 microversion: 2.1 time: 0.117353 Sep 03 20:59:45.856266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.856883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.857363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.858805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:45.859577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:45.860094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:45.865428 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1384/2852] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:45 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:46.021133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:46.033315 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-34cb87c0-0940-4696-bf4f-760d6a11e5ec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.195029 Sep 03 20:59:46.034235 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1469/2853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:45 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:46.203862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:46.205297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 2c143b21-ea16-4bd2-a5c0-1dae34b12894] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:46.213195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.214864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.215537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.216476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.217166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.217842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.243651 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] HTTP exception thrown: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Request method failure captured: Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 HTTP/1.1 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-4k7WpxIZx2-1i93gffwea5TVn3Nt5Vu_mMTd6qILY8qdzni3hkLvMEqSFveVu1rVGCRcQKf_6bOExvfygodbEteB3GVwnJD0m8sk9RE0LpqXwv4UQZmmEUhPFbK1qcK4dY1Elpb2v3x6RdVjjbOojk9Du2Q04XfClu3tdrykBZRY Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 0c77fca40dbc430db41e4a30639b28b5 Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2c143b21-ea16-4bd2-a5c0-1dae34b12894'} Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:46.245599 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Returning 404 to user: Instance 2c143b21-ea16-4bd2-a5c0-1dae34b12894 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-334b5165-dea9-4f85-8b9c-2fb7db08ebf2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894" status: 404 len: 111 microversion: 2.1 time: 0.047538 Sep 03 20:59:46.251528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1385/2854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:46 2022] GET /compute/v2.1/servers/2c143b21-ea16-4bd2-a5c0-1dae34b12894 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:46.257189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:46.257798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:46.264175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.265055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.265690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.266608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.267345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.267872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.303820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:46.427586 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a4278eb-b2b6-4573-9e3b-cfbb53539cae tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 204 len: 0 microversion: 2.1 time: 0.169426 Sep 03 20:59:46.429022 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1470/2855] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:46 2022] DELETE /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:46.438548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:46.439189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:46.449114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.450029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.450856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.452220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.453091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.453800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.570124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "79ca652d-8a93-487e-9b4e-7df80b9fd1f2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:46.592207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.593703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.594151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.616784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] Creating event network-vif-unplugged:79ca652d-8a93-487e-9b4e-7df80b9fd1f2 for instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a on nch2-master-1 Sep 03 20:59:46.631859 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-af761382-82f7-437a-8156-d784e5ffb2bb req-6a39952c-36d5-4975-8fa4-0436c0224da1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070211 Sep 03 20:59:46.635294 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1471/2856] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:46.699042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:46.711191 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66da1d4b-d7df-4318-8897-0fbf157d0a02 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1468 microversion: 2.1 time: 0.278129 Sep 03 20:59:46.711677 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1386/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:46 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:46.739922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:46.743465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:46.757539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:46.763115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.765247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.765705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.766437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.766900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.769611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.879606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:46.881369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:46.890872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.891424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.892214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:46.893133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:46.893811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:46.894395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.001613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:47.015309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7bb170a-d9c3-41bd-8798-cc16de0455d8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1221 microversion: 2.1 time: 0.137988 Sep 03 20:59:47.021287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1387/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:46 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:47.028656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a2ace1-f683-4a53-898d-90132c063bf7", "tag": "29a7f5f4-3ef0-4798-912d-b2972c9d925a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:47.040516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:47.041453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:47.042411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.059223 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] Creating event network-changed:29a7f5f4-3ef0-4798-912d-b2972c9d925a for instance 33a2ace1-f683-4a53-898d-90132c063bf7 on nch1-master-1 Sep 03 20:59:47.066577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ae6fd994-ec9d-432c-89b6-c4ea0243fdfd req-005599e8-6959-4a07-8cb9-ed6acbef437a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043726 Sep 03 20:59:47.068021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1388/2859] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:47.087538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:47.088636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:47.097402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:47.098265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:47.098955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.099931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:47.100797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:47.102133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.141241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:47.153465 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e2a74b9-54f8-40d9-8dcf-b400d0bf5600 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.434009 Sep 03 20:59:47.154930 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1472/2860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:46 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:47.738776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:47.739421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:47.747868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:47.749236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:47.749906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.751328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:47.752065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:47.752745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:47.830408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:47.841210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d68086b-4172-4fe6-8f84-5fd8c28c598f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.759394 Sep 03 20:59:47.841796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1389/2861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:47 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:48.039191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:48.039845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:48.050955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.053521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.054271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:48.057464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.060537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.062861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:48.169550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:48.179409 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56be50a7-f959-4686-a72d-768feeccf6c9 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1468 microversion: 2.1 time: 0.444688 Sep 03 20:59:48.187483 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1473/2862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:47 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:48.192563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:48.200689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:48.210376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.221800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.222564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:48.223511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.224141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.224771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:48.561913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:48.576235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:48.578864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f3b71a2-6786-4fc8-9f65-4b0196a33d4e tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.389537 Sep 03 20:59:48.579966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1474/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:48 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:48.600571 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6fa863ab-6951-4f72-95b6-054f6ff0dd39 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1287 microversion: 2.1 time: 0.565246 Sep 03 20:59:48.601747 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1390/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:48 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1287 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:48.868100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:48.869695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:48.889117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.892517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.898254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:48.900361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:48.902331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:48.903117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.052289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a", "name": "network-vif-plugged", "status": "completed", "tag": "79ca652d-8a93-487e-9b4e-7df80b9fd1f2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:49.070985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.074135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.074817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.114415 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] Creating event network-vif-plugged:79ca652d-8a93-487e-9b4e-7df80b9fd1f2 for instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a on nch2-master-1 Sep 03 20:59:49.120837 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-04dffb65-657d-49eb-9f31-8ad2d241e33b req-895e41d8-22a7-461e-ac7f-c31524a0892c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076369 Sep 03 20:59:49.121977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1391/2865] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:49.217234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:49.218615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:49.227898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.238973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.240457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.243566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.244479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.245141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.261911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:49.271454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a44f854d-b19a-4430-ac02-d7fd2ef23adb tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.407649 Sep 03 20:59:49.272066 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1475/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:48 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:49.603505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:49.604398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:49.610928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.611422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.611866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.612572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.613060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.613497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.733797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:49.743352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3db632c7-c018-4d0c-b87c-38550118755f tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1468 microversion: 2.1 time: 0.532127 Sep 03 20:59:49.744627 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1392/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:49 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:49.748702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:49.756840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:49.760253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:49.764963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5d414d5-b9bb-44d3-8a66-bebd6192a8ab tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.165202 Sep 03 20:59:49.765571 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1476/2868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:49 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:49.771203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.771781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.772304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.773300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:49.773868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:49.774406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:49.872121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:49.880368 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7a35989-1752-432f-957c-3b5a7e46165b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1275 microversion: 2.1 time: 0.127146 Sep 03 20:59:49.881079 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1393/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:49 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:50.122373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55cce66-5224-49ba-95a4-33f77168d196", "name": "network-vif-deleted", "tag": "bd2e12f1-ea0c-410e-adc0-8a5a6b38a160"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:50.136857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.137651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.137999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.153288 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] Creating event network-vif-deleted:bd2e12f1-ea0c-410e-adc0-8a5a6b38a160 for instance f55cce66-5224-49ba-95a4-33f77168d196 on nch1-master-1 Sep 03 20:59:50.158674 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e682874a-c15e-4ea0-b9f8-b340e752b33d req-298ebb03-a439-4100-9b3a-e7eeff9e5a5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039805 Sep 03 20:59:50.159274 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1477/2870] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:50.296600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:50.297475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:50.306600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.307991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.308628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.309659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.310451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.311648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.770516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:50.771646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:50.783392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.784088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.784688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.785564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.786123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.786653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.822607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:50.828850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.829736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.830649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.831347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lazy-loading 'fault' on Instance uuid f55cce66-5224-49ba-95a4-33f77168d196 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:50.841251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-052ced08-3dec-4b11-900c-6511de7f1ab2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1521 microversion: 2.1 time: 0.550093 Sep 03 20:59:50.842413 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1394/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:50 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:50.847687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:50.848492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:50.854978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.855479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.856086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.857004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.857476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.857973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.907131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:50.916134 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c76c237b-ea29-4fd8-9548-ba0721c0e5a2 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 200 len: 1304 microversion: 2.1 time: 0.152069 Sep 03 20:59:50.916878 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1478/2872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:50 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:50.932214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:50.936841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:50.949259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.949954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.950509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:50.951345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:50.952516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:50.953243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.206248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:51.215732 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05ec71a6-aadd-43c4-a892-ccfa5f45a441 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.292867 Sep 03 20:59:51.216366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1479/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:50 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:51.221293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d809ca-7e78-4ee9-8541-dfe079c91896", "name": "network-vif-plugged", "status": "completed", "tag": "6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:51.231511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:51.232005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:51.232445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.237500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:51.247842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] Creating event network-vif-plugged:6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340 for instance 79d809ca-7e78-4ee9-8541-dfe079c91896 on nch2-master-1 Sep 03 20:59:51.254089 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2ec8285b-892d-451c-a52f-811f7781f883 req-0c296a22-b69a-4da8-b765-b1b95902564a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036393 Sep 03 20:59:51.254921 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1480/2874] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:51.404481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:51.423017 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bacd3c9c-3c2c-4a23-8ff5-3b835bdfdfd2 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.579334 Sep 03 20:59:51.423619 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1395/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:50 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:51.866955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:51.867836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:51.875710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:51.876205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:51.876657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.877402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:51.877862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:51.878295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.941714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:51.943118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: f55cce66-5224-49ba-95a4-33f77168d196] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:51.950446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:51.951287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:51.951773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.952970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:51.953598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:51.954377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:51.972592 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] HTTP exception thrown: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Request method failure captured: Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 HTTP/1.1 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7-4k7WpxIZx2-1i93gffwea5TVn3Nt5Vu_mMTd6qILY8qdzni3hkLvMEqSFveVu1rVGCRcQKf_6bOExvfygodbEteB3GVwnJD0m8sk9RE0LpqXwv4UQZmmEUhPFbK1qcK4dY1Elpb2v3x6RdVjjbOojk9Du2Q04XfClu3tdrykBZRY Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 0c77fca40dbc430db41e4a30639b28b5 Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'f55cce66-5224-49ba-95a4-33f77168d196'} Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:51.974400 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:51.979074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Returning 404 to user: Instance f55cce66-5224-49ba-95a4-33f77168d196 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:51.980326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77efb6fc-ebf1-43e3-9908-fc5000c21661 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196" status: 404 len: 111 microversion: 2.1 time: 0.045727 Sep 03 20:59:51.981221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1396/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:51 2022] GET /compute/v2.1/servers/f55cce66-5224-49ba-95a4-33f77168d196 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:51.992151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:51.992976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.000189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.001032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.001583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.002380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.002961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.003497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.021170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:52.030801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:52.031072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4ee9a7ba-5e8f-4679-b357-19cb97208a70 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1506 microversion: 2.1 time: 0.168830 Sep 03 20:59:52.032080 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1481/2877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:51 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:52.058779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:52.059521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.066321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.066908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.067357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.070039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.070039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.070039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.123013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4ef1154-8c2d-49f4-b252-16a9fc61709d tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 204 len: 0 microversion: 2.1 time: 0.136881 Sep 03 20:59:52.124511 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1397/2878] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:51 2022] DELETE /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 20:59:52.135913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:52.136319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.143514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.144326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.145250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.145788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.146242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.146665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.230057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:52.238581 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-41ee8795-a561-4dae-bd75-0e48d408ab8a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 200 len: 1506 microversion: 2.1 time: 0.183648 Sep 03 20:59:52.239154 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1482/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:52 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:52.243724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:52.244529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.250341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.250895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.251504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.252360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.252999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.253830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.393731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:52.401589 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e657e672-6423-4d33-83cb-78a7c1e6c5d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.161462 Sep 03 20:59:52.402203 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1483/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:52 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:52.423079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:52.423637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:52.423637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.430012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.430450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.430868 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7cf7ee99-25cd-4aa7-961a-efda17b77a2c tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1470 microversion: 2.1 time: 0.301923 Sep 03 20:59:52.430996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.431641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.432107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.432541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.445401 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1398/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:52 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1470 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:52.453497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:52.454218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:52.460636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.461276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.461816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.462643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.463208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.463636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:52.463821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.566325 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c7fabdb-a156-476d-98d2-bffb81393eac tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 204 len: 0 microversion: 2.1 time: 0.147940 Sep 03 20:59:52.567818 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1484/2882] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:52 2022] DELETE /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:52.588872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac36e5f-f961-4bfe-b477-58985805f5a7", "tag": "f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:52.610905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:52.611399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:52.612425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:52.641410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] Creating event network-changed:f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2 for instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 on nch2-master-1 Sep 03 20:59:52.649316 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7b96a3af-6c87-4292-bf2a-f34a6403f435 req-4a5854a8-4d2f-433b-992b-4cb7beedc57a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080017 Sep 03 20:59:52.650969 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1485/2883] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:52.675982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:52.685157 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d782e6c-2f50-4df6-9d77-3da136b305c1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1322 microversion: 2.1 time: 0.238253 Sep 03 20:59:52.686371 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1399/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:52 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:52.743909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-423798372", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "997056ce-178c-47cb-9487-493aaba31e81"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:52.807456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] validate_networks() for [('997056ce-178c-47cb-9487-493aaba31e81', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:53.426302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:53.427626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:53.434767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.435247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.435962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.437432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.437914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.438339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.442170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:53.491050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:53.491535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:53.492725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:53.495223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:53.496845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:53.540613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.542240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.542947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.545027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.546303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.548462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.579451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:53.589096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:53.589975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for user 859a4503b4d84a4e8c3213e2de02492d and project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:53.599167 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bea1fa36-94b4-4caf-8221-cacb7c86381e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.179288 Sep 03 20:59:53.614664 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1400/2885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:53 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:53.615295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:53.619827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:53.620170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:53.620433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:53.627161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.627852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.628469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.629350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.629955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.630563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.800238 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49996938-98c7-451a-a5a5-075fbc5c5d05 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060728 Sep 03 20:59:53.804322 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1486/2886] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:59:53.818654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:53.819631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:53.830445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.831425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.832008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.832937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:53.833469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:53.835805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:53.936453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:53.959932 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-798eabaa-3939-4ff5-984a-7997da85cf93 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1470 microversion: 2.1 time: 0.342399 Sep 03 20:59:53.976166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1401/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:53 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:53.984730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b4e0a23-9a0f-4323-b8c9-9ea9529fe065 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:53.985571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b4e0a23-9a0f-4323-b8c9-9ea9529fe065 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:54.055006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b4e0a23-9a0f-4323-b8c9-9ea9529fe065 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:54.066728 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b4e0a23-9a0f-4323-b8c9-9ea9529fe065 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1217 microversion: 2.1 time: 0.088368 Sep 03 20:59:54.067312 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1402/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:53 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:54.115078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:54.136600 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66229e2a-3ad9-46da-9ba8-1ad61c16319f tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1519 microversion: 2.1 time: 0.331084 Sep 03 20:59:54.137255 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1487/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:53 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:54.313013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-502f3377-8f05-4030-9afb-76af64c9b770 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-729008345", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-502f3377-8f05-4030-9afb-76af64c9b770 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 242 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-729008345", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-729008345', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '6558e500-88ff-4453-8fc4-ebe415b62d51'}]}}} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.319257 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-502f3377-8f05-4030-9afb-76af64c9b770 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-502f3377-8f05-4030-9afb-76af64c9b770 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012650 Sep 03 20:59:54.323844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1403/2890] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:54 2022] POST /compute/v2.1/servers => generated 175 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:54.337409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:54.338027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: cdeb08cb-6176-4ab5-afb5-fbb77b7335aa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:54.345850 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] HTTP exception thrown: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/cdeb08cb-6176-4ab5-afb5-fbb77b7335aa/metadata HTTP/1.1 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': 'cdeb08cb-6176-4ab5-afb5-fbb77b7335aa'} Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.356569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.362017 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:54.362017 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:54.362017 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. Sep 03 20:59:54.362017 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.374549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 404 to user: Instance cdeb08cb-6176-4ab5-afb5-fbb77b7335aa could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.375539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4900c050-e6ba-420c-af13-989a7e2fbb22 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/cdeb08cb-6176-4ab5-afb5-fbb77b7335aa/metadata" status: 404 len: 111 microversion: 2.1 time: 0.042866 Sep 03 20:59:54.388220 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1488/2891] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 20:59:54 2022] GET /compute/v2.1/servers/cdeb08cb-6176-4ab5-afb5-fbb77b7335aa/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:54.466175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b821bc7a-f31b-4bb1-b442-5ea8976124de tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-257173961", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b821bc7a-f31b-4bb1-b442-5ea8976124de tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 498 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-257173961", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-257173961', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6558e500-88ff-4453-8fc4-ebe415b62d51'}]}}} Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:59:54.483476 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b821bc7a-f31b-4bb1-b442-5ea8976124de tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b821bc7a-f31b-4bb1-b442-5ea8976124de tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.034009 Sep 03 20:59:54.488464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1404/2892] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:54 2022] POST /compute/v2.1/servers => generated 687 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:54.573755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55a900cb-0406-41c5-b558-30314f8b71f5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1422841602", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55a900cb-0406-41c5-b558-30314f8b71f5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 500 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1422841602", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1422841602', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6558e500-88ff-4453-8fc4-ebe415b62d51'}]}}} Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:59:54.580285 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55a900cb-0406-41c5-b558-30314f8b71f5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55a900cb-0406-41c5-b558-30314f8b71f5 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012792 Sep 03 20:59:54.583879 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1489/2893] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:54 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 20:59:54.628238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:54.629078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:54.644807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:54.645184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2e75e2-12b2-4faa-8a57-a48425735f18 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509034276", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:54.648442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:54.649710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2e75e2-12b2-4faa-8a57-a48425735f18 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 753 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-509034276", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-509034276', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6558e500-88ff-4453-8fc4-ebe415b62d51'}]}}} Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:54.651252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:54.654056 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:54.660185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.660185 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.660815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:54.660815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:54.660815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:54.662484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e2e75e2-12b2-4faa-8a57-a48425735f18 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.664183 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2e2e75e2-12b2-4faa-8a57-a48425735f18 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023395 Sep 03 20:59:54.678924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1490/2894] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:54 2022] POST /compute/v2.1/servers => generated 1197 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 03 20:59:54.838212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec39dab4-87f1-4bbb-b319-6c41e2ece2dd tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1717842123", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec39dab4-87f1-4bbb-b319-6c41e2ece2dd tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 1266 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1717842123", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "6558e500-88ff-4453-8fc4-ebe415b62d51"}]}} Sep 03 20:59:54.846747 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1717842123', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '6558e500-88ff-4453-8fc4-ebe415b62d51'}]}}} Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.848868 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 20:59:54.849929 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 20:59:54.851544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 03 20:59:54.851544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.852738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec39dab4-87f1-4bbb-b319-6c41e2ece2dd tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.853021 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec39dab4-87f1-4bbb-b319-6c41e2ece2dd tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018859 Sep 03 20:59:54.860008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1491/2895] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Sep 3 20:59:54 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 03 20:59:54.874020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:54.875288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 6f43a23f-07be-4850-b530-b7c4573ecb7e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:54.903728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] HTTP exception thrown: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6f43a23f-07be-4850-b530-b7c4573ecb7e/metadata/test2 HTTP/1.1 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': '6f43a23f-07be-4850-b530-b7c4573ecb7e', 'id': 'test2'} Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:54.907387 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:54.912052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:54.912052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:54.912052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. Sep 03 20:59:54.912052 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:54.918563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 404 to user: Instance 6f43a23f-07be-4850-b530-b7c4573ecb7e could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:54.920078 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21fc3a12-6ac8-48dc-b3fb-2a5ec6d617f9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/6f43a23f-07be-4850-b530-b7c4573ecb7e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.058229 Sep 03 20:59:54.923294 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1492/2896] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 20:59:54 2022] GET /compute/v2.1/servers/6f43a23f-07be-4850-b530-b7c4573ecb7e/metadata/test2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 20:59:54.935379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:54.945279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:54.945793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:54.952650 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f99473f1-dc36-485a-9f15-fca53b0d8a16 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.333692 Sep 03 20:59:54.954236 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1405/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:54 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:54.981156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:54.982596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:54.989020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:54.989910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:54.990509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:54.993699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:54.994502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:54.994747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:55.005873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.006700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.007434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.008517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.009154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.010402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.034853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 20:59:55.234886 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe5990cd-4cf4-4779-b2bb-84aada2e8227 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 204 len: 0 microversion: 2.1 time: 0.293885 Sep 03 20:59:55.235483 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1493/2898] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 20:59:54 2022] DELETE /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 20:59:55.255576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:55.259678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:55.262422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:55.269897 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0a297f6-103d-4c1c-bb46-3644ee28fa6b tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1470 microversion: 2.1 time: 0.281800 Sep 03 20:59:55.281133 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1406/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:54 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1470 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:55.281133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:55.281133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:55.281509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.282378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.290631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.290746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.290842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.290930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.291048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.291138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.291238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.291327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:55.291327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:55.291327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:55.417140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:55.428994 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1705ed57-86a9-4a38-ac56-93396cef6f8d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1269 microversion: 2.1 time: 0.189000 Sep 03 20:59:55.430102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1494/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:55 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:55.482495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:55.490334 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0cccd51-bf5f-47e7-ba0a-3a3163cefb9d tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1525 microversion: 2.1 time: 0.217848 Sep 03 20:59:55.490903 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1407/2901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:55 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:55.557961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-510833348", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:55.613848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] validate_networks() for [('fc7bb338-c80e-4c56-8d25-4a07b0e5f6f2', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 20:59:55.991376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:55.992139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:56.002094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.002811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.003401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.004291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.004915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.005750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.022645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 20:59:56.023070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 20:59:56.023545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 20:59:56.024011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 20:59:56.024350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 20:59:56.035588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.036088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.036681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.037612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.037945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.038998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.060554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Getting quotas for project 630205311fc04912910e56076899f18d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 20:59:56.068101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Getting quotas for user fa304e40e3894910be1a5e1e97a34b1a and project 630205311fc04912910e56076899f18d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 20:59:56.084121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 20:59:56.087697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 20:59:56.139030 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f5fa224-eeed-4553-b655-ae18c2daa72c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.707493 Sep 03 20:59:56.140544 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1495/2902] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 20:59:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 20:59:56.152260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aaa7fa01-e328-40c6-b792-0bfd68c13e42 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:56.153091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aaa7fa01-e328-40c6-b792-0bfd68c13e42 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:56.231633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaa7fa01-e328-40c6-b792-0bfd68c13e42 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:56.239493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aaa7fa01-e328-40c6-b792-0bfd68c13e42 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1222 microversion: 2.1 time: 0.091553 Sep 03 20:59:56.240083 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1496/2903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:56 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:56.294749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:56.303601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:56.304217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:56.305980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e1928da-8609-46f1-b963-0857f38ef5f1 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.319855 Sep 03 20:59:56.307566 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1408/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:55 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:56.311705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.312293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.312815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.313712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.314239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.314597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.454763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:56.455874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:56.462485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.470354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.471281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.474958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.475677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.476322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.569195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:56.578646 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2426a88b-5aaf-41cf-8172-02054df2daa4 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1470 microversion: 2.1 time: 0.278859 Sep 03 20:59:56.579241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1497/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:56 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:56.589411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:56.590039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:56.604474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.605014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.605466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.606195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:56.614500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:56.615334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:56.738021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:56.750848 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-859c5750-1b2b-486f-b4f7-8347f7c2c455 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1275 microversion: 2.1 time: 0.297405 Sep 03 20:59:56.751749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1409/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:56 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:56.872611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:56.897746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e447211-8fab-411a-9985-2f3edc98233c tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1525 microversion: 2.1 time: 0.312068 Sep 03 20:59:56.900784 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1498/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:56 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1525 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:57.265360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:57.266001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:57.276424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f418a14-c2a7-4495-85ca-22f600a66d65", "name": "network-vif-deleted", "tag": "434c214a-3a8a-4c83-ae50-679a35739a55"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:57.288191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.290989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.291655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.291813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.292398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.293064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.294881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.298406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.299585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.311825 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] Creating event network-vif-deleted:434c214a-3a8a-4c83-ae50-679a35739a55 for instance 9f418a14-c2a7-4495-85ca-22f600a66d65 on nch2-master-1 Sep 03 20:59:57.318620 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-aaa7fbc1-056e-4834-983d-f94fa582d26c req-ec3dea6e-75f7-4f83-bbd2-b66d5006271c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048346 Sep 03 20:59:57.319887 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1499/2908] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 20:59:57.334871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:57.336604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:57.359693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.360195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.362260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.365427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.366141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.366823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.632263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:57.641868 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ab59e4e-b02a-433a-b551-5e9235593409 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.311649 Sep 03 20:59:57.659653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1500/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:57 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:57.665457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:57.666317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:57.675239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.676021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.676622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.677650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.678268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.678910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.715554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.716314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.716965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.718152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lazy-loading 'fault' on Instance uuid 9f418a14-c2a7-4495-85ca-22f600a66d65 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 20:59:57.772252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c77fca40dbc430db41e4a30639b28b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf7c2d797a74562993d8605bda80ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:57.782433 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8abac0b4-0922-4fd6-b3cf-8d38597e1335 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 200 len: 1304 microversion: 2.1 time: 0.121217 Sep 03 20:59:57.782895 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1501/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:57 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:57.787489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:57.788097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:57.791313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:57.795913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.796420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.796863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.797598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:57.798058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:57.798489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:57.823204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:57.944588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:57.958239 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b5c22edc-e859-4ef5-994b-7bcc1ce4a265 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1275 microversion: 2.1 time: 0.173627 Sep 03 20:59:57.959280 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1502/2911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:57 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:57.981941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:57.982867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:58.002778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.006518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.007778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.007901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:58.011043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.011760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.012416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.020365 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11374b68-fea6-49f6-a5eb-7f27f1c79da9 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1274 microversion: 2.1 time: 0.761720 Sep 03 20:59:58.040653 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1410/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:57 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1274 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:58.666923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:58.668390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:58.678409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.679116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.679733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.680620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.681279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.681978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.687990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:58.735528 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a565ca3-5493-43b9-a8da-5686c15c3fb9 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1525 microversion: 2.1 time: 0.774261 Sep 03 20:59:58.741859 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1503/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:57 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1525 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:58.808195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:58.810004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] [instance: 9f418a14-c2a7-4495-85ca-22f600a66d65] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:58.824597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.825241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.825703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.826532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.828045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.828045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:58.874670 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] HTTP exception thrown: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Request method failure captured: Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 HTTP/1.1 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7-4k7WpxIZx2-1i93gffwea5TVn3Nt5Vu_mMTd6qILY8qdzni3hkLvMEqSFveVu1rVGCRcQKf_6bOExvfygodbEteB3GVwnJD0m8sk9RE0LpqXwv4UQZmmEUhPFbK1qcK4dY1Elpb2v3x6RdVjjbOojk9Du2Q04XfClu3tdrykBZRY Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9bf7c2d797a74562993d8605bda80ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 9bf7c2d797a74562993d8605bda80ae4 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminTestJSON-760224018 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 0c77fca40dbc430db41e4a30639b28b5 Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminTestJSON-760224018-project Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9f418a14-c2a7-4495-85ca-22f600a66d65'} Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 20:59:58.876475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] Returning 404 to user: Instance 9f418a14-c2a7-4495-85ca-22f600a66d65 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-47a6c3cc-2b62-4d41-a141-1d295de896d0 tempest-ServersAdminTestJSON-760224018 tempest-ServersAdminTestJSON-760224018-project] 10.222.0.16 "GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65" status: 404 len: 111 microversion: 2.1 time: 0.075960 Sep 03 20:59:58.881613 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1504/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:58 2022] GET /compute/v2.1/servers/9f418a14-c2a7-4495-85ca-22f600a66d65 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 20:59:58.937441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a", "name": "network-vif-deleted", "tag": "79ca652d-8a93-487e-9b4e-7df80b9fd1f2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 20:59:58.959953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:58.972974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:58.973854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.023523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] Creating event network-vif-deleted:79ca652d-8a93-487e-9b4e-7df80b9fd1f2 for instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a on nch2-master-1 Sep 03 20:59:59.032937 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-179d12e3-c27d-4877-88f1-afb259daddf9 req-febc1c39-f978-4c1c-9bce-0e815c234398 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100764 Sep 03 20:59:59.042615 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1505/2915] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 20:59:59.048987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:59.050414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:59.058202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.058712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.059163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.061698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.062698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.063153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.491893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:59.502826 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5407cebb-bce8-44ed-902c-bb472f167727 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.458713 Sep 03 20:59:59.512570 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1506/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:59 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:59.527468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:59.543079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:59.549847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:59.552327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-914dc32d-afd3-45c3-b706-1c7d1867e68e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.878724 Sep 03 20:59:59.554241 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1411/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:58 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 20:59:59.573606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.576648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.579672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.584709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.594959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.597008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.768882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 20:59:59.769946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 20:59:59.785039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.786179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.787081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.788425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 20:59:59.789543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 20:59:59.790319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 20:59:59.809816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:59.821776 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e81c17d3-284c-433b-9e7b-8d61b2104f2a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1280 microversion: 2.1 time: 0.305085 Sep 03 20:59:59.836941 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1507/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:59 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 20:59:59.969699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 20:59:59.987134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2056699-3bb4-40c1-af1c-e583fa98ced1 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1307 microversion: 2.1 time: 0.223128 Sep 03 20:59:59.988958 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1412/2919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 20:59:59 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:00.540496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:00.541150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:00.554831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.556093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.556979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:00.557939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.558588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.558842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:00.581425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:00.582137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:00.589741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.599725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.604961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:00.606244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.606905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.607397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:00.733327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:00.742905 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b1a6883d-ea8f-4b0f-8b74-d54f8aa6be72 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.206573 Sep 03 21:00:00.744428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1508/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:00 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:00.856536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:00.859913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:00.877475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.878188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.879049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:00.880852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:00.881623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:00.882671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.008137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:01.021270 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-278b5f55-6c46-40c4-931b-c13f94d666ce tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.444551 Sep 03 21:00:01.023352 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1413/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:00 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:01.056512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:01.059063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:01.072514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.073197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.091065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.095688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.096555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.097261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.151820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.152436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.153103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.154095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lazy-loading 'fault' on Instance uuid 79d809ca-7e78-4ee9-8541-dfe079c91896 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:01.176338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:01.185629 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ba758ef-9e00-411c-acb6-08836792c25e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.335806 Sep 03 21:00:01.187506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1509/2922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:00 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:01.192646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d809ca-7e78-4ee9-8541-dfe079c91896", "name": "network-vif-deleted", "tag": "6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340"}, {"name": "network-changed", "server_uuid": "5d132783-c4a8-4417-9154-352e292056a0", "tag": "fe35b4c2-173b-4a1b-8d04-3581619f06e8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:01.208325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.210128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.210676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.216606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b25b05106404b64adc5476924f2e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cdab592b0646aaa02deff957842bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:01.227898 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1394f384-a01e-4a13-be1a-a105b2394d7b tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 200 len: 1312 microversion: 2.1 time: 0.203132 Sep 03 21:00:01.228756 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1414/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:01 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:01.241472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Creating event network-vif-deleted:6c1b558c-d5c2-48c5-ae92-7bbf9e7a2340 for instance 79d809ca-7e78-4ee9-8541-dfe079c91896 on nch2-master-1 Sep 03 21:00:01.241472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] Creating event network-changed:fe35b4c2-173b-4a1b-8d04-3581619f06e8 for instance 5d132783-c4a8-4417-9154-352e292056a0 on nch1-master-1 Sep 03 21:00:01.241472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3f1bc27b-c0fe-4d2d-89c1-ebe548c43c5e req-f4d574c1-a2ba-401b-a67b-d0278c693ee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051178 Sep 03 21:00:01.241472 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1510/2924] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:01.655686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:01.667022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.667661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.668162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.682423 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] Creating event network-changed:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:01.688382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-311700a2-5d63-4123-b437-54d81e3b2525 req-0146eed3-047b-42bd-8f9a-cd938a193fef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040015 Sep 03 21:00:01.689725 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1511/2925] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:01.770914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:01.771679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:01.775035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:01.781116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.781678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.782182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.782960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:01.783479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:01.784113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:01.936290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:01.944305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49a8a409-893d-4c67-8983-2d7474e0ce65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.178830 Sep 03 21:00:01.945145 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1415/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:01 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:02.048249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:02.049229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:02.055725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.056436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.056881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.057809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.058274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.058817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.204269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:02.209741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:02.210412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:02.213227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a73b5b28-0bba-40b2-bc87-4a8ca058704f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.169255 Sep 03 21:00:02.213974 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1512/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:02 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:02.216679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.217356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.217798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.218494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.218945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.219371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.252760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:02.253799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] [instance: 79d809ca-7e78-4ee9-8541-dfe079c91896] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:02.260406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.261149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.261904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.262751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.263547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.264609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.279065 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] HTTP exception thrown: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Request method failure captured: Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 HTTP/1.1 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8A3Lx4pFIellxZXBIj3RGsYlJlbDNMN1ZvNZIyzV-Dp_zBIzZrBGn-V_5RM3MzVOzsh5eeNQU7LtAlpq7z5U7XQanROB3axE3xSWlNYoYCugEJDSmO67CFi6zLj_H5Jo4-wcAjB-87M25bDkQoWk-2L_5wE_U69w8ENo66v-ItCh3A Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5cdab592b0646aaa02deff957842bc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f5cdab592b0646aaa02deff957842bc0 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1679841697 Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 6b25b05106404b64adc5476924f2e69d Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1679841697-project Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '79d809ca-7e78-4ee9-8541-dfe079c91896'} Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:02.280760 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] Returning 404 to user: Instance 79d809ca-7e78-4ee9-8541-dfe079c91896 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:02.285408 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49d1d71c-7f98-4a85-a80e-bcc038679aa7 tempest-ServerMetadataNegativeTestJSON-1679841697 tempest-ServerMetadataNegativeTestJSON-1679841697-project] 10.222.0.16 "GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896" status: 404 len: 111 microversion: 2.1 time: 0.033934 Sep 03 21:00:02.286684 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1513/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:02 2022] GET /compute/v2.1/servers/79d809ca-7e78-4ee9-8541-dfe079c91896 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:00:02.364592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:02.374680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62ae60ba-b108-4bc9-9444-f761628e604c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.168974 Sep 03 21:00:02.376495 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1416/2929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:02 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:02.975366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:02.976049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:02.982607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.983088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.983712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:02.984491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:02.985012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:02.985492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.139930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-236225815", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:03.169279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:03.181835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec56d4d5-a470-4955-bb54-e0d2b1f1a2a4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.210505 Sep 03 21:00:03.182420 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1417/2930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:02 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:03.209858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] validate_networks() for None {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:00:03.236738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:03.237469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:03.243461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.243944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.244383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.245107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.245562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.245990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.375530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:03.384180 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6886aec4-a816-47c7-b6d1-9f42e8d4402f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.151688 Sep 03 21:00:03.384753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1418/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:03 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:03.397800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:03.398418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:03.404462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.404973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.405420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.406153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.406711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.407147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.423422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:03.544247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:03.552864 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a29a63a0-b523-4336-b4c4-01f5c9521283 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.158718 Sep 03 21:00:03.553583 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1419/2932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:03 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:03.906164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:03.906618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:03.907093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:03.907524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:03.907935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:03.918259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=29 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:03.920627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.921478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.921927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.922690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:03.923144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:03.923567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:03.935412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:03.946759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Getting quotas for project f9175f0f4d204936aed9f62d91c141f0. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:03.952918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Getting quotas for user a1e643d2a39441cda1035502d08d909a and project f9175f0f4d204936aed9f62d91c141f0. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:03.966408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:03.969625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:04.019055 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25ed1beb-697a-49e7-b11e-5790140aa565 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054384 Sep 03 21:00:04.020016 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1514/2933] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:00:04.031968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3c05d58-04a9-4010-9839-fda95f49b386 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:04.033296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3c05d58-04a9-4010-9839-fda95f49b386 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:04.063550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:04.098782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d3c05d58-04a9-4010-9839-fda95f49b386 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:04.108792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3c05d58-04a9-4010-9839-fda95f49b386 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1221 microversion: 2.1 time: 0.081533 Sep 03 21:00:04.117842 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1420/2934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:04 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:04.206887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:04.207496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:04.214869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.215398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.216092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.216812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.217853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.218287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.407510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:04.408543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:04.416634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.417413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.418123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.419098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.419933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.421420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.485575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:04.503259 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d5670ce-d471-4722-be3f-e617c1a546b4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.301582 Sep 03 21:00:04.521836 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1515/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:04 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:04.576591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:04.577253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:04.587058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.587551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.588024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.588746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.594954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.597298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.842019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:04.854434 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04fabd52-e803-4b0b-a7ae-edfee4723de4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.449166 Sep 03 21:00:04.855275 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1421/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:04 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:04.865297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac36e5f-f961-4bfe-b477-58985805f5a7", "name": "network-vif-plugged", "status": "completed", "tag": "f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:04.892119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:04.892887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:04.894180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:04.906528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:04.915266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8df78e55-70c6-4012-9516-f1badabc2337 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.343220 Sep 03 21:00:04.916565 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1516/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:04 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:04.919719 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] Creating event network-vif-plugged:f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2 for instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 on nch2-master-1 Sep 03 21:00:04.931918 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a225ad44-e241-4af3-b2a9-9b2d3cc46400 req-5e1b9053-936b-4c69-b14a-aded104db83a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074550 Sep 03 21:00:04.932524 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1422/2938] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:05.158772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:05.159334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:05.172283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.172790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.173262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.173977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.174434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.174880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.261243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:05.273921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-035b284d-0cc9-43f4-a228-8b92617c097b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1273 microversion: 2.1 time: 0.146268 Sep 03 21:00:05.277394 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1517/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:05 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:05.535316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:05.536760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:05.549106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.550234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.551094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.552022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.552701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.553371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.796738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:05.804930 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2144b332-a646-4506-8539-856d97b36288 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.273786 Sep 03 21:00:05.805663 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1423/2940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:05 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:05.883262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:05.886038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:05.896836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.897577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.899121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.900129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.900830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.901490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.944645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:05.945812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:05.953685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.954186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.960343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:05.961551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:05.962070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:05.962805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.211655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:06.234445 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5fd11db0-4292-4320-89fc-9126a239ebc7 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1317 microversion: 2.1 time: 0.356464 Sep 03 21:00:06.252927 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1518/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:05 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:06.297216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:06.301214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:06.301701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:06.309527 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7058a538-ff8f-469e-a6c1-4c4606005019 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.368247 Sep 03 21:00:06.310533 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1424/2942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:05 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:06.317086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:06.317668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:06.318119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.318847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:06.321523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:06.322163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.512228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:06.530251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b177e93-82af-493e-b397-abf17dc28963 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1279 microversion: 2.1 time: 0.232615 Sep 03 21:00:06.532081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1519/2943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:06 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:06.832323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:06.834653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:06.851506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:06.853822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:06.854800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.857017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:06.858501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:06.859210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.954487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "name": "network-vif-plugged", "status": "completed", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:06.966581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:06.967721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:06.968188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:06.984125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] Creating event network-vif-plugged:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:06.989127 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2df288eb-247d-4aa6-988c-b5bff687f1f2 req-4ccc40fb-7a20-4262-b7c9-2debbd83be0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043730 Sep 03 21:00:06.990723 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1520/2944] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:07.090693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:07.099875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b25198b2-9792-4232-94e9-5b2256b03e40 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.275190 Sep 03 21:00:07.113812 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1425/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:06 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:07.284005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:07.287498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:07.301601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.302166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.302584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.303645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.305190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.305796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.333614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:07.334253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:07.345575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.349652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.350202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.351132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.351612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.353986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.598431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:07.606617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1a8f55b1-f06e-46d0-96b7-bc2187a59914 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1467 microversion: 2.1 time: 0.342873 Sep 03 21:00:07.608917 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1521/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:07 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1467 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:07.613955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:07.614837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:07.621409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.622164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.622895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.623863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.624533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.625204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.629041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:07.641916 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aece5f66-7f26-4e4c-864b-eb824b485167 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1322 microversion: 2.1 time: 0.312222 Sep 03 21:00:07.642953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1426/2947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:07 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:07.648086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:07.648760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:07.655676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.656636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.657325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.658256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:07.658934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:07.659595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:07.925494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:07.941938 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25bde2c2-3525-47dc-801e-b18c106c7eda tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.331650 Sep 03 21:00:07.957450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1522/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:07 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:07.987515 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0315c7a0-854c-4d3f-9f76-786e4684cf8f tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1618 microversion: 2.1 time: 0.343142 Sep 03 21:00:07.988993 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1427/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:07 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1618 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:08.123875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:08.124626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:08.135392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.137344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.137984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.139503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.140317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.141458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.175825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-250896350", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b4d9ba95-551c-4316-94bb-bb83ba4bd615"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:08.256228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:00:08.355410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:08.367943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:08.386941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-efe8ec6c-59fc-4735-ad33-1819b0a0d6cc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.266058 Sep 03 21:00:08.393363 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1523/2950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:08 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:08.502477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2db057-71f8-4c37-bfcf-eefae40a8764", "tag": "ca894091-379f-4026-95d3-262f3fa203a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:08.525824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.526547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.527217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.545020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] Creating event network-changed:ca894091-379f-4026-95d3-262f3fa203a4 for instance bd2db057-71f8-4c37-bfcf-eefae40a8764 on nch1-master-1 Sep 03 21:00:08.552169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-523d22ce-72da-489d-87c2-3b8a768b2d9c req-7f95fb50-9395-4aa6-86c2-9ea6ba47c43d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053705 Sep 03 21:00:08.553762 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1524/2951] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:08.606209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:08.607070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:08.608103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:08.608723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:08.609363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:08.620270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.621039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.621493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.622241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.622704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.623184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.641500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:08.647203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Getting quotas for user e6970a72952e4d4a8f26e0f8ee23f364 and project 5a2f3c186f88497181cf6a1d806631b1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:08.663839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:08.666303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:08.667276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:08.668091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:08.674635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.675380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.676080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.677046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:08.677709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:08.678379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:08.731793 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e19455f-2e50-479d-a7a6-7f3bfa098366 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559891 Sep 03 21:00:08.732452 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1428/2952] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:00:08.744023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9be840a9-ebdb-44c4-8e66-0a1ba639eeb6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:08.744644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9be840a9-ebdb-44c4-8e66-0a1ba639eeb6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:08.810060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9be840a9-ebdb-44c4-8e66-0a1ba639eeb6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:08.819336 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9be840a9-ebdb-44c4-8e66-0a1ba639eeb6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1216 microversion: 2.1 time: 0.078749 Sep 03 21:00:08.820116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1429/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:08 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:08.954203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:08.975068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:08.977013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:08.990802 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d2101de-46b4-470c-a814-43728ca0040b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1518 microversion: 2.1 time: 0.328161 Sep 03 21:00:09.002257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1525/2954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:08 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:09.008194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.009332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.010187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.012688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.014786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.015457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.022509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d132783-c4a8-4417-9154-352e292056a0", "name": "network-vif-plugged", "status": "completed", "tag": "fe35b4c2-173b-4a1b-8d04-3581619f06e8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:09.052759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.053448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.053967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.080694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] Creating event network-vif-plugged:fe35b4c2-173b-4a1b-8d04-3581619f06e8 for instance 5d132783-c4a8-4417-9154-352e292056a0 on nch1-master-1 Sep 03 21:00:09.093762 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d2a5405a-554b-46ae-b361-204b802b390a req-5ad17d23-570a-4608-96a7-041d17fb1636 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076136 Sep 03 21:00:09.094570 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1526/2955] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:09.105252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:09.108826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:09.116267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.117310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.118153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.119134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.119827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.120616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.165456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lazy-loading 'flavor' on Instance uuid 10116344-8967-46c4-ad23-ab769cb073dc {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:09.314772 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cba33481-1256-4340-8aa2-06db1905d9d1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action" status: 200 len: 32 microversion: 2.1 time: 0.213990 Sep 03 21:00:09.316057 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1527/2956] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:09 2022] POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:00:09.319236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:09.331717 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ed15ee1-71cb-4ee7-8ce8-683d49a94465 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.369553 Sep 03 21:00:09.349878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:09.350398 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1430/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:08 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:09.350651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:09.362911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.364079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.365494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.366611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.367368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.368100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.416134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:09.416757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:09.428675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.429250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.429726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.430519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.431028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.431453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.586207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:09.598323 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54c5666d-f9e8-46b5-8669-caeb55415517 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.186057 Sep 03 21:00:09.599617 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1431/2958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:09 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:09.665032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:09.675977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01ce358a-052b-4783-9424-9c411d893902 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.341604 Sep 03 21:00:09.676555 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1528/2959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:09 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:09.844504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:09.846094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:09.854832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.855980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.856617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.859180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:09.862086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:09.862801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:09.938039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:09.947207 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf1feece-6bf5-4311-ae32-212db1aa5b26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1212 microversion: 2.1 time: 0.107561 Sep 03 21:00:09.947869 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1432/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:09 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:10.103689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-611096447", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:10.160967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:10.161398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:10.161878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:10.162287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:10.162698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:10.172296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.172924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.173798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.174671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.175091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.175537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.194667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Getting quotas for project 7eef34f8ef5e4e73802caff2f4e5a023. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:10.200166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Getting quotas for user 3db58915ddb1452490f90c8f2a583220 and project 7eef34f8ef5e4e73802caff2f4e5a023. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:10.213092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:10.215414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:10.260204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11349b73-7d2e-4333-947e-725c8f47f5c5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.274307 Sep 03 21:00:10.260961 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1529/2961] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 03 21:00:10.273162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.273875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.336775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.345841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.347802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.349075 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f10f885f-2fba-4910-98ab-9e52d20622b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825" status: 200 len: 1277 microversion: 2.47 time: 0.079845 Sep 03 21:00:10.349714 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1433/2962] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:10.366943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.367882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.374946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.375593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.376042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.376753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.377711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.377711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.416354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-369920156", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:10.475800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:10.476231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:10.476712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:10.477160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:10.477955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:10.487848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.488341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.488777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.489558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.490076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.490443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.508122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Getting quotas for project 7eef34f8ef5e4e73802caff2f4e5a023. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:10.514423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Getting quotas for user 3db58915ddb1452490f90c8f2a583220 and project 7eef34f8ef5e4e73802caff2f4e5a023. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:10.528614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:10.531385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:10.538474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.550741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf11152e-acc3-4b06-bc1a-5378e94a9560 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.188683 Sep 03 21:00:10.552205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1530/2963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:10.594873 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9bdd0577-96c8-482c-a2ea-e7cff8bc61f2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.182236 Sep 03 21:00:10.595945 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1434/2964] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 184 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:00:10.620040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6021d2d8-5251-4c1b-b21e-85506db32e17 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:10.622611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6021d2d8-5251-4c1b-b21e-85506db32e17 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.623160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.623778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.639938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.640622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.641362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.642386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.643485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.644267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.675496 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6021d2d8-5251-4c1b-b21e-85506db32e17 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "PUT /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 991 microversion: 2.47 time: 0.071981 Sep 03 21:00:10.676427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1531/2965] 10.222.0.16 () {62 vars in 1297 bytes} [Sat Sep 3 21:00:10 2022] PUT /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:00:10.698260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.698879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.772112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.781183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.782827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.783989 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79e9a501-47ad-40b7-bd98-7741e8ddbe0c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1277 microversion: 2.47 time: 0.090014 Sep 03 21:00:10.796924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1532/2966] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:10.796924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.797941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.803856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.804455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.804775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.805504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.805955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.806754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.858012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.882980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2368f5e3-ad6e-4984-828d-616a11187f99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.265104 Sep 03 21:00:10.884138 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1435/2967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:10.963736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:10.971074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:10.971719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:10.977054 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b01472d5-6f35-4bed-8792-3d51019b9ce1 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.191102 Sep 03 21:00:10.978144 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1533/2968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:10.980612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.981212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.981656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:10.983324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:10.983978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:10.984471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.058393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:11.066796 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-183a5172-c90e-4750-95e6-620a440b5fca tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1212 microversion: 2.1 time: 0.099746 Sep 03 21:00:11.067646 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1436/2969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:10 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:11.573556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:11.574245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:11.578571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:11.583195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.583647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.584090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.584789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.585434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.586410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.740367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:11.750105 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ed16a2b-312d-442c-b57d-ac7a9a3e0a75 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.180381 Sep 03 21:00:11.750746 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1534/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:11 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:11.813455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:11.814074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:11.821794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.822300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.822743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.823449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.823911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.824565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.907771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:11.908528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:11.914840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.915334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.915831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.916540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:11.917021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:11.917489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:11.933417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:11.941707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:11.943165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:11.944298 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5510354-37b6-485d-ac7d-9a81970950bc tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1329 microversion: 2.47 time: 0.134833 Sep 03 21:00:11.944860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1437/2971] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:11 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:12.003616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:12.004235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:12.010279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.010769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.011213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.011915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.012375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.012807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.050978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:12.059577 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f89487e8-e50c-4bd6-a7d4-0939dea1119a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.156406 Sep 03 21:00:12.060407 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1535/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:11 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:12.096058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:12.096584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:12.103054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.103550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.104014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.104737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.105180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.108983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.162508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:12.170316 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cfb9fc8-1c72-4f88-b7ac-a7cfd066469f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.170608 Sep 03 21:00:12.170882 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1438/2973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:11 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:12.180460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:12.188593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1bd5222-2d8d-4b54-abc6-6e71c5701958 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1212 microversion: 2.1 time: 0.097284 Sep 03 21:00:12.189183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1536/2974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:12 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:12.773584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:12.774292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:12.780299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.780777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.781246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.781932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.782384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.782806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.910662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:12.918603 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5ab92dd-51ff-4149-b443-989cd8abc8d2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.149862 Sep 03 21:00:12.919159 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1439/2975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:12 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:12.969897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:12.970805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:12.977724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.978206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.978645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:12.979334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:12.979789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:12.980213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.082836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:13.083880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:13.090907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.091984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.092634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.093612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.094266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.094925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.103278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.114297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.116177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.120975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-593f8de2-e5ab-47a7-a31e-52f66af378f7 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1337 microversion: 2.47 time: 0.151441 Sep 03 21:00:13.120975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1537/2976] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:12 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1337 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:13.193289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:13.193936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:13.199962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.200452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.200981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.201655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.202113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.202546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.252506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.260328 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-baf3a1cf-38d0-4a7b-aed5-e57216f4442a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1317 microversion: 2.1 time: 0.181724 Sep 03 21:00:13.260925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1440/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:13 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:13.265373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:13.265981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:13.271652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.272610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.272610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.273282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.273737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.274164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.278308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:13.341347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.341700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:13.350169 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9630834d-af6a-4e65-b883-b5544348469c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1212 microversion: 2.1 time: 0.088284 Sep 03 21:00:13.350727 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-013c5769-9709-421d-b336-aba6b49459a8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.161398 Sep 03 21:00:13.350874 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1441/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:13 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:13.351323 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1538/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:13 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:13.942950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:13.943582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:13.950492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.951727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.952336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:13.953248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:13.953703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:13.954128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.143900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.145389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.158108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.158637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.159665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.160400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.160873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.161831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.338270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.347426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f208f2b9-2b1e-4667-8110-1dca30a579f8 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.410064 Sep 03 21:00:14.348101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1442/2980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:13 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:14.361157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.361157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.375721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.376215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.376653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.377419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.377876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.378300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.506756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.520612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.522166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.523641 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28f18e12-0ce1-4f49-9c3f-5cef658e4831 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1335 microversion: 2.47 time: 0.383376 Sep 03 21:00:14.524041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1539/2981] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1335 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:14.528586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.529253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.544340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.546095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.547282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.549558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.550585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.551248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.551751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.560693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6218e45-56cd-416f-9801-27e8edda1191 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1507 microversion: 2.1 time: 0.211355 Sep 03 21:00:14.561552 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1443/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:14.567282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.568302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.582785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.584229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.585090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.586790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.587579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.588683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.656252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.665799 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5578feb-b45a-4073-b298-21f9b3798d2e tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1268 microversion: 2.1 time: 0.140585 Sep 03 21:00:14.676922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1540/2983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1268 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:14.681271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.681970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.688614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.689143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.689904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.690620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.691084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.691608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.727633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.736067 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5f97588-c4b4-484a-b913-978f226b9d66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.173415 Sep 03 21:00:14.736669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1444/2984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:14.742595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.743136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.749817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.750340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.750791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.751510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.751992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.752457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.782150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:14.870130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:14.880675 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e3311a7-3e1d-4345-8981-8c6d1ee4aa25 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 204 len: 0 microversion: 2.1 time: 0.142447 Sep 03 21:00:14.881801 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1445/2985] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:14 2022] DELETE /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:14.893042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:14.893933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.901925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.902572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.903116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.904137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.904712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.905275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.923255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:14.933614 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1732e4b7-1716-49f0-9361-db66d5b2f6b8 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1507 microversion: 2.1 time: 0.265242 Sep 03 21:00:14.946133 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1541/2986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:14.958686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:14.961188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:14.967221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.967705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.968146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.968840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:14.969336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:14.969764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:14.989424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:15.038237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d4bada6-6ce3-4f48-9cc3-a8b439605013 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "PUT /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1079 microversion: 2.1 time: 0.083423 Sep 03 21:00:15.050357 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1542/2987] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:00:14 2022] PUT /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:15.050678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.055005 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c7e2279-5e21-44c9-902f-df8bb5654a1d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1665 microversion: 2.1 time: 0.168294 Sep 03 21:00:15.055661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1446/2988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:14 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:15.057556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.058182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.064600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.065118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.065559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.066257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.066725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.067136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.199369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.207095 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d043f25d-c6c7-4480-80b1-ef23f54433b5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1505 microversion: 2.1 time: 0.153486 Sep 03 21:00:15.207658 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1543/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:15.228818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.229502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.236224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.236746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.237235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.237978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.238384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.238840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.371097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.371908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.374105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.379141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.379743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.380213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.381054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.381580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.382074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.382744 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-302e6a16-e225-42b0-9cdd-bfacc18e2141 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1505 microversion: 2.1 time: 0.157756 Sep 03 21:00:15.383323 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1447/2990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:15.405324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:15.408559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.414956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.415494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.415968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.416676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.417166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.418043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.497385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:15.497733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:15.498823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:15.499238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:15.499652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:15.532096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.540586 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40e288af-c87e-457e-8706-e37af5c1471b tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.173398 Sep 03 21:00:15.541196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1544/2991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:15.550364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.551055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.557704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.558290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.558802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.559614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.560135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.560637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.568177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.574764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.575259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.575708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.577038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.577193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.577774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.617375 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-09a094fd-639c-4bc3-9548-2ee9039c3021 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "POST /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0/action" status: 202 len: 1111 microversion: 2.1 time: 0.216274 Sep 03 21:00:15.618351 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1448/2992] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:15 2022] POST /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0/action => generated 1111 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 03 21:00:15.638027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.643559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.644196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.647956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.649441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.650356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.650857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.650965 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d925f57-a666-4895-b607-42313672b15d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1335 microversion: 2.47 time: 0.104302 Sep 03 21:00:15.651364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.651749 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1545/2993] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:15.657831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.658363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.658804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.689479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.692394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.698854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.699350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.699790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.700499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.701013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.702015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.770427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.779258 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2a8423c-12fc-46e6-a9cb-7c65d704432f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1276 microversion: 2.1 time: 0.094176 Sep 03 21:00:15.780110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1546/2994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:15.784543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:15.785465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:15.791587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.792154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.792663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.793458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:15.794044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:15.794576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:15.809132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.817979 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb9eada1-513c-4099-a33f-ac7285d068a1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.185594 Sep 03 21:00:15.818835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1449/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:15.932372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:15.941380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f131aa49-ae92-4f25-8076-7b72c64be7cd tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.160331 Sep 03 21:00:15.942260 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1547/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:15 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:16.078911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:16.079472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.086788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.087289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.087739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.088452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.088942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.089385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.345807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.354032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a2b01fb-98f0-458d-9b71-14e43adf187f tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1665 microversion: 2.1 time: 0.279071 Sep 03 21:00:16.354728 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1450/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:16 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1665 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:16.563625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:16.564365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.571485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.571977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.572424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.573154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.573609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.574230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.679909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:16.680546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.691197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.692003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.693105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.694536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.695008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.695456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.741495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.749626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0035d48-d672-4a9a-b859-784e14945424 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.189902 Sep 03 21:00:16.750372 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1548/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:16 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:16.802998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:16.803643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.804539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.810762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.811390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.811833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.812743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.813235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.813672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.814285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.815776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.817088 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15ac5248-5057-4c60-b2d3-32e63141c125 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1356 microversion: 2.47 time: 0.143660 Sep 03 21:00:16.817656 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1451/2999] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:16 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1356 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:16.842614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:16.843297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.850772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.851278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.851759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.852483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.853033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.853471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.884175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:16.894447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b050d13-1098-4354-9007-51cb284f9670 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1274 microversion: 2.1 time: 0.095769 Sep 03 21:00:16.895181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1549/3000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:16 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:16.900885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:16.904024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:16.911923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.912542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.913115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:16.914332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:16.914518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:16.915038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.008175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:17.008615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:17.009139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:17.009568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:17.009995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:17.063660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.076049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.082210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47cdd790-ccaa-4579-bac3-02c8ff9be46a tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.240084 Sep 03 21:00:17.101924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1452/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:16 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:17.106198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.111546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.112088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.112854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.113270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:17.113446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.113809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.115560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.142772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.143285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.145939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.146716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.147199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.147646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.163587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf518d71-b70c-4752-ab9d-3221635ec57e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "POST /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099/action" status: 202 len: 1078 microversion: 2.47 time: 0.266948 Sep 03 21:00:17.175801 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1550/3002] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 21:00:16 2022] POST /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099/action => generated 1078 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 03 21:00:17.192686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:17.193740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.206260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.206857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.207321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.209294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.209770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.210211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.373038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.388196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.390370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.395426 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12c50202-440c-42d1-82dc-098214472baf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.206955 Sep 03 21:00:17.396350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1551/3003] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:17 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:17.405800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:17.406557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.417308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.420407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.424570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.430354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.430995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.433383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.450586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.463979 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8eb6599-54cb-46dd-a27c-f25e010a16f4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.359715 Sep 03 21:00:17.465131 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1453/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:17 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:17.783930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:17.784965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.791510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.805844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.808528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.811387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.813390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.814236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.820922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:17.832626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:17.846332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b55f290a-8e46-4a0f-a0b6-758e5e8fb996 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1665 microversion: 2.1 time: 0.448408 Sep 03 21:00:17.846988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1552/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:17 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1665 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:17.918120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:17.918658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:17.928175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.929156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.929933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:17.930990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:17.931698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:17.932404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.111387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.128099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e9a943d-3401-40f7-b849-fc35f48c38a5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.349612 Sep 03 21:00:18.137079 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1454/3006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:17 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:18.153037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:18.153978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:18.163403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.164009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.164552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.165414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.165982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.166513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.231756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.252671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ee74515-eb07-469c-9b15-9bbdf7c268bd tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.338280 Sep 03 21:00:18.253710 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1553/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:17 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:18.308370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2db057-71f8-4c37-bfcf-eefae40a8764", "name": "network-vif-plugged", "status": "completed", "tag": "ca894091-379f-4026-95d3-262f3fa203a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:18.330540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.331815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.332560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.351666 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] Creating event network-vif-plugged:ca894091-379f-4026-95d3-262f3fa203a4 for instance bd2db057-71f8-4c37-bfcf-eefae40a8764 on nch1-master-1 Sep 03 21:00:18.358241 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a1064d1b-652e-4467-9034-8d06c74e50fc req-fcb40e7a-3a69-4a39-bd61-31b6fa491c76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057994 Sep 03 21:00:18.359373 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1554/3008] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:18.400768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cc638f-dd8b-47eb-96ab-71a9453e13b3", "tag": "ac4d7b1d-56a8-4c20-b0cf-2af8f2208594"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:18.401480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.413516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6221f7c-f960-4d26-ab3c-307f4d250fec tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.274922 Sep 03 21:00:18.417470 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1455/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:18 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:18.418962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.419408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.420455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.429778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:18.432492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:18.449513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.450131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.450664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.453636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.455105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.456033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.471842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] Creating event network-changed:ac4d7b1d-56a8-4c20-b0cf-2af8f2208594 for instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 on nch1-master-1 Sep 03 21:00:18.484493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d8094c0f-d76e-4f72-85c8-8e6b1d03313d req-e1fe59c1-8854-4fbd-bc5c-954c75e4babf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091413 Sep 03 21:00:18.486603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1555/3010] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:18.500849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:18.502507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:18.536015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.537162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.537837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.538749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.539366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.539960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.620065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.630679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.632297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.633900 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-deab90af-63db-46aa-893d-4b297324bc1b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.209868 Sep 03 21:00:18.634872 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1456/3011] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:18 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:18.726544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aed6c85-7b16-4509-a569-5197641ec082", "name": "network-vif-deleted", "tag": "19bffd6e-ec17-4c8e-bc49-ac030cf6cab9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:18.746991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.749139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.749978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.768605 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] Creating event network-vif-deleted:19bffd6e-ec17-4c8e-bc49-ac030cf6cab9 for instance 0aed6c85-7b16-4509-a569-5197641ec082 on nch1-master-1 Sep 03 21:00:18.773840 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5b8b6457-7ea3-4e6e-89a3-e76ed33ad411 req-13ed8dd1-dea7-49cb-af17-5365aa47889d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057381 Sep 03 21:00:18.774999 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1457/3012] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:18.824943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.833834 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b544085a-c255-4fce-bb7a-7e551f2bb467 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.342191 Sep 03 21:00:18.834507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1556/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:18 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:18.874057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:18.875004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:18.881470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.882075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.882774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.883820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:18.884671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:18.885381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:18.953367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:18.961127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd0b2ab5-375a-4118-aaf7-42de34df116b tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1310 microversion: 2.1 time: 0.092129 Sep 03 21:00:18.961706 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1458/3014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:18 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:19.165674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.166427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.175588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.183191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.183716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.184699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.185352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.187066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.275664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.276282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.283859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.284473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.285153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.285994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.286862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.287452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.327202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.331149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:19.336188 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1eb0544f-39f2-4bfc-9dd8-3bda12e97581 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.176325 Sep 03 21:00:19.340938 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1557/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:19.422937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.430777 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e6d9793-10d5-4789-9e72-5ff28bf54d8f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.158948 Sep 03 21:00:19.431676 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1459/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:19.443668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.444378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.451685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.452320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.452836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.453646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.454178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.454686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.592589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.600680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-886f353d-c3ea-4339-86f5-88b3070bbe00 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.161108 Sep 03 21:00:19.601396 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1558/3017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:19.666097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.666771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.673908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.674490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.675023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.675809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.676356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.676841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.743275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.752282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.753762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:19.754939 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e83c75b-b704-4df1-ac55-d1b7944b05ba tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.092907 Sep 03 21:00:19.755622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1460/3018] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:19.859259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.860559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.869364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.871234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.871696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.872501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.873531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.874078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.984243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:19.984790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:19.993007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.993510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.994095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:19.994815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:19.995280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:19.995712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.023366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.030227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.030724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.031174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.031626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lazy-loading 'fault' on Instance uuid 0aed6c85-7b16-4509-a569-5197641ec082 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:20.032005 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d8f0d35-b7fd-415c-9e80-adfd826e45ca tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.177423 Sep 03 21:00:20.032659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1559/3019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:20.097333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.105304 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-170a9efb-ce01-4a5e-9adb-fc2c96e080f6 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1315 microversion: 2.1 time: 0.125632 Sep 03 21:00:20.121140 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1461/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:19 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:20.359480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:20.360008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:20.361914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:20.367401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.367883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.368326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.369197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.369656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.370084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.453605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:20.454307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:20.461409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.461989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.462536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.463327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.463879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.464376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.496727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:20.522741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=18 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:20.605251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.613926 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59a368f2-7645-4955-9355-6cdc19e7eb70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.163934 Sep 03 21:00:20.614429 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1462/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:20 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:20.624431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:20.625156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:20.631685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.632188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.632633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.633377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.633839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.634277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.743207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.751445 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0cbc871-4d07-4b74-9b41-eacca537a978 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.396428 Sep 03 21:00:20.752014 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1560/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:20 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:20.773672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.779803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:20.780414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:20.782099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab19cc55-88d5-4b7a-be00-b664a5a76214 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.162260 Sep 03 21:00:20.782335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=13 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:20.782876 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1463/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:20 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:20.788724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.789260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.789705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.790457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:20.790901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:20.791339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:20.855574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.864164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.866238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:20.867895 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b67420d1-4190-44b5-8eaa-2d7f94f20d86 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.092174 Sep 03 21:00:20.868494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1561/3024] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:20 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:21.054573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.055187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.061702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.062186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.062625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.063312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.063764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.064188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.130387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.131346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.138668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.139179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.139622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.140338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.140798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.141255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.173313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.173796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.174236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.174685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lazy-loading 'fault' on Instance uuid 0aed6c85-7b16-4509-a569-5197641ec082 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:21.194745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:21.202690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c87658e-4662-4536-98aa-b8a128c679fe tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.151964 Sep 03 21:00:21.203257 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1464/3025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:21.215058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:21.223167 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a1a70685-6b19-4d72-8fb8-b02016917fe5 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1315 microversion: 2.1 time: 0.096955 Sep 03 21:00:21.223718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1562/3026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:21.637383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.637996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.645377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.645872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.646315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.647021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.647480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.647913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.774649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.775283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.782625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.783126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.783575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.784371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.784759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.785219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.790640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:21.800543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b349da9e-c8dc-4ad7-82b2-a223ae24a7b4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.165493 Sep 03 21:00:21.801004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1465/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:21.810803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.811587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.818281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.819004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.819561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.820534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.821119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.821656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.956585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:21.965342 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8dd42d4-751e-4e43-a912-fbc89dc1bb69 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.194593 Sep 03 21:00:21.965924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1563/3028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:21.971778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:21.972610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:21.979409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.979552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:21.980094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.980640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.981544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:21.982063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:21.982515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:21.987312 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77f080ff-7841-4e01-8a6e-5c2bc71e2f87 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.184268 Sep 03 21:00:21.987972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1466/3029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:22.046780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.054882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.056344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.057548 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c42f4e36-045c-4e0b-ba68-f05b9026f9e4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.090560 Sep 03 21:00:22.058110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1564/3030] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:21 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:22.226542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:22.227273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:22.233402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.233889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.234328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.235018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.235479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.235907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.246715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:22.247343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:22.254427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.254926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.255370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.256115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.256585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.257119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.289016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.289504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.289951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.290407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lazy-loading 'fault' on Instance uuid 0aed6c85-7b16-4509-a569-5197641ec082 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:22.330872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.338723 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-759e13da-c4a0-444f-ab86-f62a35d6aa3d tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1315 microversion: 2.1 time: 0.096597 Sep 03 21:00:22.339507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1565/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:22 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:22.367430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.375852 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe744865-2f03-4b14-8c59-69d652d4122b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.153385 Sep 03 21:00:22.376416 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1467/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:22 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:22.823660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:22.824275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:22.830888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.831400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.831876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.832606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.833097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.833537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.968760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:22.976773 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93eeb10e-fe16-452d-a938-d2501bd7adb9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.157030 Sep 03 21:00:22.977380 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1566/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:22 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:22.989089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:22.989706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:22.996514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.997037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.997483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:22.998775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:22.999234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:22.999667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.011461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:23.012079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:23.018013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.018533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.018974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.019663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.020119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.020546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.144351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.152184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01e9de42-7430-4d3f-b666-8d99904b2777 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1321 microversion: 2.1 time: 0.166941 Sep 03 21:00:23.152733 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1468/3034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:22 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:23.158111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:23.158699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.158812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:23.164685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.165287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.165738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.166427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d49b9fd-e9e9-4b55-91da-2d06e5aadd30 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.158823 Sep 03 21:00:23.166583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.166939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.167374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.183377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1567/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:23 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:23.232991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.241228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.242678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.243839 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ccc775e4-f8dc-4c42-b616-d15c37edb1a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.089855 Sep 03 21:00:23.244392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1469/3036] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:23 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:23.361456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:23.362024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:23.368715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.369239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.369677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.370387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.370866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.371295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.399034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:23.399720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:23.403732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.405200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.405646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.406119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lazy-loading 'fault' on Instance uuid 0aed6c85-7b16-4509-a569-5197641ec082 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:23.406343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.406857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.407306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.408184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:23.408660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:23.409203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:23.446929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322d75aacb244323b79f7f0e2ac464b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7084c9131a4f77b9688e10cd4c84de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.455872 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c2cef7b9-f43a-4563-b253-0d97af64e70c tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 200 len: 1315 microversion: 2.1 time: 0.098990 Sep 03 21:00:23.456463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1568/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:23 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 1315 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:23.537552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:23.545400 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a7d5a4f-d767-4721-a662-64dfc5cab59b tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.150217 Sep 03 21:00:23.545971 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1470/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:23 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:24.000723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.001294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.007826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.008319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.008764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.009509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.009973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.010404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.143237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.151298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a38c95b1-66c3-49bc-aaa7-16736e8cc0cb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.155053 Sep 03 21:00:24.151915 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1569/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:23 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:24.181790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.183699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.191266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.192188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.194557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.195388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.196172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.197565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.198251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.198891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.200049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.201092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.203584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.205017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.206628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.207259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.216743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:24.360305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.368640 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04343054-843e-4840-bf87-7f27e5610b24 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.181777 Sep 03 21:00:24.369392 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1570/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:24 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:24.374664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.375281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.381292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.381784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.382262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.382970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.383431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.383866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.425031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.434082 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b7f36e8-c940-4414-b96b-80ed31cda770 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1471 microversion: 2.1 time: 0.256510 Sep 03 21:00:24.434876 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1471/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:24 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:24.451543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.460276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.461959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.463258 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aaff2e6c-03e2-4abd-a6e2-7fd0eb64042c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.092919 Sep 03 21:00:24.471528 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1571/3042] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:24 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:24.484780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.485584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] [instance: 0aed6c85-7b16-4509-a569-5197641ec082] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.491834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.492510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.492989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.493803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.494336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.494841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.511851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] HTTP exception thrown: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Request method failure captured: Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 HTTP/1.1 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_hyz2PpTd-JE6l75qRi-1_6ifHfe0qGiM8SHhtORLG1cWiimhjnVJlXUwLQrfuhhLqqE1LI6McXDXccBoGioiF7Qjj9o-jtrkGKu8hzFb_-4TfHQfu7NVwErNltJwGxmkgjRskDUkvH_bCoIox5NgmJXFLhLs8aS7DmlovUs-5zvU Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fb7084c9131a4f77b9688e10cd4c84de Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestFqdnHostnames-659938081 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fb7084c9131a4f77b9688e10cd4c84de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fb7084c9131a4f77b9688e10cd4c84de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fb7084c9131a4f77b9688e10cd4c84de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fb7084c9131a4f77b9688e10cd4c84de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestFqdnHostnames-659938081 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fb7084c9131a4f77b9688e10cd4c84de Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-659938081 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestFqdnHostnames-659938081-project Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 322d75aacb244323b79f7f0e2ac464b8 Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestFqdnHostnames-659938081-project Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '0aed6c85-7b16-4509-a569-5197641ec082'} Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:24.514689 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Returning 404 to user: Instance 0aed6c85-7b16-4509-a569-5197641ec082 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80a7eba8-187d-4fd2-8aa6-08eff6bc58a0 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082" status: 404 len: 111 microversion: 2.1 time: 0.040281 Sep 03 21:00:24.519363 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1572/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:24 2022] GET /compute/v2.1/servers/0aed6c85-7b16-4509-a569-5197641ec082 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:24.525324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68cde3fb-babf-466f-a53e-71f600ab3573 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] Calling method '.version_select at 0x7fae6b7510d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.547508 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68cde3fb-babf-466f-a53e-71f600ab3573 tempest-ServersTestFqdnHostnames-659938081 tempest-ServersTestFqdnHostnames-659938081-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872135995" status: 202 len: 0 microversion: 2.1 time: 0.025939 Sep 03 21:00:24.547770 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1573/3044] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872135995 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:00:24.570194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:24.570930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.579704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.580338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.580788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.581542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:24.582029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:24.582502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:24.608066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:24.608670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] [instance: 9a6a4e2d-8435-4385-b224-53b9d822e562] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:24.614437 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] HTTP exception thrown: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Request method failure captured: Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/9a6a4e2d-8435-4385-b224-53b9d822e562/action HTTP/1.1 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 15 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8BS1kG1aDHZP3UrDf3Qm_X6bbrRlb4H5eaDpQ4C0w2G1TTMCsmA5CxXkSYu_bxpmX899KRGHx3rARf5R_XuXZ4hordoxCgp7dpo0xusevvPiFQ1Yp8mxQPBittz_h4S8km__SNAlxlqBqYXaF09Qy8mrGoWBxOnqNkENI4lWMFPpqU Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d05514342ed4dc383c025be27b5808b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 538736eb093546e1a81e2b4c3e537166 Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: {"migrate": {}} Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '9a6a4e2d-8435-4385-b224-53b9d822e562', 'body': {'migrate': {}}} Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.616294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Returning 404 to user: Instance 9a6a4e2d-8435-4385-b224-53b9d822e562 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c92bc7c2-e2d1-4dd2-8b8c-08752729e244 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9a6a4e2d-8435-4385-b224-53b9d822e562/action" status: 404 len: 111 microversion: 2.1 time: 0.164026 Sep 03 21:00:24.620719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1472/3045] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:24 2022] POST /compute/v2.1/servers/9a6a4e2d-8435-4385-b224-53b9d822e562/action => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:00:24.727190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-204557840", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:24.741515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:24.751550 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e63ced0-2e3c-4704-b737-15d81d1a3a4f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.187446 Sep 03 21:00:24.752245 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1574/3046] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:24 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:24.794135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:00:25.024613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:25.025079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:25.025566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:25.025984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:25.026405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:25.035518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.036010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.036458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.037232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.037699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.038138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.056011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Getting quotas for project f9175f0f4d204936aed9f62d91c141f0. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:25.061902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Getting quotas for user a1e643d2a39441cda1035502d08d909a and project f9175f0f4d204936aed9f62d91c141f0. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:25.074130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:25.076459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:25.124767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9d8a6a8-754d-4302-86ae-ca8d973a5877 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.401876 Sep 03 21:00:25.126434 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1473/3047] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:00:25.140437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd612c54-ee34-4ba2-acf2-0d620535c32a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:25.141720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd612c54-ee34-4ba2-acf2-0d620535c32a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:25.176481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:25.177547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:25.186106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.186873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.187024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.187885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.188344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.188795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.247544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd612c54-ee34-4ba2-acf2-0d620535c32a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.255973 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd612c54-ee34-4ba2-acf2-0d620535c32a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1221 microversion: 2.1 time: 0.122543 Sep 03 21:00:25.259191 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1575/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:25 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:25.393632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:25.394466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:25.416016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.417055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.417759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.422460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.432132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.432809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.435049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.437726 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d072adc-bb0a-477a-84c7-f8f317938a2c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.262829 Sep 03 21:00:25.447127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:25.455225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1474/3049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:25 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:25.492436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:25.492886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:25.501378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.501908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.502318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.503395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.503863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.504297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.599257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.610980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.613922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.615134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fea64974-e61b-4ad0-a72f-06a1828d4298 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.127852 Sep 03 21:00:25.621035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1475/3050] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:25 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:25.666920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:25.675164 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d4cd51b-81de-4c1c-b898-de94b68f7406 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.285398 Sep 03 21:00:25.677225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1576/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:25 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:25.776621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:25.777405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:25.784498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.785168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.785707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:25.791648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:25.792466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:25.793248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.282243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:26.282856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:26.287048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:26.292674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.293175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.293679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.294417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.295463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.295895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.338460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.349646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ba179a2-d42f-4546-bd85-d38f2ef97d99 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.578511 Sep 03 21:00:26.350229 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1476/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:25 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:26.361263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.369215 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80b0c47b-88a6-41ac-b008-c07bc7cd482d tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1273 microversion: 2.1 time: 0.092160 Sep 03 21:00:26.369779 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1577/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:26 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:26.460388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:26.461029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:26.467913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.468406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.468848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.469581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.470040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.470721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.643016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:26.643893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:26.650401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.650894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.651573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.652281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.652747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.653201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.716323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.725858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-758426d2-0f75-4249-a2b8-6a39d8f56ad4 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.268544 Sep 03 21:00:26.740577 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1477/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:26 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:26.745617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:26.746492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:26.753372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.754113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.754798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.755782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:26.756453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:26.764151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:26.832843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.842574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.843961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:26.846599 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf2bdbea-7775-409f-b624-9ae6d1ba09e1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.208528 Sep 03 21:00:26.847387 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1578/3055] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:26 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:27.003182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:27.017681 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eed5af7a-e7da-4ad7-8f29-e2308d94ab0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.275511 Sep 03 21:00:27.018428 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1478/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:26 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:27.376658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:27.377899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:27.386132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.389679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.391671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.393121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:27.393660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.393768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:27.397449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.399023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.402970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.403433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.404141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.405297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.405758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.406617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.639716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:27.651434 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5cdde05c-ba56-4fd3-842a-7526496f9cd4 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.282384 Sep 03 21:00:27.665331 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1579/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:27 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:27.710312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:27.722441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66c96214-40b7-43b1-acbc-48019ef9bb25 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.333365 Sep 03 21:00:27.727049 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1479/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:27 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:27.753238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:27.754150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:27.762088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.762889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.763580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.764476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.765125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.765763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.873250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:27.874146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:27.880564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.881305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.881903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:27.882796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:27.883411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:27.883992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.034162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.052430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.053482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62261775-81bb-415f-8a3a-0d472b27ed95 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.301245 Sep 03 21:00:28.054105 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1580/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:27 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:28.080079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:28.084723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:28.090259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.096427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.100013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ddd94b4-da38-4f33-baa0-b5fae2004fc1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.230741 Sep 03 21:00:28.100888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.101587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.101970 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1480/3060] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:27 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:28.103071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.103973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.104495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.104952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.346433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cc638f-dd8b-47eb-96ab-71a9453e13b3", "name": "network-vif-plugged", "status": "completed", "tag": "ac4d7b1d-56a8-4c20-b0cf-2af8f2208594"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:28.360192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.360849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.361389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.375320 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] Creating event network-vif-plugged:ac4d7b1d-56a8-4c20-b0cf-2af8f2208594 for instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 on nch1-master-1 Sep 03 21:00:28.376318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.382049 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c245193f-0a29-4d36-adba-1404bc4fb333 req-a447d03d-8a3d-4ac6-8b6b-a91227e411c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041981 Sep 03 21:00:28.383553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1481/3061] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:28.385055 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3cd3d59f-cb85-475b-83fc-a04e8dddd7b2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.327410 Sep 03 21:00:28.385632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1581/3062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:28 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:28.570270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6228808a-a705-45aa-bb31-2f411e0e114f", "tag": "51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:28.592437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.593023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.593651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.611209 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] Creating event network-changed:51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3 for instance 6228808a-a705-45aa-bb31-2f411e0e114f on nch2-master-1 Sep 03 21:00:28.619260 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e6dfa9d9-f64a-44ef-804f-c57922fea7dd req-6ce7da97-70ac-4f5e-9dc4-9f104eec7625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060352 Sep 03 21:00:28.620721 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1482/3063] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:28.679313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:28.680568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:28.690402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.691258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.691981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.693911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.694655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.695741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.755871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:28.756889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:28.772941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.773538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.773972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.774876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:28.775881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:28.776335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:28.979170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:28.988712 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d230986c-e2bc-4fa7-aadd-0ad97902b515 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.313761 Sep 03 21:00:28.989936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1582/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:28 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:29.008969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.019324 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d2e3537-3dc2-4c13-b9ef-7122dac54c50 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.274296 Sep 03 21:00:29.020807 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1483/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:28 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:29.078820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:29.079451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:29.085522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.086276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.087012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.088013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.088635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.089258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.137687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:29.139186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:29.148213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.150688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.151327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.152222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.153596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.154077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.290994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.303308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.305002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.306332 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a8b9323-3aac-4c78-a72c-692548ff6a1e tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.180915 Sep 03 21:00:29.307553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1484/3066] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:29 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:29.346721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.354485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d029c91-93ff-471f-ad21-4291010b003d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.281690 Sep 03 21:00:29.355234 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1583/3067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:29 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:29.408450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:29.409109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:29.411233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:29.416783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.417417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.417928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.418727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:29.419258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:29.419789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:29.600942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:29.608849 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4026a464-95ba-4acf-a38d-5d623dcd34a7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.204991 Sep 03 21:00:29.609453 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1485/3068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:29 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:30.016406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:30.017284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:30.024631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.025159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.025671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.026450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.026921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.027355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.043156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:30.043779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:30.049953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.050447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.050892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.051605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.052066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.052508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.179377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.188187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-155495ba-4ce2-4204-baef-96d539be022e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.177164 Sep 03 21:00:30.188768 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1584/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:30 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:30.263324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.271030 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d6c0ffd-bed9-48c4-ba98-214cd8171173 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.231815 Sep 03 21:00:30.271600 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1486/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:30 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:30.349276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:30.349901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:30.356250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.356747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.357818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.358531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.358998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.359435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.378888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:30.379598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:30.386071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.386797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.387248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.388141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.389211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.389654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.436785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.447235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.448719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.449958 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8fad2131-30c2-40e3-a349-199b55d4f6a2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.104946 Sep 03 21:00:30.454976 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1585/3071] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:30 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:30.559360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.569540 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04c314ab-a0bb-46a2-86b1-4214641ea145 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1316 microversion: 2.1 time: 0.195088 Sep 03 21:00:30.586590 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1487/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:30 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:30.632100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:30.632754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:30.639446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.640068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.640669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.641404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:30.641869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:30.642306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:30.881026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:30.889226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e685f01-8d52-4bac-9e7b-6a944b772dc7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.261651 Sep 03 21:00:30.889799 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1586/3073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:30 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:31.210741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.212417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.218712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.219340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.219845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.220869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.221441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.221989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.294249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.295612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.302572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.303288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.303731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.304434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.304950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.305346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.399793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.410714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8228673-10ad-42fa-9df4-8f5c9febb497 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.203611 Sep 03 21:00:31.411309 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1488/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:31.444455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.453780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88bc69da-dde8-4ba6-9140-1a4bac4b8cf0 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.163437 Sep 03 21:00:31.469401 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1587/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:31.486563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.487213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.493515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.493999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.494440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.495174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.495690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.496009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.581624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.590355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.592334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.593529 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b91d203d-8cb9-4f69-821f-508a164d07a8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.111629 Sep 03 21:00:31.597269 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1489/3076] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:31.599054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.599681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.606725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.607908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.608479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.609494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.610028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.610607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.763969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:31.771947 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b74be983-4455-42d7-8665-faffe6f4d2da tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1466 microversion: 2.1 time: 0.182169 Sep 03 21:00:31.772525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1588/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:31.796742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.797496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.803908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.804405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.804850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.805761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.806226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.806664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.914496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:31.915133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:31.921824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.922415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.922865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.923586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:31.924058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:31.924493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:31.992647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:32.000036 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b0c34d2-1be2-423c-ba15-dca6250ff5ba tempest-ServersOnMultiNodesTest-2013511108 tempest-ServersOnMultiNodesTest-2013511108-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1617 microversion: 2.1 time: 0.208149 Sep 03 21:00:32.001182 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1490/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1617 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:32.033515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:32.036212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:32.044571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.046433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.047198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.048160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.049112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.049961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.089167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:32.090984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.101354 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8aba6dbc-974e-475d-b5dd-1ee1686b6bba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.190773 Sep 03 21:00:32.102584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1589/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:31 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:32.205058 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fcf86d2-64f3-49fb-b018-7862f9f9afa8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 204 len: 0 microversion: 2.1 time: 0.179707 Sep 03 21:00:32.205797 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1491/3080] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:32 2022] DELETE /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:32.214005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:32.214720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:32.221118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.221615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.222060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.222771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.223232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.223666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.371707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.381481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a7bc07c-cc28-40b5-a83f-7990ea087cde tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1472 microversion: 2.1 time: 0.171325 Sep 03 21:00:32.382616 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1590/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:32 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:32.436643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:32.437532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:32.445957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.446563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.447270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.448222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.448791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.449346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.480621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:32.482726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:32.490740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.491385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.492085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.493089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.493773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.494420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.661629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.673263 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42632440-6245-429b-92c1-02c0b7ca0084 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.199342 Sep 03 21:00:32.674194 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1591/3082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:32 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:32.679252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:32.680740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:32.688361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.689997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.690647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.691427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:32.691948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:32.692610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:32.766520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.770291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:32.779267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.781463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.782985 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1922882a-6e5f-4363-acac-6bfb5306badf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.107493 Sep 03 21:00:32.783674 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1592/3083] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:32 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:32.856434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:32.864881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d7f0d6a-5cdb-4670-8d26-42c0a3e92266 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.433646 Sep 03 21:00:32.865808 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1492/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:32 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:33.127367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:33.133150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:33.145022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.145528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.145970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.147307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.150655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.151098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.335441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.344519 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55fb1564-2e4c-4a00-bbc0-7f4d8c769ecc tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.221767 Sep 03 21:00:33.349039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1593/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:33 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:33.405436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:33.406137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:33.412300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.412854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.413390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.414151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.414613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.415034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.644815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.653590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b17a88c-2612-4d10-afbd-8fbbd5516f07 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1472 microversion: 2.1 time: 0.252037 Sep 03 21:00:33.655029 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1493/3086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:33 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:33.700204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:33.701315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:33.708042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.708543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.709018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.709793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.710438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.711066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.809212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:33.810225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:33.817310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.818135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.818862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.819795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.820467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.821868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.864425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.879760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0f451ea9-6f09-4035-8104-eef93c74839c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.183395 Sep 03 21:00:33.896988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1594/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:33 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:33.896988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:33.896988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:33.902077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.902586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.903231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.903809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:33.905019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:33.905458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:33.939455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.951952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.956269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:33.958502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78b1c15f-1cf6-4a22-940c-ff6c1d0aca89 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.153063 Sep 03 21:00:33.974214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1494/3088] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:33 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:34.056213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:34.065032 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83a3ede9-89cd-4251-8a35-25ff6f5ff093 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.179502 Sep 03 21:00:34.074345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1595/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:33 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:34.373695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:34.374425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:34.386384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.386901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.387350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.389540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.390013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.390585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.614707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:34.626545 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2112aa0-1818-4f3d-9e1a-a8db06c00e0c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.261265 Sep 03 21:00:34.627158 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1495/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:34 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:34.677601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:34.678229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:34.688551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.689091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.689539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.690279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.690739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.691170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.831483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cc638f-dd8b-47eb-96ab-71a9453e13b3", "name": "network-vif-deleted", "tag": "ac4d7b1d-56a8-4c20-b0cf-2af8f2208594"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:34.843280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.843862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.844529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.858233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] Creating event network-vif-deleted:ac4d7b1d-56a8-4c20-b0cf-2af8f2208594 for instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 on nch1-master-1 Sep 03 21:00:34.863639 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fea455ce-cf76-40a0-8ca0-463914841438 req-9f277004-29a5-40df-96e0-0c6c25fd0fd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Sep 03 21:00:34.867731 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1496/3091] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:34.911025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:34.912062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:34.929094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.931352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.938349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.939621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:34.940239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:34.941529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:34.995937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.006683 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ccfba65f-5350-4151-ace5-db2c248904c5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1430 microversion: 2.1 time: 0.333024 Sep 03 21:00:35.010159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1596/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:34 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1430 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:35.031741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:35.032358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:35.070520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:35.071372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.071901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:35.072279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.072882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.073841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.074507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.076366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.212463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.230513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.236950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.238198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec3fe027-c9c6-4d26-b3e2-59d3fdd0b01c tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.219899 Sep 03 21:00:35.238751 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1597/3093] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:35 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:35.260271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:35.263595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:35.277070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.278041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:35.283548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.284254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.286467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.287387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.289072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.289953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.290664 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b09eb0bf-e624-4eae-8951-dc3bdfdca48a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.385546 Sep 03 21:00:35.291269 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1497/3094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:34 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:35.306343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228808a-a705-45aa-bb31-2f411e0e114f", "name": "network-vif-plugged", "status": "completed", "tag": "51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:35.335229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.335745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.337689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.372316 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] Creating event network-vif-plugged:51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3 for instance 6228808a-a705-45aa-bb31-2f411e0e114f on nch2-master-1 Sep 03 21:00:35.379132 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ee03132b-ae9d-4b56-b690-2a4b38818d12 req-852ae472-b454-4b0f-b1c5-9d06ef5203bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086609 Sep 03 21:00:35.380278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1498/3095] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:35.656394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:35.657242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:35.676444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.678402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.680191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.681209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:35.684283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:35.687637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:35.748434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.772052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f9b5682-aa4d-4240-a8b6-fab99eac280f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.527114 Sep 03 21:00:35.786125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1598/3096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:35 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:35.882067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:35.904289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c908e14-e32b-4e9c-92ac-2ccdad9b7e86 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.256722 Sep 03 21:00:35.905612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1499/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:35 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:36.032402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:36.033203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:36.041715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.045192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.045724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.046685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.048245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.052523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.101506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.102484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.103133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.103841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid e3cc638f-dd8b-47eb-96ab-71a9453e13b3 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:36.161571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:36.170308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0d91f3dc-6e6b-4403-940d-27896bc9f067 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 200 len: 1306 microversion: 2.1 time: 0.141309 Sep 03 21:00:36.171051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1599/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:36 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 1306 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:36.266813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:36.267633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:36.275384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.275914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.276399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.277226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.277627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.278064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.320357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:36.321035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:36.332318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.332759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.333231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.334143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.334617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.335059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.355567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:36.373268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:36.375779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:36.377181 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25b5b749-435c-4a4e-a614-d198c3ba3dac tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.114573 Sep 03 21:00:36.389370 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1500/3099] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:36 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:36.666925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:36.682671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e46ea7e-efc3-446a-bc27-6d296593f4b7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1321 microversion: 2.1 time: 0.367695 Sep 03 21:00:36.683974 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1600/3100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:36 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:36.798022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:36.799048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:36.807730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.810827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.811364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.812109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.812776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.813463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.929688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:36.930611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:36.939520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.940879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.941572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:36.942675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:36.943390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:36.944160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.014305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.022443 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d32ad0a-958c-401f-a8c5-d7c9a7de0b4a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.229795 Sep 03 21:00:37.023381 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1501/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:36 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:37.196259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:37.197340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e3cc638f-dd8b-47eb-96ab-71a9453e13b3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.204389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.204995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.205372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.206099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.206562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.206997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.229365 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 HTTP/1.1 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e3cc638f-dd8b-47eb-96ab-71a9453e13b3'} Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:37.231436 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. Sep 03 21:00:37.235883 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:37.237183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance e3cc638f-dd8b-47eb-96ab-71a9453e13b3 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:37.238226 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e3d9b8c-4f27-4137-a237-c946bbb09d23 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3" status: 404 len: 111 microversion: 2.1 time: 0.045938 Sep 03 21:00:37.239310 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1502/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:37 2022] GET /compute/v2.1/servers/e3cc638f-dd8b-47eb-96ab-71a9453e13b3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:00:37.248509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:37.249351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.257159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.257790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.258226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.259002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.259478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.259918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.264889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.280405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-32715bcd-eac4-461f-86e9-66defcba08d5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.351601 Sep 03 21:00:37.281782 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1601/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:36 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:37.302832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:37.392695 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a48e0f3f-6cf8-408f-a68e-f7a21f1061d5 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 204 len: 0 microversion: 2.1 time: 0.148553 Sep 03 21:00:37.393848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1503/3104] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:37 2022] DELETE /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:00:37.406801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:37.408206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:37.409035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.411704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.415345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.416028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.416658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.417498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.417968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.418453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.434295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.434981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.435811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.437605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.438910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.439782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.509500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.521089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.522885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.524652 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-368d336a-6136-4ae0-8839-eb73a239775f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.121176 Sep 03 21:00:37.525842 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1504/3105] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:37 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:37.605066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.613506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac5bd5e5-3557-40af-ac53-49f75484411f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1473 microversion: 2.1 time: 0.214976 Sep 03 21:00:37.614410 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1602/3106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:37 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:37.702603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80dc9eed-43ef-45da-ba70-25ea8c0a7c1f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Action: 'create', calling method: .version_select at 0x7fae663fc820>, body: {"keypair": {"name": "tempest-keypair-1609962765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwgtU9GcizzCz+JqdY4z7rF48GJlcADz+6ccO7jycyrVzkLZD4Ore7QXdD+3WUJnoxPv+kuGMf2SNfvq70Dg4AAHdf4EqSL0aPbFpqpJ8wuVZ7ZzAZKhGW5nW7Sp3rUQA=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:37.707907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:37.708532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.714771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.715272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.715716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.717047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.717517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.717951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.720659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-80dc9eed-43ef-45da-ba70-25ea8c0a7c1f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for project 146fb657f35e47de8fbad6cacc39f501. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:37.726088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-80dc9eed-43ef-45da-ba70-25ea8c0a7c1f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for user 8923b1af5fd54c31ac0af85564cfdd92 and project 146fb657f35e47de8fbad6cacc39f501. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:37.752137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80dc9eed-43ef-45da-ba70-25ea8c0a7c1f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166508 Sep 03 21:00:37.756940 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1505/3107] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:00:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:37.875260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:37.884879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-452ab3e7-2b36-4bf5-9bdd-dfa42b7573dc tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1470 microversion: 2.1 time: 0.180752 Sep 03 21:00:37.885704 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1603/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:37 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:37.909363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:37.909956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:37.916808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.917330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.917771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.918473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:37.918927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:37.919392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:37.951839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lazy-loading 'flavor' on Instance uuid 6228808a-a705-45aa-bb31-2f411e0e114f {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:37.972392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:38.030635 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f58cd3cc-4b8c-40cb-bb80-5a5f9bb85ce0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f/action" status: 202 len: 0 microversion: 2.1 time: 0.126559 Sep 03 21:00:38.031748 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1506/3109] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:37 2022] POST /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:00:38.039636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:38.040264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:38.046969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.047482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.047951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.049114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.049583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.050016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.055492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:38.057087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:38.065440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.066049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.066502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.067231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.067767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.068224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.225465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.234379 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fad46ef3-e49b-4dbb-a9c7-42fac8dc9097 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.187122 Sep 03 21:00:38.234960 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1507/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:38 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:38.312807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:38.312807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:38.321527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.321944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.322384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.323095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.323558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.323987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.420268 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1dbdf13f-b1c9-4814-b2af-5553306d63e7 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1629 microversion: 2.1 time: 0.383407 Sep 03 21:00:38.420888 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1604/3111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:38 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1629 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:38.553941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:38.554562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:38.563338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.563957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.564533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.565332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.565787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.566406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.582695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.593527 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-606b196f-5a07-4369-abcf-991fde40152f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.288038 Sep 03 21:00:38.594694 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1508/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:38 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:38.641801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:38.644183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:38.653212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.654296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.654820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.655555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:38.656021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:38.656936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:38.663464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.675199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.676783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.678095 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5ed8700-a9f6-4705-b924-d5b90e5d71a1 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.129575 Sep 03 21:00:38.678751 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1605/3113] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:38 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:38.892110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:38.900317 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1970f9eb-8947-4f92-8742-bed825024c1c tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1473 microversion: 2.1 time: 0.265949 Sep 03 21:00:38.913125 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1509/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:38 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:39.264484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:39.266360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:39.275486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.276251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.277138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:39.278235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.279565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.280212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:39.448476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1966967107", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7f3b5655-9925-42f2-9907-8e181e6d89c5"}], "security_groups": [{"name": "tempest-securitygroup--1291775494"}], "key_name": "tempest-keypair-1609962765", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:39.527658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:39.540687 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b88d958-4012-44b7-8496-44be3f4f72ab tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.282676 Sep 03 21:00:39.542114 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1606/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:39 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:39.561471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:39.562469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:39.572124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.575221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.576876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:39.579014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.580182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.581526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:39.591172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] validate_networks() for [('7f3b5655-9925-42f2-9907-8e181e6d89c5', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:00:39.926435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e88e4f5c-0ae3-477d-b4c9-49e72994f94c tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1612 microversion: 2.1 time: 0.383123 Sep 03 21:00:39.941309 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1607/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:39 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1612 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:39.943431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:39.946203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:39.959871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.960791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.962704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:39.964052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:39.964767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:39.966014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.237936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.249042 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3cf9228-fd51-46f1-ab3a-5eb36280942f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.311230 Sep 03 21:00:40.249652 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1608/3117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:39 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:40.255823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:40.256931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:40.259757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for project 146fb657f35e47de8fbad6cacc39f501. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:40.267440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for user 8923b1af5fd54c31ac0af85564cfdd92 and project 146fb657f35e47de8fbad6cacc39f501. Resources: dict_keys(['metadata_items']) {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:40.269543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.272294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.272965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.273898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.274553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.275159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.281289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:40.288959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:00:40.292203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:00:40.292969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:00:40.293546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:00:40.294121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:00:40.308173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.308968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.309641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.310722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.311520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.312155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.338495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for project 146fb657f35e47de8fbad6cacc39f501. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:00:40.345966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Getting quotas for user 8923b1af5fd54c31ac0af85564cfdd92 and project 146fb657f35e47de8fbad6cacc39f501. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:00:40.363877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:00:40.367658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:00:40.381129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.393102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.394853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.396323 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd875104-d9eb-426e-ba69-1c15d8061aa8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.145099 Sep 03 21:00:40.397147 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1609/3118] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:40 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:40.421255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac36e5f-f961-4bfe-b477-58985805f5a7", "name": "network-vif-deleted", "tag": "f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:40.444711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.445659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.457486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.465229 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-091f4bb2-3d97-4800-92b7-fc6b22605ae9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.021359 Sep 03 21:00:40.466782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1510/3119] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:00:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:00:40.479656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:40.480258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:40.491040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.491936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.492551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.493827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.494451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.494965 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] Creating event network-vif-deleted:f6b8f9bf-3a7a-4bde-8c8e-10fe89a4a5b2 for instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 on nch2-master-1 Sep 03 21:00:40.495243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.543394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:40.545639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-21d70411-4f73-405e-8829-98866dccb176 req-8ad45ef7-e646-413d-bb01-a274f6a63b31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127690 Sep 03 21:00:40.546542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.547044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.547497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.547964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid 4ac36e5f-f961-4bfe-b477-58985805f5a7 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:40.552720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1610/3120] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:40.562119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:40.562824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:40.580455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.586430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.587025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.587802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.588287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.588730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.605055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.615313 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5479caa-2875-4334-9f26-9615637a0d56 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1307 microversion: 2.1 time: 0.139797 Sep 03 21:00:40.615906 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1511/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:40 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:40.620602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb9f51f2-ce41-4e7f-b03e-eb66aec589d4 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:40.621265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bb9f51f2-ce41-4e7f-b03e-eb66aec589d4 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:40.701472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bb9f51f2-ce41-4e7f-b03e-eb66aec589d4 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.711822 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bb9f51f2-ce41-4e7f-b03e-eb66aec589d4 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1278 microversion: 2.1 time: 0.094397 Sep 03 21:00:40.730455 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1512/3122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:40 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:40.736067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:40.736696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:40.743225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.743620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.744644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.745430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:40.745899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:40.746335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:40.896678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6228808a-a705-45aa-bb31-2f411e0e114f while it is in vm_state suspended Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Request method failure captured: Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f/action HTTP/1.1 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 15 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BS1kG1aDHZP3UrDf3Qm_X6bbrRlb4H5eaDpQ4C0w2G1TTMCsmA5CxXkSYu_bxpmX899KRGHx3rARf5R_XuXZ4hordoxCgp7dpo0xusevvPiFQ1Yp8mxQPBittz_h4S8km__SNAlxlqBqYXaF09Qy8mrGoWBxOnqNkENI4lWMFPpqU Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d05514342ed4dc383c025be27b5808b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 538736eb093546e1a81e2b4c3e537166 Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: {"migrate": {}} Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'migrate' instance 6228808a-a705-45aa-bb31-2f411e0e114f while it is in vm_state suspended Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6228808a-a705-45aa-bb31-2f411e0e114f', 'body': {'migrate': {}}} Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6228808a-a705-45aa-bb31-2f411e0e114f in vm_state suspended. Cannot resize while the instance is in this state. Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:00:40.898727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6228808a-a705-45aa-bb31-2f411e0e114f while it is in vm_state suspended Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6228808a-a705-45aa-bb31-2f411e0e114f while it is in vm_state suspended Sep 03 21:00:40.903988 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.906301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Returning 409 to user: Cannot 'migrate' instance 6228808a-a705-45aa-bb31-2f411e0e114f while it is in vm_state suspended {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:40.907564 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-60436f06-b401-4185-8a34-f7e3a3d6f30b tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f/action" status: 409 len: 148 microversion: 2.1 time: 0.353514 Sep 03 21:00:40.915198 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1611/3123] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:40 2022] POST /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f/action => generated 148 bytes in 362 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:00:40.927773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39b57fdc-db51-4a8b-bedb-76d3e40320d1 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39b57fdc-db51-4a8b-bedb-76d3e40320d1 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Request method failure captured: Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action HTTP/1.1 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 39 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BS1kG1aDHZP3UrDf3Qm_X6bbrRlb4H5eaDpQ4C0w2G1TTMCsmA5CxXkSYu_bxpmX899KRGHx3rARf5R_XuXZ4hordoxCgp7dpo0xusevvPiFQ1Yp8mxQPBittz_h4S8km__SNAlxlqBqYXaF09Qy8mrGoWBxOnqNkENI4lWMFPpqU Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d05514342ed4dc383c025be27b5808b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 538736eb093546e1a81e2b4c3e537166 Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: {"os-resetState": {"state": "invalid"}} Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'bd2db057-71f8-4c37-bfcf-eefae40a8764', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'invalid' Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:00:40.933953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 03 21:00:40.939287 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.941232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39b57fdc-db51-4a8b-bedb-76d3e40320d1 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:40.943440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39b57fdc-db51-4a8b-bedb-76d3e40320d1 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action" status: 400 len: 144 microversion: 2.1 time: 0.026164 Sep 03 21:00:40.944450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1612/3124] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:40 2022] POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:00:40.957931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8603be73-e232-4a65-ac1b-1bf26f0d69f0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8603be73-e232-4a65-ac1b-1bf26f0d69f0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Request method failure captured: Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action HTTP/1.1 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 31 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BS1kG1aDHZP3UrDf3Qm_X6bbrRlb4H5eaDpQ4C0w2G1TTMCsmA5CxXkSYu_bxpmX899KRGHx3rARf5R_XuXZ4hordoxCgp7dpo0xusevvPiFQ1Yp8mxQPBittz_h4S8km__SNAlxlqBqYXaF09Qy8mrGoWBxOnqNkENI4lWMFPpqU Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d05514342ed4dc383c025be27b5808b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 538736eb093546e1a81e2b4c3e537166 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: {"os-resetState": {"state": 1}} Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'bd2db057-71f8-4c37-bfcf-eefae40a8764', 'body': {'os-resetState': {'state': 1}}} Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 1 Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 03 21:00:40.962239 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8603be73-e232-4a65-ac1b-1bf26f0d69f0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8603be73-e232-4a65-ac1b-1bf26f0d69f0 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action" status: 400 len: 120 microversion: 2.1 time: 0.011744 Sep 03 21:00:40.972584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1613/3125] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:40 2022] POST /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:00:40.977763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:40.985097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Failed to fetch instance by id 999 {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 21:00:40.985658 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 03 21:00:40.990069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Request method failure captured: Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 37 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BS1kG1aDHZP3UrDf3Qm_X6bbrRlb4H5eaDpQ4C0w2G1TTMCsmA5CxXkSYu_bxpmX899KRGHx3rARf5R_XuXZ4hordoxCgp7dpo0xusevvPiFQ1Yp8mxQPBittz_h4S8km__SNAlxlqBqYXaF09Qy8mrGoWBxOnqNkENI4lWMFPpqU Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d05514342ed4dc383c025be27b5808b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d05514342ed4dc383c025be27b5808b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d05514342ed4dc383c025be27b5808b Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1871941800 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 538736eb093546e1a81e2b4c3e537166 Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1871941800-project-admin Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: {"os-resetState": {"state": "error"}} Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 999 could not be found. Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:40.996381 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c33d9951-fdbc-4cf0-8283-93fc7e282d13 tempest-ServersAdminNegativeTestJSON-1871941800 tempest-ServersAdminNegativeTestJSON-1871941800-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.026487 Sep 03 21:00:41.007128 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1614/3126] 10.222.0.16 () {60 vars in 1179 bytes} [Sat Sep 3 21:00:40 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:00:41.008536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-659b2fe7-060f-41fb-aa39-853df753c2e5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.269118 Sep 03 21:00:41.008536 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1513/3127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:40 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:41.012815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.018313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.025242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.025949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.026491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.027374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.028332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.029697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.068636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:41.176950 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b2ea104c-9d87-47f5-9584-4d777878b1e7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 204 len: 0 microversion: 2.1 time: 0.167890 Sep 03 21:00:41.181670 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1615/3128] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:41 2022] DELETE /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:41.191885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.192509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.199738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.200471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.201693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.202644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.203291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.203882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.275307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.277975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.287283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.288134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.288770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.290598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.291255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.291876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.375888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.384262 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7bb50664-8f4a-4ffb-9e73-55657cb3d0b2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1467 microversion: 2.1 time: 0.197106 Sep 03 21:00:41.385465 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1514/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:41 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1467 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:41.437375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.438288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.445020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.445793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.446564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.447441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.448058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.448693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.453049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.465684 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e8f3834-1705-4947-9d6d-7fba6a602e0d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.194682 Sep 03 21:00:41.466313 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1616/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:41 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:41.532833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.543118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.545234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.546426 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-082b78f2-ba2e-4988-a7af-72a970d485d2 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.114701 Sep 03 21:00:41.547017 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1515/3131] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:41 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:41.641318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.642037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.649072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.649571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.650082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.650725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.651277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.651718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.690799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.691365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.691818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.692272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid 4ac36e5f-f961-4bfe-b477-58985805f5a7 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:41.738482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.740776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:41.741644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:41.748177 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9d3b51d-37ee-4ca7-bf89-442f8e4e7e0b tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 200 len: 1307 microversion: 2.1 time: 0.110258 Sep 03 21:00:41.748944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.749156 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1617/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:41 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:41.749846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.750453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.751192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:41.751996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:41.752715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:41.822129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:41.830017 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0bf99a45-e3e8-4233-8e83-3425ed5487af tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1330 microversion: 2.1 time: 0.093839 Sep 03 21:00:41.831441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1516/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:41 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:42.027378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.028046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.034765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.035259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.035725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.036433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.036889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.037344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.171776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.179489 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21aeda0b-0bb2-4466-9a58-f095df45475a tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.156163 Sep 03 21:00:42.180049 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1618/3134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:42.408414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.409121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.415388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.416084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.416541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.417848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.418362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.418805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.491282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.492299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.513890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.515920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.516792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.518928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.519896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.520606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.606567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.616959 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-750e77b3-df24-4478-bad0-36f7d8d9f15f tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1467 microversion: 2.1 time: 0.213113 Sep 03 21:00:42.617788 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1517/3135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1467 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:42.626744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.627600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.634761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.635265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.635719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.636582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.637084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.637589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.682905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.691453 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6845cd7e-e02e-4ed5-848c-1425b7a52556 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.204917 Sep 03 21:00:42.697885 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1619/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:42.716478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.725122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.726621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.727810 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7eabc755-85eb-4ccf-898d-93e7535af830 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.108625 Sep 03 21:00:42.728388 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1518/3137] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:42.770465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.771090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 4ac36e5f-f961-4bfe-b477-58985805f5a7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.777184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.777676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.778117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.778866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.779320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.779751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.793337 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 HTTP/1.1 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4ac36e5f-f961-4bfe-b477-58985805f5a7'} Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:42.795062 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance 4ac36e5f-f961-4bfe-b477-58985805f5a7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6863a5fd-1b66-45af-b2d8-8db9dbcb650a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7" status: 404 len: 111 microversion: 2.1 time: 0.029854 Sep 03 21:00:42.799184 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1620/3138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/4ac36e5f-f961-4bfe-b477-58985805f5a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:42.805707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.806216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.812808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.813360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.813808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.814508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.814971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.815403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.839937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:42.854843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.855605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.862722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.863294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.863809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.864592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.865152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.865650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.928092 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8e774e4-896d-43d3-8d53-c09ff467b046 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 204 len: 0 microversion: 2.1 time: 0.126057 Sep 03 21:00:42.929145 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1519/3139] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:42 2022] DELETE /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:00:42.941365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:42.953051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2eadc76-77f3-4412-aede-2f8e3f0412fc tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1336 microversion: 2.1 time: 0.102601 Sep 03 21:00:42.953241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:42.964950 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1621/3140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:42.965152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.166578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.174721 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b02eba24-fb4a-4742-bb35-2681ed65ba26 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1472 microversion: 2.1 time: 0.240004 Sep 03 21:00:43.175485 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1520/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:42 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:43.202491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:43.203108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:43.209158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.209643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.210082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.210779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.211240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.211666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.378116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.387957 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ad84489e-bfd0-42ed-957a-01c45d110555 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.189366 Sep 03 21:00:43.404417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1622/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:43 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:43.639713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:43.640265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:43.647797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.648370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.648821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.649592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.650057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.650488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.715179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:43.715744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:43.723386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.723881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.724354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.725100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.725560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.726022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.864988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.874671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42a4e319-c9f3-4144-a564-6595f15db3d6 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.163372 Sep 03 21:00:43.875436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1623/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:43 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:43.880262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:43.880963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:43.887326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.888061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.888506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.889233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.889690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.890114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.962294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.970930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.972312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:43.973534 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-97a5a68f-1725-424d-a95c-a7092f9aa856 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.097159 Sep 03 21:00:43.974645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1624/3144] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:43 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:43.979501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:43.979733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:43.983562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:43.987987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.988658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.989128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:43.990019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:43.990474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:43.990904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.133785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:44.139177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:44.141525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:44.148956 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa8895d8-8763-4b49-8651-042d6c446fba tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.173230 Sep 03 21:00:44.149737 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b33a9a79-df28-4549-8d33-f76e9df2d05e tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1467 microversion: 2.1 time: 0.513988 Sep 03 21:00:44.149938 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1625/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:43 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:44.160935 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1521/3146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:43 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1467 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:44.198291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:44.199038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:44.205264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.205821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.206322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.207085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.207608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.208103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.342612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:44.352377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-51102a29-c4fa-467c-8bf8-613526b983b6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1472 microversion: 2.1 time: 0.158149 Sep 03 21:00:44.353078 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1626/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:44 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:44.411900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:44.412616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:44.419876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.420379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.420830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.421675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.422143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.422717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.440186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44248bd8-d4ef-4152-9118-df5b56ff43d9", "tag": "239bbbee-9280-4147-9d2e-62064fc60a52"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:44.456145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.457039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.457551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.471260 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] Creating event network-changed:239bbbee-9280-4147-9d2e-62064fc60a52 for instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 on nch1-master-1 Sep 03 21:00:44.476538 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-86338408-8818-41b2-89c0-0843d6b91c07 req-41f7bfe3-16b8-4af4-a32e-6961352d3788 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041737 Sep 03 21:00:44.477192 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1627/3148] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:44.645569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:44.655039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-34103ddd-efef-4214-96e2-682081898773 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.247684 Sep 03 21:00:44.655608 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1522/3149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:44 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:44.898410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:44.899114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:44.909082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.909990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.910535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:44.911448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:44.912069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:44.912511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.002582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:45.003481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:45.010145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.010944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.011554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.012293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.012748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.014015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.082883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.092801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.094474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.096272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f87960cc-ab0a-4b58-bf9a-3a74a23e68ff tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.097852 Sep 03 21:00:45.097209 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1523/3150] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:44 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:45.171574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:45.172318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:45.178571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.179139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.179652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.180431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.180993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.181496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.357146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.369694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d16d007-a460-4972-a86e-9b4d0812021d tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.475333 Sep 03 21:00:45.371236 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1628/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:44 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:45.379733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:45.380587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:45.388526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.389081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.389531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.390244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.390705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.391293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.395633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:45.484159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.493256 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-36fe6bcd-62df-4e0d-9520-9511f05af557 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.325485 Sep 03 21:00:45.494297 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1524/3152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:45 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:45.499967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:45.500657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:45.507354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.508593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.509143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.509987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.511144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.511649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.539663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.548059 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6536499-4064-4f1b-a1e1-8a42bcf912e4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1467 microversion: 2.1 time: 0.173348 Sep 03 21:00:45.548641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1629/3153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:45 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1467 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:45.678568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:45.679200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:45.686114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.686620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.687072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.687789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:45.688256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:45.688698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:45.830324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.838427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-213b492c-5a0c-4c25-81d8-4db30cf4ad22 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1524 microversion: 2.1 time: 0.163771 Sep 03 21:00:45.839009 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1630/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:45 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:45.878876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:45.886714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3be0da6-9b26-46ee-8ad9-4c8b856c3233 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1472 microversion: 2.1 time: 0.391214 Sep 03 21:00:45.887286 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1525/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:45 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:46.128542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.129196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.140828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.146836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.147688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.149521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.150083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.150884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.265032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.274064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.282937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.284361 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8726def4-076d-475c-88c2-37ffcc910eb8 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.159816 Sep 03 21:00:46.285204 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1631/3156] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:46.393656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.394493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.401613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.402354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.402959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.404383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.405038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.405632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.506473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228808a-a705-45aa-bb31-2f411e0e114f", "name": "network-vif-deleted", "tag": "51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3"}, {"server_uuid": "123bb02c-0a54-4b48-b0a6-1fc382d7caa7", "name": "network-vif-deleted", "tag": "7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:46.529704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.530199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.530635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.548540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Creating event network-vif-deleted:51b43e71-1f7c-48ee-b9cf-a9ee9065f8d3 for instance 6228808a-a705-45aa-bb31-2f411e0e114f on nch2-master-1 Sep 03 21:00:46.549105 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] Creating event network-vif-deleted:7e5a6e6c-abaf-41c9-b425-53d6bd46fa1c for instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 on nch2-master-1 Sep 03 21:00:46.567774 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6be6a441-4371-4ba4-af6f-14173b6d7e37 req-b0bfec56-39b1-4c9b-a28c-cd776749c77a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065493 Sep 03 21:00:46.569425 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1632/3157] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:46.585331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.586593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.600611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.601161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.601607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.602358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.602814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.603243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.619818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.630006 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-146422f5-bc63-4c7e-9b22-48bd22ef549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.240151 Sep 03 21:00:46.646023 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1526/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:46.655707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.656745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.666709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.667687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.668505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.669598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.670278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.671058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.709430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.717689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.718543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.719390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lazy-loading 'fault' on Instance uuid 6228808a-a705-45aa-bb31-2f411e0e114f {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:46.771356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.780125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-220681c5-f8c4-44da-a44c-78b49d5d9747 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 200 len: 1311 microversion: 2.1 time: 0.132864 Sep 03 21:00:46.780715 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1527/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:46.796939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:46.807575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-34c725ae-614a-4a37-85e8-6982a8136383 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.232649 Sep 03 21:00:46.808181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1633/3160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:46.861915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.862549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.871078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.871583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.874484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.875780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.877596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.878843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.910224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:46.910852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:46.920175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.920681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.921160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.921877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.922339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.923029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.978251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:46.978753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:46.979198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:46.979661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:47.052461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.063841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9cbc397-32d9-4477-b24c-fec944f8f384 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 200 len: 1306 microversion: 2.1 time: 0.156950 Sep 03 21:00:47.063841 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1634/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:47.106339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.114292 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49e8e872-aa29-48d4-9503-8ff27911faf5 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1504 microversion: 2.1 time: 0.256305 Sep 03 21:00:47.114875 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1528/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:46 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:47.137709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0e91ea7-20b7-428f-9f68-afe8db048592 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'create', calling method: .version_select at 0x7fae6708fee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1074855804", "description": "tempest-description-1423449697"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:47.289264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0e91ea7-20b7-428f-9f68-afe8db048592 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.155184 Sep 03 21:00:47.290699 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1635/3163] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:00:47 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:47.308146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1074855804"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:47.316084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:47.316760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.323380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.328989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.330482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.330618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.331046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.331702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.332368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.332603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.333275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.333417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.333905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.334213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.334335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.403468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.411962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.413488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.414677 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d213553-431a-4be0-9910-ba2c1a2c5ef4 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.102498 Sep 03 21:00:47.415261 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1636/3164] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:47 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:47.464526 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Adding security group c5c5af30-3758-49fc-9fd8-c58b45ba2457 to port a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 Sep 03 21:00:47.659141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:47.659850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.668811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.669973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.670505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.671413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.671952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.672464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.815176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:47.823312 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36613f7c-03fe-4bdb-bdc6-88abc0a74e65 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.168227 Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1637/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:47 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: 6228808a-a705-45aa-bb31-2f411e0e114f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.836856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.837531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.837639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.838986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.855391 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] HTTP exception thrown: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Request method failure captured: Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f HTTP/1.1 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BSwLC7DkimL61J4cuu7NbQgBXH-qLGqXtOFwijX7FDaYBE39z2xYjFbP6gxbDUxX6gFssOvxFZnXc581tvtaxbIFa6RNJwkqy9-qVUU3m7YEL66Qa-1Lhw_sZGt_G7wpTyWgI9u-9P3atmuICGVGkhVmERnZwd2Tv870DOUWo1GaE Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f9175f0f4d204936aed9f62d91c141f0 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f9175f0f4d204936aed9f62d91c141f0 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-2027940113-project Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: a1e643d2a39441cda1035502d08d909a Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2027940113-project Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6228808a-a705-45aa-bb31-2f411e0e114f'} Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:47.857756 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Returning 404 to user: Instance 6228808a-a705-45aa-bb31-2f411e0e114f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0441b49-2f08-495a-9be9-8e0cae20fed5 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f" status: 404 len: 111 microversion: 2.1 time: 0.034358 Sep 03 21:00:47.861741 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1638/3166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:47 2022] GET /compute/v2.1/servers/6228808a-a705-45aa-bb31-2f411e0e114f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:47.866428 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dba51236-1b48-420d-b638-44510d114449 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action" status: 202 len: 0 microversion: 2.1 time: 0.565280 Sep 03 21:00:47.867058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:47.867408 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1529/3167] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:47 2022] POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:00:47.867903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.875381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:47.875584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.876002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:47.876122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.876449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.877207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.877732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.878237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.882804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.883305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.883759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.884476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:47.885022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:47.885463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:47.912837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:48.007514 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a40d0f3c-6e12-415b-bcef-74997297511c tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 204 len: 0 microversion: 2.1 time: 0.135493 Sep 03 21:00:48.012041 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1530/3168] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:47 2022] DELETE /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:48.017651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1074855804"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:48.018321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.027149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.027665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.028344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.030091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.030236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.030701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.031149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.038751 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd9b6777-a024-465a-8159-26affbf112dd tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.177603 Sep 03 21:00:48.039735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1639/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:47 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:48.045285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.045975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.052031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.052632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.053189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.054215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.054759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.055264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.177424 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Removing security group c5c5af30-3758-49fc-9fd8-c58b45ba2457 from port a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 Sep 03 21:00:48.197964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.206963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ebea96f-2e26-46c7-8082-4302c61a4453 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1477 microversion: 2.1 time: 0.166236 Sep 03 21:00:48.208001 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1640/3170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:48 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:48.213580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.214523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 123bb02c-0a54-4b48-b0a6-1fc382d7caa7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.224129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.225288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.225769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.227177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.227690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.228648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.244978 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 HTTP/1.1 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '123bb02c-0a54-4b48-b0a6-1fc382d7caa7'} Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:48.246653 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance 123bb02c-0a54-4b48-b0a6-1fc382d7caa7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e8c6de8-fd05-4dcf-b4ac-f6ad23935188 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7" status: 404 len: 111 microversion: 2.1 time: 0.038889 Sep 03 21:00:48.251827 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1641/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:48 2022] GET /compute/v2.1/servers/123bb02c-0a54-4b48-b0a6-1fc382d7caa7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:48.257551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.258220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.265361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.265970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.266729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.267552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.268153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.268921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.297333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:48.383810 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7af2a71-135d-490c-9ab8-a844d803d902 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 204 len: 0 microversion: 2.1 time: 0.129917 Sep 03 21:00:48.384406 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1642/3172] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:48 2022] DELETE /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:48.403324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.404502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.413993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.414818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.415275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.415998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.416469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.416931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.445332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:48.525604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a59f0b34-abee-4d37-b523-c9c248bfc1e9 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 204 len: 0 microversion: 2.1 time: 0.135475 Sep 03 21:00:48.529191 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1643/3173] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:48 2022] DELETE /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:48.531808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.532506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.538315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.538798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.539241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.539957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.540414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.540832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.567611 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f60cf818-576b-4d80-82bc-e8504d227f66 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action" status: 202 len: 0 microversion: 2.1 time: 0.556816 Sep 03 21:00:48.571904 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1531/3174] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:48 2022] POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:00:48.585856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.586588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.609048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.609773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.610410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.611135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.611595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.612187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.618364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.628814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.630709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.632319 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b0d3dc4-da6f-4611-8245-a95560d16011 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.104952 Sep 03 21:00:48.633068 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1644/3175] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:48 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:48.647750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa4552f0-c91e-46e1-a4d9-d19c47514d5e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'create', calling method: .version_select at 0x7fae6685b820>, body: {"pool": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:48.769280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:48.779198 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2fdc5c10-676d-4e83-8014-5bfbb203b884 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1475 microversion: 2.1 time: 0.206204 Sep 03 21:00:48.780028 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1532/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:48 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1475 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:48.785467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}, {"name": "network-changed", "server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:48.797790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.799088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.800082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.815673 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Creating event network-changed:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:48.816599 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] Creating event network-changed:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:48.822137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2bada8a4-06a4-4711-b0e9-b6257f05a143 req-252b771d-f3cd-45e3-acef-7e2d3abe7fc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040759 Sep 03 21:00:48.823069 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1533/3177] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:48.850148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:48.851195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:48.858385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.858879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.859324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.860039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:48.860503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:48.860959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:48.996922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.005638 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5af9f1b2-6267-46a5-a011-836bfc7efb4e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.159992 Sep 03 21:00:49.006214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1534/3178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:48 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:49.063314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:49.063929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:49.070296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.070803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.071303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.072334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.072992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.073441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.209994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.218730 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ed0aa89-cc96-49d5-944e-1eeb841de387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.160463 Sep 03 21:00:49.219372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1535/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:49 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:49.232493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:49.233513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:49.240533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.240997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.241478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.242847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.243504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.243941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.385887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.395963 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-592d9807-8be5-4961-8ba0-67d16016fa62 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1477 microversion: 2.1 time: 0.168621 Sep 03 21:00:49.396955 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1536/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:49 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:49.659470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:49.660096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:49.666168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.666657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.667099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.667801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.668260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.668690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.734396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.736931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:49.744308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.745828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.747014 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-835e8bde-6d67-46c2-93b1-e03dc5193b7a tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1365 microversion: 2.47 time: 0.091527 Sep 03 21:00:49.747687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1537/3181] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:49 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:49.772514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa4552f0-c91e-46e1-a4d9-d19c47514d5e tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.137854 Sep 03 21:00:49.773269 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1645/3182] 10.222.0.16 () {60 vars in 1170 bytes} [Sat Sep 3 21:00:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:49.785965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.88"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:49.788521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:49.795792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.796390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.797036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.797815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.798420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.799052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.804031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:49.804760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:49.811125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.811621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.812090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.812799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:49.813280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:49.813710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:49.818100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:49.827056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 21:00:49.827466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquired lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 21:00:49.949740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:49.958319 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eed13165-643b-4a8a-bc9c-4c0e6f4eb357 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1475 microversion: 2.1 time: 0.158629 Sep 03 21:00:49.958900 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1646/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:49 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:50.028332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:50.028926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:50.035072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.035564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.036011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.036719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.037206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.037641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.192254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.201702 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f464c4e4-41b2-483f-a1fb-176a739bec90 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.177341 Sep 03 21:00:50.202290 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1647/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:50 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:50.241776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:50.242399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:50.249265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.249754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.250198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.250900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.251382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.252027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.326595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:50.383464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.391473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c911c461-0389-41f3-96ac-2222917030c2 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.153578 Sep 03 21:00:50.392045 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1648/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:50 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:50.422287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:50.422909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:50.429167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.429660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.430103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.430806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.431266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.431695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.571082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.579911 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b0af4c97-4515-4bbe-ae33-1da8885b8b3a tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1477 microversion: 2.1 time: 0.161993 Sep 03 21:00:50.580416 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1649/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:50 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:50.706922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:50.774303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:50.775028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:50.782060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.782554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.783013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.783728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.784453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.784608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.865834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.875454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.876976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:50.878194 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b00addb0-0de7-4872-b859-ead863f7e4f5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1383 microversion: 2.47 time: 0.108346 Sep 03 21:00:50.878807 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1650/3187] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:50 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1383 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:00:50.983091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:50.983831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:50.989949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.990443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.990890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:50.991601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:50.992062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:50.992520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.135350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:51.143752 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db271122-0a6c-4a7f-a26b-cdc7bac57d9d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1475 microversion: 2.1 time: 0.164448 Sep 03 21:00:51.144345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1651/3188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:50 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1475 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:51.225447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:51.226076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:51.233344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.233833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.234273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.234993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.235447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.235872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.374627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:51.384791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b09f85a5-4236-4fac-b7f7-8005b1b3f6af tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.163279 Sep 03 21:00:51.388947 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1652/3189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:51 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:51.414098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:51.415313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:51.422220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.423019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.423524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.424449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.425149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.425642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.485661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 21:00:51.573502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:51.581900 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62e3ce92-278c-49fe-8ad8-2257359c7b61 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.171613 Sep 03 21:00:51.582971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1653/3190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:51 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:51.587685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:51.600092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.600849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.601583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.616163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] Creating event network-changed:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:51.624131 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1438be52-205e-425f-8f5e-563385a69b7f req-e2103fa7-a98e-43ec-8d44-fe8b956d8288 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 Sep 03 21:00:51.624931 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1654/3191] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:51.631214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:51.632333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:51.639602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.640102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.640543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.641280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.641976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.642910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.825728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:51.834893 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1622b5fa-08d6-49ed-8048-4078933cd205 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1477 microversion: 2.1 time: 0.208486 Sep 03 21:00:51.835811 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1655/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:51 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1477 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:51.912056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:51.913048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:51.926249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.926866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.927374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:51.937425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:51.938374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:51.938943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.059555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:52.069765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:52.071415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:52.072605 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fed9a82b-f5c0-4444-b533-bf7b5b0ed5bf tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1371 microversion: 2.47 time: 0.166570 Sep 03 21:00:52.080997 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1656/3193] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:51 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:52.080997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44248bd8-d4ef-4152-9118-df5b56ff43d9", "name": "network-vif-plugged", "status": "completed", "tag": "239bbbee-9280-4147-9d2e-62064fc60a52"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:52.087885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.088380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.088926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.107598 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] Creating event network-vif-plugged:239bbbee-9280-4147-9d2e-62064fc60a52 for instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 on nch1-master-1 Sep 03 21:00:52.113172 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-60931752-ba66-48f3-81e9-7e7cb68e9a4a req-828d669d-dbaa-487f-be3d-1de9e538a879 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038352 Sep 03 21:00:52.113957 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1657/3194] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:52.171312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:52.172402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:52.179051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.179678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.180595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.181108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.181764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.182397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.274707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:52.291401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05daf97a-a4fa-4586-a7cd-a105783cad1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 200 len: 1433 microversion: 2.1 time: 0.127507 Sep 03 21:00:52.292417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1658/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:52 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 1433 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:52.408561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:52.409396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:52.415563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.416080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.416531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.417521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.419477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.420121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.535698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Updating instance_info_cache with network_info: [{"id": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54", "address": "fa:16:3e:ae:aa:e8", "network": {"id": "fc7bb338-c80e-4c56-8d25-4a07b0e5f6f2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1263120218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "630205311fc04912910e56076899f18d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4f4c371-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 21:00:52.549544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Releasing lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 21:00:52.550452 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87a36eee-ff4e-4f2a-81b6-bcebfc2960c8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action" status: 202 len: 0 microversion: 2.1 time: 2.768406 Sep 03 21:00:52.551067 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1538/3196] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:49 2022] POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action => generated 0 bytes in 2770 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 21:00:52.559390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.88"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:52.615474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:52.625082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01142c39-7926-4e15-ab32-05f83b54f3b0 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1516 microversion: 2.1 time: 0.221196 Sep 03 21:00:52.625679 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1659/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:52 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:52.636681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:52.637320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:52.652160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.653021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.654317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:52.655205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:52.656014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:52.656871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.003205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:53.029512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.030460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.030917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.035529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.036910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.038359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.136092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:53.147017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7537dfb-44f9-46c4-895a-8fbf7ec422e9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.520266 Sep 03 21:00:53.148160 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1660/3198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:52 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:53.154107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:53.154987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:53.162561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.163240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.164068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.164970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.166034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.166627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.516179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 21:00:53.516830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquired lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 21:00:53.596221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:53.613852 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4271db24-6de3-463d-915c-2847e0e51bbd tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1477 microversion: 2.1 time: 0.464465 Sep 03 21:00:53.627366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1661/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:53 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1477 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:53.636660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:53.637588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:53.646666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.647170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.647619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.648368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.648830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.649472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.765031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:53.775813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:53.777993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:53.780210 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50c280d0-3343-4076-9937-17f5a6fe3655 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1356 microversion: 2.47 time: 0.151734 Sep 03 21:00:53.781116 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1662/3200] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:53 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:53.785985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:53.786867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 510591bb-0231-4c0d-a54a-d403336b6cdb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:53.803874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.805467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.806117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.806998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.807616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.808216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.826360 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb HTTP/1.1 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '510591bb-0231-4c0d-a54a-d403336b6cdb'} Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:53.828297 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. Sep 03 21:00:53.832811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:53.834257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance 510591bb-0231-4c0d-a54a-d403336b6cdb could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:53.835595 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a5c96ef5-1192-41a7-8aa1-df04cb63f322 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb" status: 404 len: 111 microversion: 2.1 time: 0.053146 Sep 03 21:00:53.836348 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1663/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:53 2022] GET /compute/v2.1/servers/510591bb-0231-4c0d-a54a-d403336b6cdb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:53.842462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:53.843288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:53.862332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.862924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.863441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:53.864233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:53.864770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:53.865332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.180556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.191029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:54.196331 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-379e31a6-3348-4515-a3e3-5ef6b65094ca tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.358342 Sep 03 21:00:54.197127 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1664/3202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:53 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:54.213094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510591bb-0231-4c0d-a54a-d403336b6cdb", "name": "network-vif-deleted", "tag": "e4dfcddc-eed7-463b-b3bd-77a017e4614b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:54.226760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.227446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.228036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.241490 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] Creating event network-vif-deleted:e4dfcddc-eed7-463b-b3bd-77a017e4614b for instance 510591bb-0231-4c0d-a54a-d403336b6cdb on nch2-master-1 Sep 03 21:00:54.246858 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-eb536861-0f33-4973-a725-3bc0c7d9fd12 req-1dccaf61-685c-4e95-88aa-cf45f41c6bef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048645 Sep 03 21:00:54.247463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1665/3203] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:54.258039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:54.265336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.266168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Searching by: {'deleted': False, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:00:54.272565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.273256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.274149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.274574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.275269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.275764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.410170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:00:54.497901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.505847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.506066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.506337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.532414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.535209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.581592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f0097a5-8e24-421c-ae47-3f0b8b22c64f tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.332883 Sep 03 21:00:54.582623 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1666/3204] 10.222.0.16 () {60 vars in 1187 bytes} [Sat Sep 3 21:00:54 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:54.587437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:54.588391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:54.598001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.598767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.599491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.600377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.601579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.602047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.698008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.708130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-087091a6-ed68-4efa-a57b-2f9b0d98a0fb tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1432 microversion: 2.1 time: 0.124295 Sep 03 21:00:54.709028 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1667/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:54 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1432 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:54.714366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2db057-71f8-4c37-bfcf-eefae40a8764", "name": "network-vif-deleted", "tag": "ca894091-379f-4026-95d3-262f3fa203a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:54.726098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.726745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.727294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.741143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] Creating event network-vif-deleted:ca894091-379f-4026-95d3-262f3fa203a4 for instance bd2db057-71f8-4c37-bfcf-eefae40a8764 on nch1-master-1 Sep 03 21:00:54.746636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-93acb398-a60a-4713-99dd-42b6f0d474c0 req-1556e525-f529-4048-9b8a-d620f02ac3a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036185 Sep 03 21:00:54.747772 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1668/3206] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:54.754177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:54.754882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:54.758064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:54.763286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.763784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.764232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.764974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.765451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.765870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.910231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:54.918576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ffacd334-65e0-49e0-916e-e3dedb25eaa9 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.169331 Sep 03 21:00:54.928457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1669/3207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:54 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:54.934284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:54.935424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:54.941503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.941996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.942604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.943303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:54.943761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:54.944188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:54.968838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:55.048939 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5229c418-339b-43c3-b855-1a8c2b4b7f34 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "DELETE /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 204 len: 0 microversion: 2.47 time: 0.118536 Sep 03 21:00:55.049571 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1670/3208] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:00:54 2022] DELETE /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:00:55.057378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.058279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:55.065200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.065703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.066226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.067039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.067559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.068056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.153164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.155100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Building network info cache for instance {{(pid=140519) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 03 21:00:55.161413 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a73be593-7760-49a6-9479-305af38e5de4 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1435 microversion: 2.1 time: 0.110332 Sep 03 21:00:55.162215 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1671/3209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:55 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1435 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:55.175229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.176501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:55.183791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.185733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.186777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.187640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.188354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.188948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.258531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.267845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.270123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.271129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c91ef9d-acc9-4515-b472-3963c719ba6d tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1362 microversion: 2.47 time: 0.099996 Sep 03 21:00:55.272602 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1672/3210] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:55 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1362 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:55.276726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.277506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:55.295093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.295762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.296304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.297152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.297747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.298309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.456485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.465052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0b42c9d-b543-4cc2-a22a-658195c710c7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.192206 Sep 03 21:00:55.482222 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1673/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:55 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:55.734257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.734957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:55.741646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.742689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.743139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.743860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.744319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.744744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.814945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:55.824912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57f6e800-54d3-4401-a138-11ef3023395d tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1432 microversion: 2.1 time: 0.094755 Sep 03 21:00:55.826227 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1674/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:55 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1432 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:55.846028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Updating instance_info_cache with network_info: [{"id": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54", "address": "fa:16:3e:ae:aa:e8", "network": {"id": "fc7bb338-c80e-4c56-8d25-4a07b0e5f6f2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1263120218-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "630205311fc04912910e56076899f18d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa4f4c371-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 21:00:55.854677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Releasing lock "refresh_cache-10116344-8967-46c4-ad23-ab769cb073dc" {{(pid=140519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 21:00:55.855491 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d18bd534-c3b4-4e73-84ff-2640e49cb1db tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action" status: 202 len: 0 microversion: 2.1 time: 3.299999 Sep 03 21:00:55.856108 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1539/3213] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:00:52 2022] POST /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc/action => generated 0 bytes in 3301 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 03 21:00:55.864399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d5bb88c-e49a-4cfe-9845-dbcf33c33220 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '.version_select at 0x7fae67935550>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.944963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:55.945750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:55.963839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.964662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.965313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:55.966727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:55.967687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:55.968364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.125615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.134778 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-84da4204-f7f3-40d0-a519-093cfaca6871 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.194748 Sep 03 21:00:56.136517 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1540/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:55 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:56.185855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.187555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:56.195129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.195633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.196082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.196835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.197357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.197818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.272442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.282254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-55e389d8-8c41-4f76-a7aa-eba91e802bb2 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1435 microversion: 2.1 time: 0.100800 Sep 03 21:00:56.282841 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1541/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:56 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1435 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:56.288270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:56.298227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.298698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.299137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.314049 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] Creating event network-changed:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:00:56.320229 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-94209e7f-872d-4134-833c-c2c9ec965f19 req-1d7481e3-2ea1-4319-9858-a2598ed87790 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036049 Sep 03 21:00:56.321114 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1542/3216] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:56.327184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.328061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:56.334270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.334762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.335208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.335909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.336544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.337007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.407793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.419543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.421160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.423571 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-869f44f6-631a-4111-9c32-0891b3708223 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1362 microversion: 2.47 time: 0.099978 Sep 03 21:00:56.424672 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1543/3217] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:56 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1362 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:56.489524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.490436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:56.497819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.498405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.498983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.499862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.500558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.501268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.686974 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d5bb88c-e49a-4cfe-9845-dbcf33c33220 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/51dc43d9-e451-41f1-9d61-8051faf0531b" status: 202 len: 0 microversion: 2.1 time: 0.826326 Sep 03 21:00:56.687578 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1675/3218] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 21:00:55 2022] DELETE /compute/v2.1/os-floating-ips/51dc43d9-e451-41f1-9d61-8051faf0531b => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:00:56.693770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d132783-c4a8-4417-9154-352e292056a0", "name": "network-vif-unplugged", "status": "completed", "tag": "fe35b4c2-173b-4a1b-8d04-3581619f06e8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:56.704055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.704856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.705519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.718559 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] Creating event network-vif-unplugged:fe35b4c2-173b-4a1b-8d04-3581619f06e8 for instance 5d132783-c4a8-4417-9154-352e292056a0 on nch1-master-1 Sep 03 21:00:56.718751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:56.724543 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cc49f7d9-927a-43ee-a713-3c8cd8f58945 req-7049ffa3-90ef-4f30-bd21-1d35012c2344 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035099 Sep 03 21:00:56.725744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1676/3219] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:00:56.730302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec9e4ff0-88db-41ad-b0aa-a84ef642549e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.244753 Sep 03 21:00:56.731197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78e89817-f2a6-4f51-a147-8f8d63204a56 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '.version_select at 0x7fae66a61ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.731332 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1544/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:56 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:56.766873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d09915-197d-436d-9e4e-1d16d7efbc4c", "name": "network-vif-deleted", "tag": "4d6cb81a-21f6-4aa5-8457-63545b5d7cd9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:00:56.778181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.779321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.779846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.793466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] Creating event network-vif-deleted:4d6cb81a-21f6-4aa5-8457-63545b5d7cd9 for instance e6d09915-197d-436d-9e4e-1d16d7efbc4c on nch1-master-1 Sep 03 21:00:56.799989 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ded4aa9f-6577-4e4f-8100-e3c992735135 req-deb66112-f06d-4e2f-94cb-fddb2af2c344 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Sep 03 21:00:56.801012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1545/3221] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:56.849950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.850771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:56.859118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.859716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.860278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.861222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.861760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.862292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.958441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78e89817-f2a6-4f51-a147-8f8d63204a56 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c5c5af30-3758-49fc-9fd8-c58b45ba2457" status: 202 len: 0 microversion: 2.1 time: 0.230930 Sep 03 21:00:56.959730 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1677/3222] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:00:56 2022] DELETE /compute/v2.1/os-security-groups/c5c5af30-3758-49fc-9fd8-c58b45ba2457 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:00:56.967910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:56.968541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:56.975767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.976548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.977207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.978091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:56.978720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:56.979157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:56.986330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.000942 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa4db103-72b6-43a1-ba55-39db3fc95057 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1432 microversion: 2.1 time: 0.155513 Sep 03 21:00:57.001513 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1546/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:56 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1432 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:57.029897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:57.122040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0eb79812-c3b4-4771-9b2c-09accda7b7f8 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 204 len: 0 microversion: 2.1 time: 0.158189 Sep 03 21:00:57.135759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:57.136585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:57.140499 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1678/3224] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:56 2022] DELETE /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:00:57.143776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.144348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.144888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.145732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.146264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.146767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.161311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:57.162136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:57.169974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.170545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.171072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.172049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.172519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.172989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.278340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.286858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ab5e1cf-8724-46da-9ed9-771394485311 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1510 microversion: 2.1 time: 0.157470 Sep 03 21:00:57.287434 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1547/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:57 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:57.307468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:57.308078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.308214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:57.314556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.315048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.315495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.315851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e586c4ae-0c98-45b8-8b4b-60bd62744764 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1404 microversion: 2.1 time: 0.159273 Sep 03 21:00:57.316231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.316419 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1679/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:57 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:57.316777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.317317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.379132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.386772 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-736775e5-3b7b-4a02-b89b-81177624cde7 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1435 microversion: 2.1 time: 0.083637 Sep 03 21:00:57.387333 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1548/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:57 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1435 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:57.450771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:57.451559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:57.458633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.459260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.459717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.460944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.461455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.463070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.503264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.503669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.504114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.504595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lazy-loading 'fault' on Instance uuid 62378b14-092c-4ea1-96ba-ef6ff2f76099 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:57.550191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.558385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.560354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.561572 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58adffd7-73b6-47d8-9918-c2927bbefa35 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1367 microversion: 2.47 time: 0.115288 Sep 03 21:00:57.562141 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1680/3228] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:57 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1367 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:57.758445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:57.759046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:57.766909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.767414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.767861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.768580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:57.769076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:57.769515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:57.905366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:57.914787 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-815eeeca-45b0-4aa6-abcf-56b50e523d36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.160407 Sep 03 21:00:57.915665 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1549/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:57 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:58.027621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.028276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.035298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.035795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.036243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.036999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.037433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.037866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.042298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:58.073821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.074316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.074761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.075333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid e6d09915-197d-436d-9e4e-1d16d7efbc4c {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:58.128310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.144091 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6b7ad649-0cb5-4cea-96b2-ee2e48cf45f6 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 200 len: 1309 microversion: 2.1 time: 0.119999 Sep 03 21:00:58.145231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1681/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:58.309922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.310882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.317023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.317518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.317963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.318659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.319117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.319549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.339885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.340688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.348207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.348692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.349199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.349941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.350561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.351004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.482608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.491244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.492571 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e71d5ec8-a445-47da-9472-c4f7d0aa2117 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1510 microversion: 2.1 time: 0.186553 Sep 03 21:00:58.493189 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1550/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:00:58.506618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.507347 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c88cb198-8fc3-4647-ba1d-d229896055ce tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1591 microversion: 2.1 time: 0.170969 Sep 03 21:00:58.507684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.508402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1682/3232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1591 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:58.514414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.515010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.515551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.516403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.517012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.517513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.531822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.532250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.540194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.540710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.541188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.541940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.542437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.542901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.554966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.555456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.555900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.556352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lazy-loading 'fault' on Instance uuid bd2db057-71f8-4c37-bfcf-eefae40a8764 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:58.599135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e643d2a39441cda1035502d08d909a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9175f0f4d204936aed9f62d91c141f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.608407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-85ba36e6-dde0-45c8-9b4e-7a363a533c43 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 200 len: 1311 microversion: 2.1 time: 0.106698 Sep 03 21:00:58.609376 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1551/3233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:58.614382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.615026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.618406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:58.623549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-27954351-ac7c-4072-a781-3320435bd9b7 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095987 Sep 03 21:00:58.623717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.624290 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1683/3234] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:00:58.624414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.624810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.625562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.626032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.626469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.662437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.662928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.663446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.663889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lazy-loading 'fault' on Instance uuid 62378b14-092c-4ea1-96ba-ef6ff2f76099 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:00:58.734975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.743390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.745037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:58.746255 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2484904-bce9-4097-9562-00448f9784b5 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 200 len: 1367 microversion: 2.47 time: 0.135672 Sep 03 21:00:58.746805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1552/3235] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 1367 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:00:58.938474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:58.939094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:58.946866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.947889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.948484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:58.949253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:58.949755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:58.950834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.107404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:59.116795 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2b13c17-d4c5-445e-97e1-5344ae847cd9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.182322 Sep 03 21:00:59.118068 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1684/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:58 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:59.177196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.177968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: e6d09915-197d-436d-9e4e-1d16d7efbc4c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.189460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.194959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.196480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.197658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.199052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.199843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.229026 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c HTTP/1.1 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e6d09915-197d-436d-9e4e-1d16d7efbc4c'} Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.230958 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. Sep 03 21:00:59.235966 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.237737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance e6d09915-197d-436d-9e4e-1d16d7efbc4c could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:59.238767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-684a518a-a742-4abc-9323-90f4aaff0550 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c" status: 404 len: 111 microversion: 2.1 time: 0.073341 Sep 03 21:00:59.239503 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1553/3237] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:59 2022] GET /compute/v2.1/servers/e6d09915-197d-436d-9e4e-1d16d7efbc4c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:59.247932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f92d3305-3532-4812-9851-b521bd915a61 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.279912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f92d3305-3532-4812-9851-b521bd915a61 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/3a315ac1-45b1-4cba-943a-ad1ad1273ce6" status: 204 len: 0 microversion: 2.1 time: 0.036234 Sep 03 21:00:59.280732 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1685/3238] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 21:00:59 2022] DELETE /compute/v2.1/os-server-groups/3a315ac1-45b1-4cba-943a-ad1ad1273ce6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:00:59.288715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.289230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.296734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.297276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.297726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.298441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.298903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.301487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.344515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:59.377205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:59.455280 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8c2e3f1-0a75-484c-b815-c7921b264eac tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 204 len: 0 microversion: 2.1 time: 0.170369 Sep 03 21:00:59.455873 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1554/3239] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:59 2022] DELETE /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:00:59.471409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.472170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.479978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.480744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.482050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.482920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.483532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.484115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.510302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:59.515984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.516724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.523395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.523888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.524559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.525311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.525769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.526198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.591636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-35f835e0-3db4-42f4-a645-29f58c1dff70 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 204 len: 0 microversion: 2.1 time: 0.131301 Sep 03 21:00:59.592792 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1686/3240] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:00:59 2022] DELETE /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:00:59.603389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.609938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.617818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.618685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.619145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.620331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.620987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.621634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.769748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:59.778746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28d4ad37-a6d1-4eaf-b8af-4e1dde7bd14a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1472 microversion: 2.1 time: 0.180846 Sep 03 21:00:59.779789 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1687/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:59 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:00:59.784486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.785193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] [instance: bd2db057-71f8-4c37-bfcf-eefae40a8764] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.791159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.791850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.792289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.793219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.793679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.794876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.808780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] HTTP exception thrown: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Request method failure captured: Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 HTTP/1.1 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BSwLC7DkimL61J4cuu7NbQgBXH-qLGqXtOFwijX7FDaYBE39z2xYjFbP6gxbDUxX6gFssOvxFZnXc581tvtaxbIFa6RNJwkqy9-qVUU3m7YEL66Qa-1Lhw_sZGt_G7wpTyWgI9u-9P3atmuICGVGkhVmERnZwd2Tv870DOUWo1GaE Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f9175f0f4d204936aed9f62d91c141f0 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9175f0f4d204936aed9f62d91c141f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f9175f0f4d204936aed9f62d91c141f0 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2027940113 Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-2027940113-project Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: a1e643d2a39441cda1035502d08d909a Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2027940113-project Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'bd2db057-71f8-4c37-bfcf-eefae40a8764'} Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.810563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] Returning 404 to user: Instance bd2db057-71f8-4c37-bfcf-eefae40a8764 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-efc1b800-5b18-45ce-b2e0-aa89ab212eb9 tempest-ServersAdminNegativeTestJSON-2027940113 tempest-ServersAdminNegativeTestJSON-2027940113-project] 10.222.0.16 "GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764" status: 404 len: 111 microversion: 2.1 time: 0.031071 Sep 03 21:00:59.815546 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1688/3242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:59 2022] GET /compute/v2.1/servers/bd2db057-71f8-4c37-bfcf-eefae40a8764 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:00:59.817551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.818165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 62378b14-092c-4ea1-96ba-ef6ff2f76099] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.824137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.825015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.825472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.826167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.826804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.827594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.847676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] HTTP exception thrown: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Request method failure captured: Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 HTTP/1.1 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BZas8rfGWPg9r5TB-5-WLCR85httja8FoltR5SlFqTMNC-Iybje-5XyxDw2VA0PTH46z5O80HgiwS43XmCF1halLWhCj3J7Z1VrVV-ApRt5CJjoip_fcNqc6X_SpBBGsx0kmJjQRJfMxf5Js52qllb9eVHImpafHXaYQUdzU4osjI Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.47 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7eef34f8ef5e4e73802caff2f4e5a023 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerShowV247Test-1645950448 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerShowV247Test-1645950448 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7eef34f8ef5e4e73802caff2f4e5a023 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerShowV247Test-1645950448 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerShowV247Test-1645950448-project Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3db58915ddb1452490f90c8f2a583220 Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerShowV247Test-1645950448-project Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '62378b14-092c-4ea1-96ba-ef6ff2f76099'} Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:00:59.849253 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Returning 404 to user: Instance 62378b14-092c-4ea1-96ba-ef6ff2f76099 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-789e60ce-c43d-42fd-ad66-fc526af6fb5b tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099" status: 404 len: 111 microversion: 2.47 time: 0.036696 Sep 03 21:00:59.855201 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1689/3243] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:00:59 2022] GET /compute/v2.1/servers/62378b14-092c-4ea1-96ba-ef6ff2f76099 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:00:59.860605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:00:59.861178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:00:59.867477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.868229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.869001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.869736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:00:59.870202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:00:59.870636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:00:59.899539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:00:59.956273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:00:59.969686 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9358bc62-e585-4587-ae89-aee89b9c8296 tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1510 microversion: 2.1 time: 0.457974 Sep 03 21:00:59.970423 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1555/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:00:59 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:00.010394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ba12006-705d-407b-b4d1-fbe8e6f9c595 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825" status: 204 len: 0 microversion: 2.47 time: 0.153771 Sep 03 21:01:00.011520 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1690/3245] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:00:59 2022] DELETE /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:01:00.027254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:00.029105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:00.038491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.038992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.039436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.040153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.040613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.041175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.143838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:00.144566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:00.151761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.152266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.152719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.154265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.154735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.155348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.570108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:00.582550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:00.586443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:00.587747 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9cbabcd4-7d15-499c-b558-424d44317e01 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825" status: 200 len: 1362 microversion: 2.47 time: 0.571985 Sep 03 21:01:00.588314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1556/3246] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:00 2022] GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:00.611020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d132783-c4a8-4417-9154-352e292056a0", "name": "network-vif-plugged", "status": "completed", "tag": "fe35b4c2-173b-4a1b-8d04-3581619f06e8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:00.634456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.635310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.648843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.678079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] Creating event network-vif-plugged:fe35b4c2-173b-4a1b-8d04-3581619f06e8 for instance 5d132783-c4a8-4417-9154-352e292056a0 on nch1-master-1 Sep 03 21:01:00.678914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:00.687484 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-30e9310f-89aa-4ec7-ad39-d454f8d87459 req-a37de052-fa94-4541-86dd-8fa4373dceef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092790 Sep 03 21:01:00.688488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1557/3247] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:00.689881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-be3dc8da-ec04-415b-9b21-c3f0362cef93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.550273 Sep 03 21:01:00.691084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1691/3248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:00 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:00.795117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:00.796027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:00.801874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44248bd8-d4ef-4152-9118-df5b56ff43d9", "tag": "239bbbee-9280-4147-9d2e-62064fc60a52"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:00.803866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.804576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.805350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.806457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.807500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.808422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.815570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.816363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.817236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.832214 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] Creating event network-changed:239bbbee-9280-4147-9d2e-62064fc60a52 for instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 on nch1-master-1 Sep 03 21:01:00.839580 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cf7aecf3-d79e-4b91-a706-129ea329d263 req-d78c4197-d223-419d-af76-b5d73a73aeef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042234 Sep 03 21:01:00.841331 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1692/3249] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:01:00.847850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:00.849153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:00.857147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.857970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.858826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:00.859745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:00.860508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:00.861290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.044210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.052303 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49739e4e-2af9-4173-a2cb-e3dfed503ce3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1472 microversion: 2.1 time: 0.209100 Sep 03 21:01:01.052884 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1693/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:00 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1472 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:01.053212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.063319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:01.063857 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5062fe3-cd6d-4253-aeb1-02a23eff9179 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1591 microversion: 2.1 time: 0.273398 Sep 03 21:01:01.064161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:01.064442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1558/3251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:00 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1591 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:01.074380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.074380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.074380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.074957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.076286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.076843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.226141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa304e40e3894910be1a5e1e97a34b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '630205311fc04912910e56076899f18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.238228 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a75a6af9-5bd5-4777-ab7a-6fff0196b55f tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 200 len: 1468 microversion: 2.1 time: 0.179934 Sep 03 21:01:01.238830 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1694/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:01 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 1468 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:01.615214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:01.615704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:01.628817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.629718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.630415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.631865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.632334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.632774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.719081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:01.723465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:01.726370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.732815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.736020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.736470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.736593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.737997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3db58915ddb1452490f90c8f2a583220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eef34f8ef5e4e73802caff2f4e5a023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.738905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:01.739175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eca80615-2949-4631-aa98-47c99a517263 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825" status: 200 len: 1362 microversion: 2.47 time: 0.129018 Sep 03 21:01:01.739688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:01.740446 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1559/3253] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:01 2022] GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 => generated 1362 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:01.741182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:01.967442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:01.975862 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21d89974-6a6b-4deb-8b0c-23d315c189ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.265187 Sep 03 21:01:01.992888 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1695/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:01 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:02.075752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:02.076652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:02.085863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.086552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.087144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.088027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.092977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.093624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.279336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:02.281253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] [instance: 10116344-8967-46c4-ad23-ab769cb073dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:02.295740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.296319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.297492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.299273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.300083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.300741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.307899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:02.318352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ce63c16-f842-4b01-afd4-dcfa6fc08708 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1472 microversion: 2.1 time: 0.247057 Sep 03 21:01:02.320033 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1560/3255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:02 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:02.338491 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] HTTP exception thrown: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Request method failure captured: Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc HTTP/1.1 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8BL0XE951AR_Oz0GKjZMh5Cl3G3aYYc85iwSf84jOUrlbGf_52WvAbBWNWk6RoNhOujHAX3ONZrPXIXvhsLsETbX18yqgxYB4JnQbX7A9rJJwc6Bjg1vgczsh6GSk_vMqO_rMMvIvzwIga-tJZSTINErDStUM1vI7r4RoF_8EoAjgg Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 630205311fc04912910e56076899f18d Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1552928113 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/630205311fc04912910e56076899f18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_630205311fc04912910e56076899f18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/630205311fc04912910e56076899f18d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/630205311fc04912910e56076899f18d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1552928113 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 630205311fc04912910e56076899f18d Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1552928113 Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueTestJSONUnderV235-1552928113-project Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: fa304e40e3894910be1a5e1e97a34b1a Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1552928113-project Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '10116344-8967-46c4-ad23-ab769cb073dc'} Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.340845 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] Returning 404 to user: Instance 10116344-8967-46c4-ad23-ab769cb073dc could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7c471f0-1fe3-41b9-851a-c6793677cd9c tempest-ServerRescueTestJSONUnderV235-1552928113 tempest-ServerRescueTestJSONUnderV235-1552928113-project] 10.222.0.16 "GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc" status: 404 len: 111 microversion: 2.1 time: 0.082606 Sep 03 21:01:02.344715 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1696/3256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:02 2022] GET /compute/v2.1/servers/10116344-8967-46c4-ad23-ab769cb073dc => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:01:02.766532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:02.767166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] [instance: 5108ddc6-5a96-4b25-8e6e-62c0754da825] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:02.773934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.774734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.775431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.776374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.777096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.777898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.796645 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] HTTP exception thrown: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Request method failure captured: Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 HTTP/1.1 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8BZas8rfGWPg9r5TB-5-WLCR85httja8FoltR5SlFqTMNC-Iybje-5XyxDw2VA0PTH46z5O80HgiwS43XmCF1halLWhCj3J7Z1VrVV-ApRt5CJjoip_fcNqc6X_SpBBGsx0kmJjQRJfMxf5Js52qllb9eVHImpafHXaYQUdzU4osjI Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.47 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7eef34f8ef5e4e73802caff2f4e5a023 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerShowV247Test-1645950448 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7eef34f8ef5e4e73802caff2f4e5a023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerShowV247Test-1645950448 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7eef34f8ef5e4e73802caff2f4e5a023 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerShowV247Test-1645950448 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerShowV247Test-1645950448-project Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3db58915ddb1452490f90c8f2a583220 Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerShowV247Test-1645950448-project Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5108ddc6-5a96-4b25-8e6e-62c0754da825'} Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:02.798999 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. Sep 03 21:01:02.802848 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:02.804524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] Returning 404 to user: Instance 5108ddc6-5a96-4b25-8e6e-62c0754da825 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:02.805678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3f8c3bde-0e76-4ed5-b639-8f8bf1043391 tempest-ServerShowV247Test-1645950448 tempest-ServerShowV247Test-1645950448-project] 10.222.0.16 "GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825" status: 404 len: 111 microversion: 2.47 time: 0.043268 Sep 03 21:01:02.806759 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1561/3257] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:02 2022] GET /compute/v2.1/servers/5108ddc6-5a96-4b25-8e6e-62c0754da825 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:01:02.889277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10116344-8967-46c4-ad23-ab769cb073dc", "name": "network-vif-deleted", "tag": "a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:02.901394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:02.901899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:02.902464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:02.924872 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] Creating event network-vif-deleted:a4f4c371-c7c2-4b86-b0f9-aacb5bb19e54 for instance 10116344-8967-46c4-ad23-ab769cb073dc on nch2-master-1 Sep 03 21:01:02.936755 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9cfefb14-2cff-41fe-85ca-0f03ffe91293 req-29f6706d-1704-4bdb-a709-77a5670c83a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051842 Sep 03 21:01:02.937408 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1697/3258] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:02.999977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:03.000716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:03.013655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:03.014424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:03.015042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:03.015936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:03.017654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:03.018385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:03.346446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:03.347797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:03.354436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:03.354928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:03.355933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:03.356951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:03.357632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:03.358278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:03.361066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:03.377297 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9798d6f0-7fdd-4225-8367-ceb179b39e36 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.380828 Sep 03 21:01:03.378559 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1562/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:02 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:03.817068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:03.829528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:03.837329 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1aa8220f-a0b9-4fa4-a055-3a07ff74d187 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1472 microversion: 2.1 time: 0.495190 Sep 03 21:01:03.838450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1698/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:03 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:04.113277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc74374f-f448-47a6-b7d1-643804422c02", "name": "network-vif-deleted", "tag": "9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:04.142482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.143227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.143865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.156060 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] Creating event network-vif-deleted:9c8a1f86-8e32-4d27-b41a-dcb5d2ec6e86 for instance dc74374f-f448-47a6-b7d1-643804422c02 on nch1-master-1 Sep 03 21:01:04.161332 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-77184598-88a7-4069-ba83-c5c278e78477 req-fa0095e2-2419-406e-bd9c-cb9d0fd2cc09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052230 Sep 03 21:01:04.162483 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1563/3261] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:04.402649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:04.405157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:04.420408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:04.426837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.427776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.429823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.431010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.433560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.434253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.521088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:04.865817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:04.867092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:04.880310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.881489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.883603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.885417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.886139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.888388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.937240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:04.945921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c16ac244-9918-49b8-a867-0a87318bf5c9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1522 microversion: 2.1 time: 0.548240 Sep 03 21:01:04.949606 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1699/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:04 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:04.969338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:04.970104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:04.970970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:04.971596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid dc74374f-f448-47a6-b7d1-643804422c02 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:05.198808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:05.223910 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd283fb2-7100-4975-bac6-7ae87c6b9e21 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 200 len: 1307 microversion: 2.1 time: 0.362563 Sep 03 21:01:05.226893 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1564/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:04 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 1307 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:05.972569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:05.973226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:05.980082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:05.980587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:05.988808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:05.988808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:05.988808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:05.988808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.219169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54311cf4-3843-466c-819b-366c0e7f1809", "name": "network-vif-deleted", "tag": "fdf02620-cbc6-4d25-8409-7e73d58d6188"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:06.242679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.245031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.245981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.273858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] Creating event network-vif-deleted:fdf02620-cbc6-4d25-8409-7e73d58d6188 for instance 54311cf4-3843-466c-819b-366c0e7f1809 on nch1-master-1 Sep 03 21:01:06.275553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:06.283264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-793db6c2-8c82-4508-94e0-fd99835ed124 req-43655e7f-509f-4abb-a109-174b7142b6e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072185 Sep 03 21:01:06.285541 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1565/3264] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:06.295212 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b609d0c3-8662-4047-95eb-41aec6147c93 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1507 microversion: 2.1 time: 0.326824 Sep 03 21:01:06.296173 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1700/3265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:05 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:06.300192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:06.301965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: dc74374f-f448-47a6-b7d1-643804422c02] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:06.310396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.311118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.311736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.319560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:06.320370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:06.334465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.335148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.338008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.343063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.343063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.343482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.344212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.344665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.345158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.378839 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 HTTP/1.1 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'dc74374f-f448-47a6-b7d1-643804422c02'} Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:06.384242 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance dc74374f-f448-47a6-b7d1-643804422c02 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:06.389637 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b38c5382-e17d-46bd-a645-b26b11b5dc1f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02" status: 404 len: 111 microversion: 2.1 time: 0.098088 Sep 03 21:01:06.402949 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1566/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:06 2022] GET /compute/v2.1/servers/dc74374f-f448-47a6-b7d1-643804422c02 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:06.711806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1983164892", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:06.822045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:06.823672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:06.826054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:06.826579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:06.827272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:06.851099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.852758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.856065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.858745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.860636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.862927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.884469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:06.899193 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-204bb8f2-2af3-4e00-9cf4-7ad96e8f59b1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 200 len: 1507 microversion: 2.1 time: 0.585179 Sep 03 21:01:06.900101 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1701/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:06 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 1507 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:06.916944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:06.917823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: 54311cf4-3843-466c-819b-366c0e7f1809] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:06.927962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Getting quotas for project b9b0f161c27a4b83865404bc57c99eca. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:06.929892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.930619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.931230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.932124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.932752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:06.939103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:06.946357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Getting quotas for user 7d240c36223b49cbb24e51bcb061a040 and project b9b0f161c27a4b83865404bc57c99eca. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:06.964374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 HTTP/1.1 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '54311cf4-3843-466c-819b-366c0e7f1809'} Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:06.966147 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance 54311cf4-3843-466c-819b-366c0e7f1809 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb2d91cb-e73d-4237-9b47-0fed375fe038 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809" status: 404 len: 111 microversion: 2.1 time: 0.066383 Sep 03 21:01:06.970394 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1702/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:06 2022] GET /compute/v2.1/servers/54311cf4-3843-466c-819b-366c0e7f1809 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:06.985209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:06.985784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:06.986551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:06.990315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:06.996675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:06.997775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.004401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.005271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:07.005763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.006211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.057122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:07.119605 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb72f63e-2121-4b09-af2d-d6b24427c915 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.701217 Sep 03 21:01:07.121320 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1567/3269] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:01:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:01:07.135678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1da0a00e-0a13-4a9e-a3ca-9ffee617c99f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:07.197323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:07.255369 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00505a32-82d9-4b41-a417-1d983b115f73 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 204 len: 0 microversion: 2.1 time: 0.286012 Sep 03 21:01:07.258684 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1703/3270] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:06 2022] DELETE /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:07.264358 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1da0a00e-0a13-4a9e-a3ca-9ffee617c99f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/66e52705-5c0b-448d-a7f7-678d58b2e2e5" status: 204 len: 0 microversion: 2.1 time: 0.139015 Sep 03 21:01:07.265124 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1568/3271] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Sep 3 21:01:07 2022] DELETE /compute/v2.1/os-server-groups/66e52705-5c0b-448d-a7f7-678d58b2e2e5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:07.274870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:07.278722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:07.283536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:07.290189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:07.300681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:07.301877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.302783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.304713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:07.304974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.305692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.334518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:07.480092 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-675ed2d2-b4df-4631-bbaf-bfb0d5f6f0ba tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 204 len: 0 microversion: 2.1 time: 0.209868 Sep 03 21:01:07.482618 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1569/3272] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:07 2022] DELETE /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:07.493329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:07.494422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:07.503639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:07.504838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.506585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.507667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:07.509011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:07.509891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:07.567184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:07.581401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:07.587981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:07.591117 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6127165d-634a-419b-b03d-dbd04a26179a tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1278 microversion: 2.54 time: 0.327298 Sep 03 21:01:07.591706 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1704/3273] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:07 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:07.633444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1738503944", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "997056ce-178c-47cb-9487-493aaba31e81"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:07.742577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] validate_networks() for [('997056ce-178c-47cb-9487-493aaba31e81', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:07.928095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:07.941470 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95baed69-4c99-4f10-b375-acf625a751b8 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1470 microversion: 2.1 time: 0.453143 Sep 03 21:01:07.943588 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1570/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:07 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:08.623103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:08.624714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:08.636348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:08.637786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:08.640197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:08.641253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:08.642609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:08.643888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:08.829142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:08.844167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:08.849606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:08.852541 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a6e4b4a-304e-4950-9dde-4785c4a48f51 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1330 microversion: 2.54 time: 0.235421 Sep 03 21:01:08.854540 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1571/3275] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:08 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1330 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:08.969147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:08.970088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:08.977954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:08.978809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:08.979512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:08.980410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:08.981093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:08.982566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:08.989515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:09.288586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:09.299421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6932f78-5dce-47d4-a962-0919a5f37e27 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1470 microversion: 2.1 time: 0.335187 Sep 03 21:01:09.300024 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1572/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:08 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:09.326055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:09.326500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:09.327091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:09.327690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:09.328283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:09.341862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:09.342432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:09.342895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:09.344271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:09.344780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:09.345258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:09.438509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:09.461049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Getting quotas for user 859a4503b4d84a4e8c3213e2de02492d and project 18ae2766f0674492909ede79ed1832d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:09.491654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:09.495063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:09.603836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aec5f7b4-c74b-4c9e-ad93-9795b8d1d217 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.975004 Sep 03 21:01:09.607993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1705/3277] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:01:09.615780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43c7a92f-af3b-40f1-95ff-bf1196fe5255 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:09.616413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-43c7a92f-af3b-40f1-95ff-bf1196fe5255 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:09.882917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:09.884397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:09.899890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:09.901464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:09.918356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:09.920811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:09.923102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:09.924659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:10.115396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:10.145192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:10.147134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:10.152563 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6f2d1686-8806-4177-be03-0f3e409997cc tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1336 microversion: 2.54 time: 0.275450 Sep 03 21:01:10.169153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1706/3278] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:09 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1336 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:10.324379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:10.325076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:10.331584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:10.332235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:10.332765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:10.333725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:10.334406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:10.334906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:10.339789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-43c7a92f-af3b-40f1-95ff-bf1196fe5255 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:10.349191 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-43c7a92f-af3b-40f1-95ff-bf1196fe5255 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1218 microversion: 2.1 time: 0.737354 Sep 03 21:01:10.349877 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1573/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:09 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1218 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:10.526540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:10.537611 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-89b6d4bf-880b-4f46-8c2d-1d4d3fc33f7a tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1470 microversion: 2.1 time: 0.217082 Sep 03 21:01:10.554555 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1707/3280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:10 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:11.181390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:11.182900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:11.212205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.213028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.213645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.214568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.215036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.216137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.339351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:11.373954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:11.375266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:11.386421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.389289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:11.391006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.392155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.402812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.404599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.405976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:11.406866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.409053 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6efefbce-7655-4d2b-b36e-f7aeb200f6f5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1336 microversion: 2.54 time: 0.232951 Sep 03 21:01:11.416126 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1574/3281] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:11 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1336 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:11.564063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:11.564697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:11.574536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:11.578669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.579473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.580145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.581180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.582177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.582821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.592746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5620101-81ed-4a28-aa9c-96200df97c8e tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1270 microversion: 2.1 time: 0.218302 Sep 03 21:01:11.613173 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1708/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:11 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:11.813485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d9ba95-551c-4316-94bb-bb83ba4bd615", "name": "network-vif-deleted", "tag": "2773b822-6a18-4e34-8b3f-43fc3cb4c804"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:11.818718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:11.829080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:11.829580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:11.830030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:11.852066 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f099e879-79ef-4f31-b4c1-61d1d19b753f tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1428 microversion: 2.1 time: 0.290778 Sep 03 21:01:11.857178 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] Creating event network-vif-deleted:2773b822-6a18-4e34-8b3f-43fc3cb4c804 for instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 on nch1-master-1 Sep 03 21:01:11.863993 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1575/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:11 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1428 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:11.871622 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-00082af2-aa0f-4d68-ae1a-cc3802c70daf req-d05dbf11-5674-41e0-8e2b-5ac5def6ec2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064831 Sep 03 21:01:11.876208 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1709/3284] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 03 21:01:12.147246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d132783-c4a8-4417-9154-352e292056a0", "name": "network-vif-deleted", "tag": "fe35b4c2-173b-4a1b-8d04-3581619f06e8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:12.166150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.169932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.173059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.218646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] Creating event network-vif-deleted:fe35b4c2-173b-4a1b-8d04-3581619f06e8 for instance 5d132783-c4a8-4417-9154-352e292056a0 on nch1-master-1 Sep 03 21:01:12.234801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bffdf764-4309-450b-8428-90a2534072aa req-2f3d1e91-7888-4ec1-8263-fb9042d0c5f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091631 Sep 03 21:01:12.238143 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1576/3285] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:12.442294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:12.445187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:12.459206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.463057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.465067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.467402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.469738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.470401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.622459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:12.623842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:12.631492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.632706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.633577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.635029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.635672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.636560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.721918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:12.758620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:12.768386 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa2fc1b3-2c4d-4494-9bcb-647eb2dd049c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1276 microversion: 2.1 time: 0.151364 Sep 03 21:01:12.770040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:12.773119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:12.778309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49f1a32d-9635-46e5-b3e7-b90e85b31a6e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1357 microversion: 2.54 time: 0.340329 Sep 03 21:01:12.780603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1710/3286] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:12 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1357 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:12.785525 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1577/3287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:12 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:12.815120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9308fc2b-f2a7-40f0-9dbb-a072a5cf99bb tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Action: 'create', calling method: .version_select at 0x7fae66a27550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-68425291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBz06pWtTpQt3R0pcO2ygM78KCBXM3ES9CWZtDpk8LWzMKnLmAdRRkmYaGKMHtCRhpEvHtb4Lhexh6bfByNU7UY+xrtK42zNBM3EFu3NuYkQu11kP8+XbJfj+4t2Z1CZg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:12.855581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9308fc2b-f2a7-40f0-9dbb-a072a5cf99bb tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Getting quotas for project b9b0f161c27a4b83865404bc57c99eca. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:12.867636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9308fc2b-f2a7-40f0-9dbb-a072a5cf99bb tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Getting quotas for user 7d240c36223b49cbb24e51bcb061a040 and project b9b0f161c27a4b83865404bc57c99eca. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:12.885018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:12.885888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:12.899751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.900666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.901365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.902354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.903132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.903945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.925535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9308fc2b-f2a7-40f0-9dbb-a072a5cf99bb tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.117307 Sep 03 21:01:12.926823 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1711/3288] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 21:01:12 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 21:01:12.938311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-68425291", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:12.941641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:12.955495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.962683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.963292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.964155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.964821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.965470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.976070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:12.982350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:12.983125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:12.983814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lazy-loading 'fault' on Instance uuid b4d9ba95-551c-4316-94bb-bb83ba4bd615 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:13.080297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:13.080828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:13.081450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:13.085259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6970a72952e4d4a8f26e0f8ee23f364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2f3c186f88497181cf6a1d806631b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:13.089445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:13.094633 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e67e8a9-e709-4c39-a9cb-e6f8553e9d13 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 200 len: 1305 microversion: 2.1 time: 0.214039 Sep 03 21:01:13.096157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:13.100303 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1578/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:12 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 1305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:13.339222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:13.364409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.368048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.368538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.370775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.373188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.373663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.479435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-adc406c5-98e0-4d85-b9bb-a00eb599ea04 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "POST /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d/action" status: 202 len: 1138 microversion: 2.54 time: 0.545477 Sep 03 21:01:13.497316 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1712/3290] 10.222.0.16 () {62 vars in 1320 bytes} [Sat Sep 3 21:01:12 2022] POST /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d/action => generated 1138 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 03 21:01:13.506720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:13.507576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:13.526145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.528724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.529338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.530329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.538985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.539928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.725957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:13.736597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:13.743019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:13.745680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e170bfc7-b9a0-4037-9ae6-739b3ed8ecf3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.243546 Sep 03 21:01:13.752819 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1579/3291] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:13 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:13.799184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:13.800485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:13.814307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.815000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.816089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.818477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:13.819165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:13.820281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:13.990903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:14.002906 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-524a1225-e4d7-42f3-9753-1820d6afc8f4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1276 microversion: 2.1 time: 0.211678 Sep 03 21:01:14.017609 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1713/3292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:13 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:14.122792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:14.125953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] [instance: b4d9ba95-551c-4316-94bb-bb83ba4bd615] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:14.142631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:14.143508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:14.144119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:14.144848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:14.145340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:14.145776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:14.183246 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] HTTP exception thrown: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Request method failure captured: Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 HTTP/1.1 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE7_ZuuUd4XYoeLdGV8JcuC6j9AnX9cjyg_7mTz8dSygMqcMaXWpMvZPgCKb90QUP020RUQUWjiA0m01ASvXv6hMm7_zQRjysf9VgqgMBBCGYCcFDHiVq6-mgMecp6Dl5xr0x4rvSXHY9jYsfbptsr8xjVC0ZZFA-HoeYzerUuArkghk Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a2f3c186f88497181cf6a1d806631b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 5a2f3c186f88497181cf6a1d806631b1 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1875768737 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e6970a72952e4d4a8f26e0f8ee23f364 Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersOnMultiNodesTest-1875768737-project Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b4d9ba95-551c-4316-94bb-bb83ba4bd615'} Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:14.187356 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] Returning 404 to user: Instance b4d9ba95-551c-4316-94bb-bb83ba4bd615 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:14.192766 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de30de2e-79eb-4c3d-b391-b3444d2715a3 tempest-ServersOnMultiNodesTest-1875768737 tempest-ServersOnMultiNodesTest-1875768737-project] 10.222.0.16 "GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615" status: 404 len: 111 microversion: 2.1 time: 0.069951 Sep 03 21:01:14.212889 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1580/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:14 2022] GET /compute/v2.1/servers/b4d9ba95-551c-4316-94bb-bb83ba4bd615 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:14.783877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:14.785811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:14.814427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:14.814926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:14.817354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:14.819216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:14.824026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:14.824496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:14.964691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:14.975938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:14.977295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:14.978624 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fb47091-a298-4180-8bc9-372f3c15d7f3 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.198950 Sep 03 21:01:14.979552 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1581/3294] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:14 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:15.010018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1547040651", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:15.031677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:15.033694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:15.047292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:15.065845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:15.067825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:15.068398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:15.069255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:15.069880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:15.071212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:15.131206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:15.131657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:15.132225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:15.132603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:15.133079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:15.150289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:15.157862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:15.158489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:15.159341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:15.159823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:15.160262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:15.213688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Getting quotas for project 75a128c413284fcb96ecbdb84d33c862. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:15.223200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Getting quotas for user 9abfaac1da5f41f7a522b009f8073ac8 and project 75a128c413284fcb96ecbdb84d33c862. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:15.246157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:15.249696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:15.308113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:15.319907 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8033d5e-2eb2-4bc2-b46c-9ae42276f975 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.293402 Sep 03 21:01:15.336606 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1582/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:15 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:15.361026 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e940ad6e-784d-488f-b3a3-3e1b18edc93d tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.607402 Sep 03 21:01:15.362910 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1714/3296] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:01:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:01:15.380953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:15.381738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:15.523825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:15.533694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:15.534946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:15.542731 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7ce69f8b-4832-48c7-9701-c0726cc5f815 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1278 microversion: 2.57 time: 0.172591 Sep 03 21:01:15.545243 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1583/3297] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:15 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:16.009367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:16.010813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:16.024456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.025238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.033068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.034523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.035796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.036624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.223871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:16.241077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:16.243263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:16.245850 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c33d714-3581-4f43-adac-ea9d67030de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.243954 Sep 03 21:01:16.263499 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1715/3298] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:16 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:16.344104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:16.347944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:16.355703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.357189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.357985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.359783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.360326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.361074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.574032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:16.577536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:16.588562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.589295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.589977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.591430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:16.592106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:16.592737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:16.598100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:16.692643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:16.706644 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bb8b8daf-95af-46dc-b854-746ea6b401ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.367138 Sep 03 21:01:16.708793 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1584/3299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:16 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:17.055967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42cf10b-db51-4389-9634-f8f2b2484a64", "tag": "44692aa4-cb69-47cb-9369-98380777f279"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:17.098703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:17.116815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:17.123777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:17.124488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:17.157785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.160537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] Creating event network-changed:44692aa4-cb69-47cb-9369-98380777f279 for instance c42cf10b-db51-4389-9634-f8f2b2484a64 on nch1-master-1 Sep 03 21:01:17.170321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.176538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.177458 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8b780ad1-7bb6-4fee-833e-363ea98930f2 req-02bf970d-302e-4b7a-aa66-f1f925bcfd12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127093 Sep 03 21:01:17.182715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae8e88b3-5091-4f38-a0d8-2bbf4677997b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1330 microversion: 2.57 time: 0.612254 Sep 03 21:01:17.183045 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1585/3300] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:17.197454 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1716/3301] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:16 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1330 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:17.280430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:17.281429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:17.305439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:17.306445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:17.306905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:17.307653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:17.308120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:17.314378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:17.432924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.444395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.446570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:17.448462 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11c782e0-d21a-47c7-ad4e-f9364a43aba9 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.174337 Sep 03 21:01:17.449606 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1586/3302] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:17 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:17.736970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:17.738717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:17.757500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:17.759464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:17.771747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:17.772557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:17.773078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:17.773530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:18.120271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.140476 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff887265-ff4d-44e0-9bc4-282a3ee7349f tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.412382 Sep 03 21:01:18.157926 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1717/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:17 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:18.213872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:18.223617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:18.239096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:18.239926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:18.240959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:18.241976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:18.242834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:18.243599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:18.422481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.442570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.444685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.446184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07b83f1d-1622-418d-9411-e14005278fde tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1336 microversion: 2.57 time: 0.236580 Sep 03 21:01:18.447233 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1587/3304] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:18 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:18.475338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:18.476224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:18.486704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:18.487503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:18.488188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:18.489147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:18.489822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:18.490329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:18.586041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.599176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.600649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:18.603430 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc4bffb8-e964-4dd8-be99-8d65982459ee tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.132519 Sep 03 21:01:18.609353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1718/3305] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:18 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:18.950380 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-352cd155-ccd6-4055-975c-12c39bed293e tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-02T21%3A01%3A18.771733&end=2022-09-04T21%3A01%3A18.771733" status: 404 len: 112 microversion: - time: 0.174661 Sep 03 21:01:18.956446 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1588/3306] 10.222.0.16 () {58 vars in 1316 bytes} [Sat Sep 3 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-02T21%3A01%3A18.771733&end=2022-09-04T21%3A01%3A18.771733 => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 21:01:18.965060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578edf63-805e-467a-a6b7-ec94d64ff036 tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] Calling method '.version_select at 0x7fae66936d30>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:18.973981 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-578edf63-805e-467a-a6b7-ec94d64ff036 tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578edf63-805e-467a-a6b7-ec94d64ff036 tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] Request method failure captured: Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-simple-tenant-usage/7d15750c4924457ca34c30658ecaa9a4?start=2022-09-04T21%3A01%3A18.771733&end=2022-09-02T21%3A01%3A18.771733 HTTP/1.1 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CeJJ32M5ZR80c96AEkntttsV6CuvrrXZ-U4v4sEfVykt5nCnn-lyOAyF_6JAQUyBDaRtTQ8IimpjdEmliTONeu4aN2akzlIgGBR6qiOTJSoz15jPquUCB8PUOyt2HM68LnQcg251sc1Ch7l3Fx9cv60y5OMI6kJrWVITsgtQQN0hM Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 94aa25977bd241e69033438537070864 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1555261791 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94aa25977bd241e69033438537070864"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94aa25977bd241e69033438537070864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94aa25977bd241e69033438537070864"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94aa25977bd241e69033438537070864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1555261791 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 94aa25977bd241e69033438537070864 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1555261791 Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 95183bf477a248a489ec81056e6f25ec Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid start time. The start time cannot occur after the end time. Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7d15750c4924457ca34c30658ecaa9a4'} Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 03 21:01:18.984386 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:18.989075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-578edf63-805e-467a-a6b7-ec94d64ff036 tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:18.989075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-578edf63-805e-467a-a6b7-ec94d64ff036 tempest-TenantUsagesNegativeTestJSON-1555261791 tempest-TenantUsagesNegativeTestJSON-1555261791-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/7d15750c4924457ca34c30658ecaa9a4?start=2022-09-04T21%3A01%3A18.771733&end=2022-09-02T21%3A01%3A18.771733" status: 400 len: 111 microversion: 2.1 time: 0.030176 Sep 03 21:01:18.989075 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1719/3307] 10.222.0.16 () {58 vars in 1412 bytes} [Sat Sep 3 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage/7d15750c4924457ca34c30658ecaa9a4?start=2022-09-04T21%3A01%3A18.771733&end=2022-09-02T21%3A01%3A18.771733 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:01:19.072713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-943972301", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "3a319c91-17bf-4587-bd66-d3e41c369cd6"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:19.149475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] validate_networks() for [('3a319c91-17bf-4587-bd66-d3e41c369cd6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:19.169594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7b982c76-5fee-4472-a2f8-3440e9cfa0df tempest-TenantUsagesNegativeTestJSON-1370584074 tempest-TenantUsagesNegativeTestJSON-1370584074-project] Calling method '.version_select at 0x7fae66803040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:19.173684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7b982c76-5fee-4472-a2f8-3440e9cfa0df tempest-TenantUsagesNegativeTestJSON-1370584074 tempest-TenantUsagesNegativeTestJSON-1370584074-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'a106e1a727b1489eb4ff5678c512b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15750c4924457ca34c30658ecaa9a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7b982c76-5fee-4472-a2f8-3440e9cfa0df tempest-TenantUsagesNegativeTestJSON-1370584074 tempest-TenantUsagesNegativeTestJSON-1370584074-project] Request method failure captured: Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-02T21%3A01%3A18.771733&end=2022-09-04T21%3A01%3A18.771733&detailed=1 HTTP/1.1 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CdgHXP_lyB0XhI1RVKV2F1mieaYTZnw6W2sWe0XxNMH5vUYraXkvDwtnT16om3Smjb96iRDR0_UQkwLyDQbP8nty0i7JdltSwsVa_eCE3qIrHrohDRYZhas3z8eimewDEOKNTXtYfpnKHUMMFera5IQjor3bTxUh62VF3yACbWG_M Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 7d15750c4924457ca34c30658ecaa9a4 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1370584074 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d15750c4924457ca34c30658ecaa9a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d15750c4924457ca34c30658ecaa9a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d15750c4924457ca34c30658ecaa9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d15750c4924457ca34c30658ecaa9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1370584074 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 7d15750c4924457ca34c30658ecaa9a4 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1370584074 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TenantUsagesNegativeTestJSON-1370584074-project Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: a106e1a727b1489eb4ff5678c512b481 Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1370584074-project Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: action_args: {} Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise self.value Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 03 21:01:19.175744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7b982c76-5fee-4472-a2f8-3440e9cfa0df tempest-TenantUsagesNegativeTestJSON-1370584074 tempest-TenantUsagesNegativeTestJSON-1370584074-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:19.179657 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7b982c76-5fee-4472-a2f8-3440e9cfa0df tempest-TenantUsagesNegativeTestJSON-1370584074 tempest-TenantUsagesNegativeTestJSON-1370584074-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-02T21%3A01%3A18.771733&end=2022-09-04T21%3A01%3A18.771733&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.182057 Sep 03 21:01:19.183121 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1589/3308] 10.222.0.16 () {58 vars in 1335 bytes} [Sat Sep 3 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-02T21%3A01%3A18.771733&end=2022-09-04T21%3A01%3A18.771733&detailed=1 => generated 123 bytes in 188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:19.188965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:19.189794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:19.197720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.198650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.199343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.200319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.201026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.201675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.623064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:19.639210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b3caf760-9cca-41de-8670-a291b7cb06ba tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.454948 Sep 03 21:01:19.640227 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1590/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:19 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:19.655472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:19.656363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:19.671818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.672781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.673447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.675612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.676272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.676876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.825700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:19.837161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:19.839201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:19.840670 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5fdb44d-6705-43e3-98b0-e637b6678a3c tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1357 microversion: 2.57 time: 0.197454 Sep 03 21:01:19.857914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1591/3310] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:19 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:19.868772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:19.869706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:19.870184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:19.870614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:19.871038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:19.871376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:19.871590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:19.878621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.879360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.880220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.881414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.882046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.882646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.882772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.883152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.883601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.885072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:19.885543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:19.885979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:19.912765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for project b0fbc0c573fc45b58137b43959b57034. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:19.918347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Getting quotas for user 50bba3c790c44425a9786b8d1404df28 and project b0fbc0c573fc45b58137b43959b57034. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:19.932174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:19.934707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:19.986539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04b653d5-02d6-4a91-a9fd-99c0bc37519c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919479 Sep 03 21:01:19.993498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1720/3311] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:01:19.999117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:20.002523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:20.010419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.011374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.012009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.012767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.013423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.013857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.015115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.023732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.025236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.026430 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b7efd08e-52e9-4eb1-a801-6dcbd750a939 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.167397 Sep 03 21:01:20.027009 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1592/3312] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:19 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:20.037827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c330e988-8c29-4764-888f-772e0fb513a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:20.038525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c330e988-8c29-4764-888f-772e0fb513a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:20.145144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:20.158591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:20.159354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:20.160172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:20.160746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:20.161365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:20.180852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c330e988-8c29-4764-888f-772e0fb513a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.192692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c330e988-8c29-4764-888f-772e0fb513a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1217 microversion: 2.1 time: 0.158610 Sep 03 21:01:20.193321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1593/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:20 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:20.243033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:20.249721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.250338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.250721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.251436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.252048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.252549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.296627 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28b7b861-16ff-42d1-8c7d-c64725aae506 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "POST /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63/action" status: 202 len: 1138 microversion: 2.57 time: 0.301831 Sep 03 21:01:20.297307 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1721/3314] 10.222.0.16 () {62 vars in 1320 bytes} [Sat Sep 3 21:01:19 2022] POST /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63/action => generated 1138 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 03 21:01:20.321142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:20.321794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:20.341798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.342303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.342753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.344124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.344124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.344414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.448992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.461522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.463826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.467439 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5c928ef-41e7-48ac-b04a-abfe5874ae74 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.150187 Sep 03 21:01:20.468292 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1594/3315] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:20 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:20.668987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:20.669883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:20.678748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.679583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.680545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.681562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:20.682228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:20.682910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:20.955038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:20.973814 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58ae7325-8ad0-4dc1-97a9-6e9f16af41c1 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.305544 Sep 03 21:01:20.974603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1722/3316] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:20 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:21.061131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:21.062506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:21.075749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.082401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.082901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.084295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.085272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.089644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.154324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:21.230245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:21.231797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:21.256396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.257039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.257814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.258585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.259054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.259486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.275670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.300077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.301587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.305332 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6a747ca-8cc3-41fd-b388-5fd5a2bfe63e tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.249291 Sep 03 21:01:21.306489 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1595/3317] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:21 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:21.456821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.469881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6dd1397-4291-480b-acb0-a143828a773c tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1213 microversion: 2.1 time: 0.242776 Sep 03 21:01:21.470399 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1723/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:21 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:21.500829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:21.504454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:21.516476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.520013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.522827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.523702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:21.524504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:21.525408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:21.664744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.698706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.700542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:21.702535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2ae8366-e625-4395-9d5d-8737c0b0bce2 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.212248 Sep 03 21:01:21.705722 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1596/3319] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:21 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:22.010546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:22.011863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:22.031514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.035085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.035872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.036789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.040451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.041143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.337785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:22.339064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:22.348539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.349282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.352953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.353946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.355014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.355691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.555121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:22.578101 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c4742cb4-1b95-424e-a985-565b5fda8d4c tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.582478 Sep 03 21:01:22.579107 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1724/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:21 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:22.599747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:22.601265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:22.616457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.617492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.633640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.634627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.636780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.639116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.669396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:22.685688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:22.691654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:22.692831 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e5382e4-b01f-44c2-95c2-10af01ecd343 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.361377 Sep 03 21:01:22.693612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1597/3321] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:22 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:22.733299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:22.734449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:22.759006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.760545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.761714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.763448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:22.768864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:22.774743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:22.788604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:22.798424 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a626d125-ae9a-41b1-b523-a874a80e70a3 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1275 microversion: 2.1 time: 0.217746 Sep 03 21:01:22.799750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1725/3322] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:22 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:23.029183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:23.038435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:23.039435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:23.049829 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2aad52e0-5b3c-4a06-ab15-f4c26c7a0918 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.311818 Sep 03 21:01:23.056785 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1598/3323] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:22 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:23.626513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:23.634668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:23.665850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:23.667749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:23.673202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:23.674795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:23.676269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:23.677414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:23.736620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:23.736620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:23.748152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:23.748654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:23.759679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:23.760488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:23.764561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:23.765046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:24.042909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.056980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.059344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.064192 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-313aaa92-248b-4e8c-9080-86b8cc225695 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.346131 Sep 03 21:01:24.082603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.085856 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1599/3324] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:23 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:24.095051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:24.096093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c38be737-7ddd-41cc-8e77-dddba8b37183 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.486820 Sep 03 21:01:24.097148 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1726/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:23 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:24.109308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:24.111333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:24.122938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:24.141060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:24.141803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:24.143368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:24.145858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:24.146308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:24.146745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:24.147376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:24.147533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:24.149450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:24.150433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:24.152388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:24.164137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:24.314376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.338793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.341573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.343181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74339c17-01a3-48cd-b9f6-10861cb7a89b tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.244800 Sep 03 21:01:24.343910 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1727/3326] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:24 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:24.650030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:24.661189 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-30b3b1fe-6e4d-45c1-a336-b09a5f79e625 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.573388 Sep 03 21:01:24.665074 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1600/3327] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:24 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:25.093284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:25.094138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:25.120458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:25.122369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:25.133855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.137898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.141720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.142543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.143781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.144425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.145053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.145711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.146182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.147048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.147528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.153237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.324269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.338231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.341944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.343187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b43d591-e04f-4042-b9fa-8ff76a9c3492 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.253969 Sep 03 21:01:25.350093 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1728/3328] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:25 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:25.381693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:25.382710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:25.396014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.398376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.400657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.402350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.405506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.406465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.503181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.513848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.516212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:25.518137 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a8f4331-3f3d-4821-b942-cd87b313bcf3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.142711 Sep 03 21:01:25.518897 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1729/3329] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:25 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:25.523985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42cf10b-db51-4389-9634-f8f2b2484a64", "name": "network-vif-plugged", "status": "completed", "tag": "44692aa4-cb69-47cb-9369-98380777f279"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:25.535320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.536090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.536933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.550925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] Creating event network-vif-plugged:44692aa4-cb69-47cb-9369-98380777f279 for instance c42cf10b-db51-4389-9634-f8f2b2484a64 on nch1-master-1 Sep 03 21:01:25.566814 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d65adefd-9600-4dfa-a88b-8863cd1ec22e req-83636a1e-e4f1-4d52-83b5-edd5840aa8ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036715 Sep 03 21:01:25.568243 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1730/3330] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:25.704364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:25.705168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:25.724241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.725057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.725674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:25.726582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:25.727328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:25.727928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:26.025942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.037951 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3dfb843a-cc94-4f23-b5fd-05f743599099 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.354422 Sep 03 21:01:26.044975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1731/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:25 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:26.241458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.258601 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cde582a3-dc35-4fed-bb98-366f9661cd99 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 1.142186 Sep 03 21:01:26.268135 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1601/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:25 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:26.377372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:26.378001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:26.388275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:26.388782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:26.397531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:26.398746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:26.399258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:26.399719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:26.551219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:26.552376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:26.562723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:26.565484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:26.565899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.566544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:26.568375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:26.571885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:26.573608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:26.581504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.587206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.591342 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-572abe3f-10e1-4911-95ab-e23c3989bc31 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.216646 Sep 03 21:01:26.592166 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1732/3333] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:26 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:26.852554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.872119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.875353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:26.877639 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cbce1c8-a819-4b20-8845-ec0937dd9ab4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.331006 Sep 03 21:01:26.892451 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1602/3334] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:26 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:27.055901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1261495a-d7e9-4093-ba15-936224a57d58", "tag": "64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:27.066534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:27.067239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:27.075768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.077273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.082366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.091428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.095153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.096024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:27.096174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.098406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.099764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.100682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.113797 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] Creating event network-changed:64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0 for instance 1261495a-d7e9-4093-ba15-936224a57d58 on nch1-master-1 Sep 03 21:01:27.138344 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a3474653-46dc-414b-9ca0-de8048b45578 req-80ae8d84-2642-4fa3-85db-630f749e2d8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085922 Sep 03 21:01:27.139465 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1733/3335] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:27.291128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:27.291977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:27.304467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.310173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.310822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.314441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.319071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.319659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.531303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:27.543860 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-141617fc-0a08-4eb0-96f7-a4f6a8880bbf tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.484865 Sep 03 21:01:27.548514 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1603/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:27 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:27.631195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:27.631949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:27.646599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.649627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.651549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.653143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.656858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.658541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.748823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:27.762984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-214db633-a2d3-4983-9faa-6de7db6e9ec9 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1318 microversion: 2.1 time: 0.476030 Sep 03 21:01:27.764219 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1734/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:27 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:27.835871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:27.857373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:27.859161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:27.862359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6cef32c1-79dc-437b-9842-21d17c68c935 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.236133 Sep 03 21:01:27.865063 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1604/3338] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:27 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:27.914558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:27.915947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:27.927672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.930657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.932596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:27.933549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:27.936630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:27.938061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.077513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:28.094641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:28.099454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:28.103402 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d63c5769-ca1f-4a25-8cd6-0cb25d608acc tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.192774 Sep 03 21:01:28.105232 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1735/3339] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:27 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:28.572051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:28.573157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:28.580541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.581300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.581810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.582720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.583527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.583970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.748484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:28.758364 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3da2734b-8188-4ce6-b712-412cf6cfad60 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.190383 Sep 03 21:01:28.769620 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1605/3340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:28 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:28.795136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:28.796370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:28.804967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.805720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.806313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.807186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.807904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.809021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.910359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:28.911125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:28.922025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.923260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.924040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:28.925805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:28.926456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:28.927123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.027737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.037774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.044328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.049916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.054676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09e5704c-10e6-4286-b1de-93286620c823 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1508 microversion: 2.1 time: 0.264529 Sep 03 21:01:29.056166 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a68e4f76-fb32-4af2-aa6b-2eb6638b3daa tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.153229 Sep 03 21:01:29.058071 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1606/3341] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:28 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:29.058488 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1736/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:28 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:29.098633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:29.099462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.114042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.126983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.127569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.137400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.138176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.138836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.141774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:29.148340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.169537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.170311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.171497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.172860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.174698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.180012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.312039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.323551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.330817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.332366 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce9a101f-06cb-4f57-98ee-1dba9dfc8436 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.200416 Sep 03 21:01:29.333971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1737/3343] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:29 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:29.335766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.346526 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e2dce71-465d-4856-a7d1-ddfaa69db5ef tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1508 microversion: 2.1 time: 0.264692 Sep 03 21:01:29.347909 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1607/3344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:29 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:29.371093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:29.374302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.381358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.381863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.382329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.383091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.383552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.383983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.458899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d3427125-69de-41a2-8925-bcb771e5c1c4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "PUT /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1080 microversion: 2.1 time: 0.092248 Sep 03 21:01:29.467377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1738/3345] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:01:29 2022] PUT /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1080 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:29.482990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:29.484834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.492743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.493004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.493450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.494169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.494624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.495051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.676992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:29.687653 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-75e24303-4a28-4423-99d7-509aac1e960b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1506 microversion: 2.1 time: 0.210136 Sep 03 21:01:29.698696 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1608/3346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:29 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:29.714496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:29.715420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.722313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.722904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.723616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.724346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.724809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.725270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.788585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:29.789726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:29.799038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.799867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.800523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.801431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:29.802046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:29.802634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:29.900241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:29.927965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:30.021673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.036118 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14dab626-3e38-401b-ab57-b23f5e92c6d7 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1506 microversion: 2.1 time: 0.325608 Sep 03 21:01:30.050073 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1739/3347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:29 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:30.074889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.080388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:30.083343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.084607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8113665b-92c9-403e-a084-dc4ddd8f1e9d tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.304165 Sep 03 21:01:30.085693 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1609/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:29 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:30.092098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:30.093148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.101108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.101955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.102621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.103562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.104331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.105057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.108145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.108736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.109226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.111407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.111883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.112344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.221249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:30.237512 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-43b40d1d-1e4f-465c-bb8f-c18a8bb529d4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "PUT /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1082 microversion: 2.1 time: 0.168230 Sep 03 21:01:30.248351 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1740/3349] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:01:30 2022] PUT /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1082 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:30.260132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:30.261207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.269438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.270330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.271075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.272141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.272829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.273542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.304727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.323815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.328305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.331788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd05a4a5-d72b-4bee-81de-59416428c65c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.244269 Sep 03 21:01:30.333745 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1610/3350] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:30 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:30.364269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:30.378394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.387950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.388976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.389616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.390342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.390803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.391349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.477203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.488656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.490339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.491805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-210be136-44dd-4d8f-8309-278fd326ba80 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.132609 Sep 03 21:01:30.492797 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1611/3351] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:30 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:30.585925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.607671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9839901-9bb6-4cb0-8ffe-6f536936b409 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1508 microversion: 2.1 time: 0.352062 Sep 03 21:01:30.618772 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1741/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:30 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:30.647937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:30.651058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.672081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.672786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.675715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.676497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.677003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.677713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.683001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:30.882700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:30.895345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f98e040c-b76c-4b5e-bd2e-8a968030bac4 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1508 microversion: 2.1 time: 0.257591 Sep 03 21:01:30.895983 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1612/3353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:30 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:30.922661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:30.925069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:30.936002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.936855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.937535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.938493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:30.939143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:30.939773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:30.969726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:31.099382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1fa24cc-0c08-405e-98dc-7b408022f3cf tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 204 len: 0 microversion: 2.1 time: 0.181304 Sep 03 21:01:31.103088 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1742/3354] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:30 2022] DELETE /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:31.115490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:31.116191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:31.130862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:31.131477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:31.143152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.144060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.144603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.146407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.147107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.147803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.151738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.158047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.170721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.171717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.176439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.180582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.274027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:31.371930 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Instance is already in deleting state, ignoring this request Sep 03 21:01:31.372829 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4efa79e2-0c05-4d1f-97a4-ce914f3e257b tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 204 len: 0 microversion: 2.1 time: 0.264337 Sep 03 21:01:31.377293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1613/3355] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:31 2022] DELETE /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:31.382544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:31.383285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:31.390015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.390516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.390963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.391682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.392145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.392578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.462787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.473918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.474670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.475664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.476949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6bdccec0-65b5-46a8-95e5-9d0d4dde40e0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.098543 Sep 03 21:01:31.477942 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1614/3356] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:31 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:31.492624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:31.492624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:31.492624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.492624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.493119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.494147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.494331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.494727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.503492 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca36b8cd-c74d-42a3-9ec4-88d109e78c00 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.376531 Sep 03 21:01:31.515134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1743/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:31 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:31.544022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:31.545829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:31.573704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.574927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.577408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.578292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:31.578880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:31.582339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:31.711681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.723666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.733198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.734655 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f45e358d-7e1d-4549-8fdb-d7fc90cb4880 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.212221 Sep 03 21:01:31.735468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1744/3358] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:31 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:31.787683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:31.801479 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ca88792d-2454-44a1-a281-2aa6aca6c045 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1514 microversion: 2.1 time: 0.322066 Sep 03 21:01:31.813399 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1615/3359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:31 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:32.514021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:32.516080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:32.527222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.528161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.528952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:32.530006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.530756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.531494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:32.550232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:32.551527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:32.562530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.563870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.570979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:32.572378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.573135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.573849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:32.683629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:32.700361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:32.702033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:32.703243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11defea4-f845-4f47-89ee-82c6373046f0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.195295 Sep 03 21:01:32.708940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1745/3360] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:32 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:32.782702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:32.786571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:32.809044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.810373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.810841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:32.811580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:32.821602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:32.822357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:33.004501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.011300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.029493 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-313d5be0-4360-4925-9c91-0f60be46b980 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.476057 Sep 03 21:01:33.030956 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1616/3361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:32 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:33.047499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.070079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.076698 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f72ab065-c17a-4619-bf9d-1af162712109 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.300231 Sep 03 21:01:33.077725 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1746/3362] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:32 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:33.083434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:33.084562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:33.098278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:33.099477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:33.100171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:33.113602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:33.115784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:33.116984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:33.537488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.548102 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b16c9946-38ba-45b9-9e5f-86e06b0f8355 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1514 microversion: 2.1 time: 0.488595 Sep 03 21:01:33.564846 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1617/3363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:33 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1514 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:33.731759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:33.733420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:33.749723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:33.753403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:33.756011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:33.757510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:33.758694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:33.759394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:33.821097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:33.965082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.995704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.995704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:33.995704 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7a19de6e-d213-45d3-ae0c-0b206db13fe2 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.268496 Sep 03 21:01:34.004814 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1747/3364] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:33 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:34.005162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb1fdc29-9d0e-46bf-be9a-2d86cb9eff81 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae6656cb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1207938171", "description": "tempest-description-1978717807"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:34.071120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:34.095332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:34.104013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.107109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.107999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.109146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.109835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.137391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.310629 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb1fdc29-9d0e-46bf-be9a-2d86cb9eff81 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.505374 Sep 03 21:01:34.312262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1618/3365] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:01:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:01:34.323780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:34.324839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:34.345081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.350200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.351756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.356608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.361254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.363202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.478798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:34.488933 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ddf283a-144a-4c57-bfb9-02b12569f389 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.423875 Sep 03 21:01:34.490422 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1748/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:34 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:34.495686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b556612f-fa3c-4361-bbd4-85cafac0e9bd tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae66941f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-73111007", "description": "tempest-description-986500991"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:34.573128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:34.611187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:34.614301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:34.615919 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5623ca20-dbc4-49e8-b949-0cc71c1f4c76 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.301911 Sep 03 21:01:34.639012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1619/3367] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:34 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:34.644102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42cf10b-db51-4389-9634-f8f2b2484a64", "name": "network-vif-deleted", "tag": "44692aa4-cb69-47cb-9369-98380777f279"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:34.661959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.662704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.663326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.686265 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] Creating event network-vif-deleted:44692aa4-cb69-47cb-9369-98380777f279 for instance c42cf10b-db51-4389-9634-f8f2b2484a64 on nch1-master-1 Sep 03 21:01:34.691393 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-25954b6b-7774-4d8f-9a72-1772a47282bf req-5aca268f-e4fd-4cfe-92cf-dc4080c6a857 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051321 Sep 03 21:01:34.692075 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1620/3368] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:34.697983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:34.698707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:34.721337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.721848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.722576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.723462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.724073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.724667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.789029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:34.791344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:34.792206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:34.792873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lazy-loading 'fault' on Instance uuid c42cf10b-db51-4389-9634-f8f2b2484a64 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:34.795742 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b556612f-fa3c-4361-bbd4-85cafac0e9bd tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.303941 Sep 03 21:01:34.797548 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1749/3369] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:01:34 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:34.861824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2029052944", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "49150632-99e2-4d38-875c-7389edde5823"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:34.875318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a4503b4d84a4e8c3213e2de02492d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae2766f0674492909ede79ed1832d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:34.885216 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-636a9bec-f2a1-4e6a-b5d6-5f7aff49d6d2 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 200 len: 1308 microversion: 2.1 time: 0.191814 Sep 03 21:01:34.894616 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1621/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:34 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:34.929320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] validate_networks() for [('49150632-99e2-4d38-875c-7389edde5823', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:35.035921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:35.037458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:35.044606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.045437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.045869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.046579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.047067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.047490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.124918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.135194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.136725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.138756 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81762a81-6341-42ac-bc2a-7edb7fd7f4d0 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.116640 Sep 03 21:01:35.139665 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1622/3371] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:35 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:35.520659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:35.521251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:35.536935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.537448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.537895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.538646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.539259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.539695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.766304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.781624 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-251a6e2e-02ee-408b-8c70-5c08fcf6645f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.261285 Sep 03 21:01:35.782478 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1623/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:35 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:35.794598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1261495a-d7e9-4093-ba15-936224a57d58", "name": "network-vif-plugged", "status": "completed", "tag": "64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:35.810400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.811162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.811853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.825976 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] Creating event network-vif-plugged:64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0 for instance 1261495a-d7e9-4093-ba15-936224a57d58 on nch1-master-1 Sep 03 21:01:35.831663 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1b6ff84e-5f1e-4e0c-98eb-561e81ebc64a req-925e3d58-b18b-4c1f-a222-f69c500b83c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041412 Sep 03 21:01:35.832976 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1624/3373] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:35.838732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:35.839667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:35.848193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.848944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.849637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.850544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.851190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.851788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.938262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:35.938915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:35.939613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:35.940950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:35.941496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:35.950892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.958878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.959547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.960453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.961729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.961962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.963674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:35.964373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:35.965844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2db180f-a5a2-4826-8045-5bc8f8cc00e0 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.131021 Sep 03 21:01:35.966683 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1625/3374] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:35 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:35.973606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:35.977600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:35.984337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: c42cf10b-db51-4389-9634-f8f2b2484a64] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:35.998747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:35.999261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.001703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.002647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.003285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.003890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.006410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Getting quotas for project 30d39cd627084dda8cb00e993f5d19a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:36.013043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Getting quotas for user 3a394ae937c54b2a82c89628d4feeb72 and project 30d39cd627084dda8cb00e993f5d19a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:36.027075 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] HTTP exception thrown: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. Sep 03 21:01:36.040373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:36.043799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Request method failure captured: Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 HTTP/1.1 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8ACN8vsf7m6V22s-0H0QdKaPEKBNXAtFjZl1ZNUe-IDVqqKKePAErOfSuTRs43KvhRAWkVT6ih8ATsuKLUGB1TZ78D3mWC0d3tIInjzf9vnXBLNMBjyzOQ8BOHBp68nsok1zX1q9GgRPCMXXYfWktl-98kuHIEkjZqmKUStaTJ-tRU Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18ae2766f0674492909ede79ed1832d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 859a4503b4d84a4e8c3213e2de02492d Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c42cf10b-db51-4389-9634-f8f2b2484a64'} Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.056070 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Returning 404 to user: Instance c42cf10b-db51-4389-9634-f8f2b2484a64 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ad992ecf-318c-4b7b-9d3c-8adeec457f13 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64" status: 404 len: 111 microversion: 2.1 time: 0.090363 Sep 03 21:01:36.060722 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1626/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:35 2022] GET /compute/v2.1/servers/c42cf10b-db51-4389-9634-f8f2b2484a64 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:36.075793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.076411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.088238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.090715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.091347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.093025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.093811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.094464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.112674 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] HTTP exception thrown: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Request method failure captured: Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 HTTP/1.1 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8ACN8vsf7m6V22s-0H0QdKaPEKBNXAtFjZl1ZNUe-IDVqqKKePAErOfSuTRs43KvhRAWkVT6ih8ATsuKLUGB1TZ78D3mWC0d3tIInjzf9vnXBLNMBjyzOQ8BOHBp68nsok1zX1q9GgRPCMXXYfWktl-98kuHIEkjZqmKUStaTJ-tRU Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18ae2766f0674492909ede79ed1832d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 859a4503b4d84a4e8c3213e2de02492d Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5d132783-c4a8-4417-9154-352e292056a0'} Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:36.115066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.118982 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.134184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01fc71f0-84e0-4494-a5da-fb51c2702e97 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276206 Sep 03 21:01:36.141103 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1750/3376] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:01:36.141842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Returning 404 to user: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:36.141842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d726fbf-c652-493e-a026-3b706443e926 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 404 len: 111 microversion: 2.1 time: 0.074670 Sep 03 21:01:36.141842 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1627/3377] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:36 2022] DELETE /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:36.150205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.150782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 5d132783-c4a8-4417-9154-352e292056a0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.152453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f44a3e7-9f6c-4d59-a78d-80a83e14fcd5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.154821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f44a3e7-9f6c-4d59-a78d-80a83e14fcd5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.158764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.159275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.159725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.160507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.161415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.161862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.202184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] HTTP exception thrown: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Request method failure captured: Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 HTTP/1.1 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8ACN8vsf7m6V22s-0H0QdKaPEKBNXAtFjZl1ZNUe-IDVqqKKePAErOfSuTRs43KvhRAWkVT6ih8ATsuKLUGB1TZ78D3mWC0d3tIInjzf9vnXBLNMBjyzOQ8BOHBp68nsok1zX1q9GgRPCMXXYfWktl-98kuHIEkjZqmKUStaTJ-tRU Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18ae2766f0674492909ede79ed1832d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 859a4503b4d84a4e8c3213e2de02492d Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5d132783-c4a8-4417-9154-352e292056a0'} Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.205161 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. Sep 03 21:01:36.209706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.211470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Returning 404 to user: Instance 5d132783-c4a8-4417-9154-352e292056a0 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:36.212604 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-84831a32-5b9c-45d3-ba00-773bf0589452 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0" status: 404 len: 111 microversion: 2.1 time: 0.067412 Sep 03 21:01:36.213736 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1628/3378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/5d132783-c4a8-4417-9154-352e292056a0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:36.219484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.220517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.229216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.230062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.230773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.232608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f44a3e7-9f6c-4d59-a78d-80a83e14fcd5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:36.236161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.236978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.237695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.241566 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f44a3e7-9f6c-4d59-a78d-80a83e14fcd5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1216 microversion: 2.1 time: 0.098463 Sep 03 21:01:36.256997 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1751/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:36.262797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.263479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.279264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.280163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.280852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.281774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.283274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.283883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.315029 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] HTTP exception thrown: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Request method failure captured: Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a HTTP/1.1 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8ACN8vsf7m6V22s-0H0QdKaPEKBNXAtFjZl1ZNUe-IDVqqKKePAErOfSuTRs43KvhRAWkVT6ih8ATsuKLUGB1TZ78D3mWC0d3tIInjzf9vnXBLNMBjyzOQ8BOHBp68nsok1zX1q9GgRPCMXXYfWktl-98kuHIEkjZqmKUStaTJ-tRU Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18ae2766f0674492909ede79ed1832d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 859a4503b4d84a4e8c3213e2de02492d Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a'} Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:36.316771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.321898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Returning 404 to user: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:36.328725 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56cb25cd-03ac-40b9-ad4e-4401477bfbed tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 404 len: 111 microversion: 2.1 time: 0.060002 Sep 03 21:01:36.329403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1752/3380] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:36 2022] DELETE /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:36.348312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.351371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] [instance: 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.352220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:36.365250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:36.368069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.368569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.369187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.370007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.370503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.370950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.378060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:36.379758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5a76e9a-0624-420b-81de-57bbeb460724 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.164533 Sep 03 21:01:36.389633 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1629/3381] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:36.398733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] HTTP exception thrown: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Request method failure captured: Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a HTTP/1.1 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8ACN8vsf7m6V22s-0H0QdKaPEKBNXAtFjZl1ZNUe-IDVqqKKePAErOfSuTRs43KvhRAWkVT6ih8ATsuKLUGB1TZ78D3mWC0d3tIInjzf9vnXBLNMBjyzOQ8BOHBp68nsok1zX1q9GgRPCMXXYfWktl-98kuHIEkjZqmKUStaTJ-tRU Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_18ae2766f0674492909ede79ed1832d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/18ae2766f0674492909ede79ed1832d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 18ae2766f0674492909ede79ed1832d7 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1246492393 Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 859a4503b4d84a4e8c3213e2de02492d Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerDiskConfigTestJSON-1246492393-project Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a'} Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:36.400272 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:36.405563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] Returning 404 to user: Instance 369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:36.411414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b597afe6-4b6f-4580-a750-384b40f117e5 tempest-ServerDiskConfigTestJSON-1246492393 tempest-ServerDiskConfigTestJSON-1246492393-project] 10.222.0.16 "GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a" status: 404 len: 111 microversion: 2.1 time: 0.076566 Sep 03 21:01:36.412282 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1753/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/369a7bec-e2a3-4c47-bdab-aa7a8ae68e7a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:36.812888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.813743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:36.822044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.822853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.823646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.825179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:36.825858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:36.826523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:36.996197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:36.997534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:37.009916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.010585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.012314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.015323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.015864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.016576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.061574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.071730 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1fad1ff-cff3-463a-852f-b8eb11776d0a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1317 microversion: 2.1 time: 0.267872 Sep 03 21:01:37.073110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1630/3383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:37.153618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.180796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.182803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.184814 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ddacf7a0-27d5-43d3-bef9-462e2b041a66 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.195494 Sep 03 21:01:37.185893 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1754/3384] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:36 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:37.266048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:37.266672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:37.278637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.279449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.279899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.280631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.281125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.281563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.347895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:37.410316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:37.411158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:37.420730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.420958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.423236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.426229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.427697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:37.428340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:37.429815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:37.437780 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24bbe144-709f-4dcc-9abb-ecb0e576ce90 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1220 microversion: 2.1 time: 0.175525 Sep 03 21:01:37.438845 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1631/3385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:37 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:37.541234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.550729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.556673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:37.562663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9204c786-1453-4027-9653-a312a666dc50 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.156737 Sep 03 21:01:37.563886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1755/3386] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:37 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:38.100311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:38.101115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:38.104641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:38.120711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.122002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.123498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.126450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.128419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.131205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.213889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:38.214562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:38.224873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.230060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.230757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.231670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.233455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.234087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.389720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.403456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.406042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.407527 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-32ca8e7e-f66d-4eb8-9ed2-0ba742b2c424 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.198491 Sep 03 21:01:38.410526 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1756/3387] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:38 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:38.466922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.469127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:38.470079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:38.480021 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0886b0e9-6107-4348-9ba3-6b0d8d44d160 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1507 microversion: 2.1 time: 0.384213 Sep 03 21:01:38.483817 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1632/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:38 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:38.502004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.502793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.503511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.504551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.505851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.506506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.592574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:38.593382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:38.612347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.613411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.617820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.622698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:38.624230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:38.631669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:38.683568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.696485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50e71246-943f-4936-8760-73e1c7e5700c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1268 microversion: 2.1 time: 0.228405 Sep 03 21:01:38.705636 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1757/3389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:38 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1268 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:38.811077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.825517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.836265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:38.843060 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de348d5b-5951-421b-b055-b042f8fc18f7 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.251165 Sep 03 21:01:38.844107 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1633/3390] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:38 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:39.444937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:39.445778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:39.466733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.467413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.468728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:39.471467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.478096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.482641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:39.614355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:39.625790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:39.627287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:39.628525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1158aa2b-8d98-4f84-af81-1559de5b9ba8 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.192453 Sep 03 21:01:39.630753 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1758/3391] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:39 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:39.722991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:39.723623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:39.738330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.741517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.742279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:39.743113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.748042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.748730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:39.878361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:39.879410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:39.896977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.899606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.900291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:39.901312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:39.903602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:39.904420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:40.084256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.096434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.103516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.108066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b19c037-97e2-44a4-abc5-732ee8de6d1d tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1407 microversion: 2.54 time: 0.234809 Sep 03 21:01:40.134340 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1759/3392] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:39 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:40.569230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:40.570802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:40.583444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:40.616810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:40.618554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:40.619612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:40.623323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:40.627576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:40.628068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:40.755453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:40.804689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.815264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68c60947-7874-44fd-a066-e9293fc22230 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 1.097130 Sep 03 21:01:40.819707 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1634/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:39 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:40.825375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:40.833142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:40.846641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:40.853628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:40.854322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:40.855318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:40.857972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:40.858700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:40.971667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.972234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9bbe3da0-1923-4572-80f1-7b9c1575ba6f tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 204 len: 0 microversion: 2.1 time: 0.420952 Sep 03 21:01:40.973913 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1760/3394] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:40 2022] DELETE /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:01:40.984170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.984487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:40.985500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:40.987222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:40.989951 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf07bb34-f664-404d-a7f4-c8b9567f35ca tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.168945 Sep 03 21:01:40.993125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:40.993421 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1635/3395] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:40 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:41.011539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.012826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.018151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.018668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.019117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.141923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:41.142970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:41.159057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.159570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.160013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.160734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.161297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.161657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.338020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:41.347433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:41.349168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:41.350564 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-45b0284a-e763-43fc-98e4-d5323ffbde98 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1413 microversion: 2.54 time: 0.212679 Sep 03 21:01:41.351952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1636/3396] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:41 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1413 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:41.426634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:41.438466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57a0a5b0-4134-4d45-91ff-bfb288e1ccc5 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1513 microversion: 2.1 time: 0.459764 Sep 03 21:01:41.439252 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1761/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:40 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:41.709632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc9f730-2fd0-4b46-bc41-0faad3d00cc9", "tag": "d2e4b512-16e1-4c9d-9fc6-472386ef3667"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:41.745956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.747615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.748085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.773856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] Creating event network-changed:d2e4b512-16e1-4c9d-9fc6-472386ef3667 for instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 on nch1-master-1 Sep 03 21:01:41.790289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fb83d948-59d3-43a7-aeec-454aed5dc5ea req-fec0a29c-5e70-4cd5-bdde-2cb4fda9db49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084386 Sep 03 21:01:41.791642 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1637/3398] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:41.847074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:41.847700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:41.867300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.867795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.868241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:41.868986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:41.869442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:41.869873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.025840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:42.027193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:42.041229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.041823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.044557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.047170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.047674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.048682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.187832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.209205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.211203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.212455 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d820f42c-694e-4bcc-a2d1-7f322d609dad tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.191381 Sep 03 21:01:42.226845 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1638/3399] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:42 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:42.244445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.254453 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c7a7dce6-aa96-41f6-9d4a-cd2b2459c439 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.415207 Sep 03 21:01:42.255360 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1762/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:41 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:42.380157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:42.381191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:42.391337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.395704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.396477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.398932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.401384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.402050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.464020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:42.465528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:42.488790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.491753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.491753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.494878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:42.495432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:42.497477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:42.522089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.551425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.555171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:42.560486 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4f71783-8e50-4b70-8339-5d60cfe8b2d5 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1413 microversion: 2.54 time: 0.185872 Sep 03 21:01:42.592002 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1639/3401] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:42 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1413 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:43.127606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.143322 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1725a6d0-569e-4a5a-a23d-1263a5da9d9e tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1513 microversion: 2.1 time: 0.683516 Sep 03 21:01:43.165297 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1763/3402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:42 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1513 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:43.249874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:43.252307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:43.278663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:43.279294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:43.303274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.303560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.304160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.308291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.309144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.309650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.310174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.310646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.311406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.315755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.316154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.316695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.533751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.549506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.551376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.555468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d1f77e4-8bdc-4d33-8816-8082a8c06eaf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.318794 Sep 03 21:01:43.559306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1640/3403] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:43 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:43.570132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1261495a-d7e9-4093-ba15-936224a57d58", "name": "network-vif-deleted", "tag": "64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:43.615792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.616540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.617483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.641977 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] Creating event network-vif-deleted:64e005dc-48df-4ca2-b7e6-6a1bfca9d5c0 for instance 1261495a-d7e9-4093-ba15-936224a57d58 on nch1-master-1 Sep 03 21:01:43.674488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5902f805-9f1e-421a-9f83-0b13e85440cb req-173eb8f0-c748-483b-915a-315d219d87a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113656 Sep 03 21:01:43.689092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1641/3404] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:43.698904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:43.713051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:43.738597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.744016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.744765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.745714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.746946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.749314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.756220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.765382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd7c6037-1ff1-48e6-85f5-35f501be14c2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.492030 Sep 03 21:01:43.769179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1764/3405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:43 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:43.876939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.894442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.897008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:43.899389 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22f023e2-b8d5-474f-a683-13a54d93d42c tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1398 microversion: 2.54 time: 0.207986 Sep 03 21:01:43.900796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1642/3406] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:43 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1398 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:43.931824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e5d1ba4-b8b6-452e-83ff-b8b11c797de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '.version_select at 0x7fae6688d040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:43.960163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e5d1ba4-b8b6-452e-83ff-b8b11c797de8 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-68425291" status: 204 len: 0 microversion: 2.54 time: 0.027883 Sep 03 21:01:43.962485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1765/3407] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Sep 3 21:01:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-68425291 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:01:43.974676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:43.975527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:43.982512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.983390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.983924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:43.984726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:43.985331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:43.988363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.025066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:44.134097 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8b3b879-73a0-49ca-b8e2-637a9eb31698 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 204 len: 0 microversion: 2.54 time: 0.160350 Sep 03 21:01:44.134097 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1643/3408] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:01:43 2022] DELETE /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:01:44.155012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:44.156799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:44.165722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.166521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.167147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.168062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.169034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.169649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.173039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:44.174937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:44.185486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.186373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.187058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.197566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.201640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.203648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.279422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.280139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.280562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.281252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lazy-loading 'fault' on Instance uuid 1261495a-d7e9-4093-ba15-936224a57d58 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:44.463198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.463543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.472060 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a0a3c48-7d3c-4531-b2a1-51f61c52b6d6 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 200 len: 1307 microversion: 2.1 time: 0.306880 Sep 03 21:01:44.472654 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1644/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:44 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:44.489019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.493364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.495461 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b91f2d70-d48d-4f06-ba2a-fd97ff104d58 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1404 microversion: 2.54 time: 0.356241 Sep 03 21:01:44.499002 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1766/3410] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:44 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1404 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:44.590114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:44.591531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:44.614837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.616882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.618649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.622431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.623105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.624128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.752697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.762078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.763962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.765584 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25c7b4c0-a64c-451f-8c1c-df2dbf81591e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.185404 Sep 03 21:01:44.766399 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1645/3411] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:44 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:44.791242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:44.791862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:44.798898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.800267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.801110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.802166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:44.802808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:44.803414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:44.829989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:44.968119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:44.981500 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-abf3e13f-d42d-43ba-81fe-9941d16f3029 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.192127 Sep 03 21:01:44.989456 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1767/3412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:44 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:45.500581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:45.501354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 1261495a-d7e9-4093-ba15-936224a57d58] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:45.509149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.510028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.511401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.512409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.513356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.514009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.525154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:45.526572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:45.537180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.537803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.541236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.542621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.543856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.546506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.554165 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] HTTP exception thrown: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Request method failure captured: Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 HTTP/1.1 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8Ac0V2P2y77-7l7q_fu4oOQDz7TKtdt_qVX4O3UPo3mfq4mwsbcNt-H3GIaZdSrbfjG6g-U1bwVQgfX049bnznfxjYueGPs0ufzA8owb-JG5bNCvNpRoVPfruJt9knTt0gfhHCpLJP07gwUFpMDPQpZHEOue3JIqydtHAQGU278Awo Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: b0fbc0c573fc45b58137b43959b57034 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: b0fbc0c573fc45b58137b43959b57034 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-VolumesAdminNegativeTest-2033592886-project Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 50bba3c790c44425a9786b8d1404df28 Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-VolumesAdminNegativeTest-2033592886-project Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '1261495a-d7e9-4093-ba15-936224a57d58'} Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:45.558020 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. Sep 03 21:01:45.563002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:01:45.566597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Returning 404 to user: Instance 1261495a-d7e9-4093-ba15-936224a57d58 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:45.567512 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9e70468b-d446-4b33-9afb-0f744786279a tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58" status: 404 len: 111 microversion: 2.1 time: 0.071605 Sep 03 21:01:45.571751 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1646/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:45 2022] GET /compute/v2.1/servers/1261495a-d7e9-4093-ba15-936224a57d58 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:45.632434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.644999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.647463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d240c36223b49cbb24e51bcb061a040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9b0f161c27a4b83865404bc57c99eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.649696 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52156ce6-7620-4bc4-9de9-6cfb8839bddf tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 200 len: 1404 microversion: 2.54 time: 0.128638 Sep 03 21:01:45.661805 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1768/3414] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:45 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 1404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:45.800435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:45.800935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:45.801410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:45.801586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:45.813196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.813196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.813196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.813196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.813196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.813646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.813745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.813837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.813837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.813837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:45.815521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:45.821897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:45.875931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:45.900124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.911026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:45.912503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.914247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:45.915665 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5eb3f0bf-2f5c-4f47-bdc5-aaf562c4a835 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.120959 Sep 03 21:01:45.929281 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1769/3415] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:45 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:46.004820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:46.005860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:46.017370 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3a5394de-32b5-46b7-b76f-18d2f76d7550 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 204 len: 0 microversion: 2.1 time: 0.222497 Sep 03 21:01:46.020284 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1647/3416] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:01:45 2022] DELETE /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:01:46.022488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:46.025074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.025872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.026873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.029005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.029746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.030415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.033491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:46.034461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:46.043551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.044559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.045712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.047375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.048109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.048732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.241079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:46.262329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:46.271817 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9480fc5c-b891-4561-a3ee-a76af55fdf9f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.271819 Sep 03 21:01:46.272914 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1770/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:45 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:46.330728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:46.341288 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-427f8e59-1004-4193-99af-fbf7825d4217 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1681 microversion: 2.1 time: 0.314542 Sep 03 21:01:46.341960 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1648/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:46 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:46.679786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:46.681078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] [instance: 79ed156b-98a5-46b9-beef-b61c93e95b3d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:46.688143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.694823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.695568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.696517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.701656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.702479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.745753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] HTTP exception thrown: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Request method failure captured: Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d HTTP/1.1 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CSRHSOyOUxazLfFoW2kTHvFnBPEx9U325ShA-DwOP8dJKBREjvSJB8P0vV1zZ49XEkxW9digp0D3tELZQJFQJsYciuDUxvY6BCGRhWLNj6NuJ9rCNIho6UlU0WEuu3EraNWSWiNcs3SQRZBwAxdJlMr2C4lfhWDv0e-UvxO0303sY Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.54 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: b9b0f161c27a4b83865404bc57c99eca Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerShowV254Test-229397627 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9b0f161c27a4b83865404bc57c99eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9b0f161c27a4b83865404bc57c99eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9b0f161c27a4b83865404bc57c99eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9b0f161c27a4b83865404bc57c99eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerShowV254Test-229397627 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: b9b0f161c27a4b83865404bc57c99eca Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerShowV254Test-229397627 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerShowV254Test-229397627-project Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 7d240c36223b49cbb24e51bcb061a040 Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerShowV254Test-229397627-project Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '79ed156b-98a5-46b9-beef-b61c93e95b3d'} Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:46.747966 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] Returning 404 to user: Instance 79ed156b-98a5-46b9-beef-b61c93e95b3d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac08d318-16cd-4671-9a3d-a6ce20853507 tempest-ServerShowV254Test-229397627 tempest-ServerShowV254Test-229397627-project] 10.222.0.16 "GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d" status: 404 len: 111 microversion: 2.54 time: 0.073750 Sep 03 21:01:46.752873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1771/3419] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:46 2022] GET /compute/v2.1/servers/79ed156b-98a5-46b9-beef-b61c93e95b3d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:01:46.944294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:46.945120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:46.961869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.962422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.962866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:46.963788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:46.964288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:46.965638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:47.085648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:47.094500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:47.098485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:47.110446 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e94e7b3-6e46-4bbc-8f30-d7ea721e197a tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.170539 Sep 03 21:01:47.111318 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1649/3420] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:46 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:47.294500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:47.295129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:47.312621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:47.313064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:47.313529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:47.314247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:47.314717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:47.315159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:47.367973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:47.368841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:47.398910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:47.400079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:47.402516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:47.405399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:47.406880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:47.411842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:47.634617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:47.676647 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b832517-0ed2-4856-8130-ea6f2c125d43 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1681 microversion: 2.1 time: 0.314908 Sep 03 21:01:47.708147 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1650/3421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:47 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:47.738220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:47.754486 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4fcc0c4-85e1-46be-933e-33601770e343 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.462148 Sep 03 21:01:47.755530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1772/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:47 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:48.153040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:48.154482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:48.173835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:48.175795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:48.176500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:48.179513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:48.180186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:48.181005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:48.262303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1166462711", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b921cf10-8d5b-4190-8d5f-07579cab263d"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:48.342080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:48.366916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:48.372383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:48.375766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-635a8e48-dff4-445e-8844-99b0e50219f1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.236045 Sep 03 21:01:48.383574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] validate_networks() for [('b921cf10-8d5b-4190-8d5f-07579cab263d', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:48.390124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1773/3423] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:48 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:48.711450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:48.717298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:48.741703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:48.744575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:48.748400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:48.750067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:48.754188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:48.757615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.121831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:49.121831 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a39a7d5-4d40-4c8a-87d8-de89f5f4dfa1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1681 microversion: 2.1 time: 0.404768 Sep 03 21:01:49.124039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1774/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:48 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:49.139279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:49.139978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:49.152471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.155094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.155557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.156277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.156739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.157230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.234889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:49.241965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:49.242755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:49.243345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:49.244951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:49.258287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.259110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.259945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.260875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.261552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.262146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.304022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:49.316939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for user f7e2c822238a45d9b4d01ecf2cebc29a and project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:49.357367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:49.369055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:49.459327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cb916cd-4f44-47b9-bb51-c7987c3e71a8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342437 Sep 03 21:01:49.475093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1651/3425] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:01:49.746175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-25005a88-9276-4a2f-bb76-ea1d032f7e1e tempest-ExtensionsTest-647593207 tempest-ExtensionsTest-647593207-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:49.749783 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-25005a88-9276-4a2f-bb76-ea1d032f7e1e tempest-ExtensionsTest-647593207 tempest-ExtensionsTest-647593207-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.272855 Sep 03 21:01:49.750008 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1652/3426] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Sep 3 21:01:49 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:49.756079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:49.756788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:49.766693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.768244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.768395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.769448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:49.773955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:49.774439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:49.856110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:49.868384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:49.870083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:49.871680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0c35097-e926-4732-960a-6bc9d07a8890 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.120366 Sep 03 21:01:49.885716 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1653/3427] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:49 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:49.898840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2131619593", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b921cf10-8d5b-4190-8d5f-07579cab263d"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:49.974680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:49.987399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a972b2e2-92e8-4206-bc1c-678ded4a1dda tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.862067 Sep 03 21:01:49.994315 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1775/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:49 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:50.010757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46071587-51ab-46c2-a7dc-3636f797b236 tempest-ExtensionsTest-647593207 tempest-ExtensionsTest-647593207-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:50.019940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] validate_networks() for [('b921cf10-8d5b-4190-8d5f-07579cab263d', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:50.043734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46071587-51ab-46c2-a7dc-3636f797b236 tempest-ExtensionsTest-647593207 tempest-ExtensionsTest-647593207-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.047654 Sep 03 21:01:50.046992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1776/3429] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Sep 3 21:01:49 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:01:50.151178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:50.151882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:50.166735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:50.170856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:50.171583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:50.172532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:50.176601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:50.177386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:50.650012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:50.663197 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-97dec6a1-1a72-4714-8972-66cece1588cc tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1681 microversion: 2.1 time: 0.516867 Sep 03 21:01:50.664425 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1777/3430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:50 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1681 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:50.906285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:50.907231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:50.950785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:50.951577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:50.953549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:50.957190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:50.962424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:50.967659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:51.171118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:51.171582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:51.172026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:51.172447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:51.172874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:51.184820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:51.185496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:51.186263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:51.190302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:51.191401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:51.191936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:51.248672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:51.254672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for user f7e2c822238a45d9b4d01ecf2cebc29a and project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:51.276371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:51.279823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:51.297312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:51.309026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:51.316591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:51.317854 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fde647ac-9768-4945-b5e3-6572c21285c1 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1366 microversion: 2.57 time: 0.420246 Sep 03 21:01:51.320167 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1778/3431] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:50 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:51.334039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:51.334939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:51.352446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:51.353725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:51.356418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:51.358838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:51.361337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:51.363274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:51.395090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bc895641-ff25-4821-9488-2680cb86dd10 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507486 Sep 03 21:01:51.398202 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1654/3432] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:01:51.644769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1437273883", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "451", "networks": [{"uuid": "b921cf10-8d5b-4190-8d5f-07579cab263d"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:51.792079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] validate_networks() for [('b921cf10-8d5b-4190-8d5f-07579cab263d', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:01:52.032137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:52.047805 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39e5df93-0a01-4c76-adad-f901d1608cf3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.725517 Sep 03 21:01:52.051328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1779/3433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:51 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:52.066574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:52.077827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:52.090758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.091777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.100246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.102525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.105964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.110403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.232459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:52.241595 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-101dc6eb-4090-4759-b3bf-5c0d3af62613 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1326 microversion: 2.1 time: 0.187587 Sep 03 21:01:52.253268 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1780/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:52 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:52.260693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a2ace1-f683-4a53-898d-90132c063bf7", "name": "network-vif-deleted", "tag": "29a7f5f4-3ef0-4798-912d-b2972c9d925a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:52.282916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.283649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.284295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.299630 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] Creating event network-vif-deleted:29a7f5f4-3ef0-4798-912d-b2972c9d925a for instance 33a2ace1-f683-4a53-898d-90132c063bf7 on nch1-master-1 Sep 03 21:01:52.307966 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6ac85404-dc24-4141-8b76-b94fcf9f7f59 req-166fb785-c54f-4304-93d9-c40d574917df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051383 Sep 03 21:01:52.315259 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1781/3435] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:52.362300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:52.367862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:52.402511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.403265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.404433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.412759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.413663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.415818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.593978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:52.604677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:52.607422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:52.608998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73dcfc76-5c12-4ba9-bbd1-ca947399cea7 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1372 microversion: 2.57 time: 0.266659 Sep 03 21:01:52.610226 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1782/3436] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:52 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:52.627393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc9f730-2fd0-4b46-bc41-0faad3d00cc9", "name": "network-vif-plugged", "status": "completed", "tag": "d2e4b512-16e1-4c9d-9fc6-472386ef3667"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:52.639961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.641151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.642174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.656446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] Creating event network-vif-plugged:d2e4b512-16e1-4c9d-9fc6-472386ef3667 for instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 on nch1-master-1 Sep 03 21:01:52.664726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f4670bd3-6e2f-47b4-8534-9942c5b80543 req-0dfdba65-16de-4f23-a541-ebdc4eab7f73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044874 Sep 03 21:01:52.665989 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1783/3437] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:52.938110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:01:52.939366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:01:52.949662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:01:52.949662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:01:52.949662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:01:52.951024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.951716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.952496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.953570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:52.954325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:52.954767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:52.977066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:52.984242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Getting quotas for user f7e2c822238a45d9b4d01ecf2cebc29a and project 250efefcd9e84269a090b0a7ec433c87. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:53.003502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:01:53.005733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:01:53.086564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:53.094306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:53.095400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:53.127013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.127549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.128013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.137092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.137719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.138191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.277208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3802fc03-98c2-49e1-8ca4-9d4a22b26e6e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635891 Sep 03 21:01:53.277992 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1655/3438] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:01:53.299706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:53.311853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:53.347935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.348480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.352361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.354519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.355028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.364848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.395164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.420396 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72699455-151a-448e-8001-22edad5ca280 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.346362 Sep 03 21:01:53.436103 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1784/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:53 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:01:53.436103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0fb9a141-cc3b-4d0c-b002-5ba02227754f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:53.436103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0fb9a141-cc3b-4d0c-b002-5ba02227754f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:53.442764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.443275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.443732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.444207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lazy-loading 'fault' on Instance uuid 33a2ace1-f683-4a53-898d-90132c063bf7 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:53.520200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0fb9a141-cc3b-4d0c-b002-5ba02227754f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.532698 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0fb9a141-cc3b-4d0c-b002-5ba02227754f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1221 microversion: 2.1 time: 0.108306 Sep 03 21:01:53.534809 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1785/3440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:53 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:53.547984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bba3c790c44425a9786b8d1404df28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc0c573fc45b58137b43959b57034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.562481 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3324d53a-6e64-4a13-b704-d668826f2e54 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 200 len: 1331 microversion: 2.1 time: 0.283370 Sep 03 21:01:53.575388 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1656/3441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:53 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 1331 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:53.640406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:53.641247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:53.655389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.658499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.659453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.660194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:53.660671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:53.661476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:53.869604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.884075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.896501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:53.904608 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc0ab6c9-ab74-4f0a-8ad9-4d906860fae4 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1372 microversion: 2.57 time: 0.266547 Sep 03 21:01:53.921328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1786/3442] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:53 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:54.444665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:54.446713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:54.470084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.470660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.478723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.479916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.480456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.480928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.556743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:54.560614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:54.589350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.590318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.591117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.600623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.601363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.601624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.778741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:54.788447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9393c45e-5ed9-4f59-a2eb-3f7f19159076 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1217 microversion: 2.1 time: 0.236635 Sep 03 21:01:54.791275 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1787/3443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:54 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:54.803661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:54.815857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] [instance: 33a2ace1-f683-4a53-898d-90132c063bf7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:54.833768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.836280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.838157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.839245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:54.841181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:54.843817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:54.855069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:54.884286 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] HTTP exception thrown: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Request method failure captured: Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 HTTP/1.1 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8Ac0V2P2y77-7l7q_fu4oOQDz7TKtdt_qVX4O3UPo3mfq4mwsbcNt-H3GIaZdSrbfjG6g-U1bwVQgfX049bnznfxjYueGPs0ufzA8owb-JG5bNCvNpRoVPfruJt9knTt0gfhHCpLJP07gwUFpMDPQpZHEOue3JIqydtHAQGU278Awo Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: b0fbc0c573fc45b58137b43959b57034 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0fbc0c573fc45b58137b43959b57034"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: b0fbc0c573fc45b58137b43959b57034 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2033592886 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesAdminNegativeTest-2033592886-project Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 50bba3c790c44425a9786b8d1404df28 Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesAdminNegativeTest-2033592886-project Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '33a2ace1-f683-4a53-898d-90132c063bf7'} Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:54.886051 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Returning 404 to user: Instance 33a2ace1-f683-4a53-898d-90132c063bf7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:54.891026 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d75a260f-9a62-4453-9777-6a106d4a443b tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7" status: 404 len: 111 microversion: 2.1 time: 0.096046 Sep 03 21:01:54.892559 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1788/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:54 2022] GET /compute/v2.1/servers/33a2ace1-f683-4a53-898d-90132c063bf7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:01:54.962136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:54.970460 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e0c1ad2-9e6e-43ac-81a0-8b173263f817 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1316 microversion: 2.1 time: 0.530726 Sep 03 21:01:54.974890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1657/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:54 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:54.979777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c1b25d3-d200-4b77-ad5d-5c51eebd3cc1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] Calling method '.version_select at 0x7fae6b855280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:55.026516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c1b25d3-d200-4b77-ad5d-5c51eebd3cc1 tempest-VolumesAdminNegativeTest-2033592886 tempest-VolumesAdminNegativeTest-2033592886-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915557563" status: 202 len: 0 microversion: 2.1 time: 0.050518 Sep 03 21:01:55.027507 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1658/3446] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915557563 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:01:55.034772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:55.036485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:55.048516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.049736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.050594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.053691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.055010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.056495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.206317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.224448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.225942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.227137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-225748bb-b72d-4a15-ab5d-fecec12e8b4f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1357 microversion: 2.57 time: 0.198333 Sep 03 21:01:55.237052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-396dcfdb-fa7d-416b-9cd5-9479266e7a07 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Action: 'create', calling method: .version_select at 0x7fae669639d0>, body: {"keypair": {"name": "tempest-keypair-115549263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQoT8gHR+0QY2PYlzoAqO3USllvUTCjDrEx+bW8KEIQJ6jdkVfwX0UScbNN3pTZDga0ZInUYpWhi0JWvdo1Z+kB4qg6sY68mzanJrKVrpRJkI+tbjWRemjpkjrhKVIO3A=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:55.256966 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1659/3447] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:55 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:55.263502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:55.265866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:55.275982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.280119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-396dcfdb-fa7d-416b-9cd5-9479266e7a07 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Getting quotas for project 35119286edb94a8fb711a37863321fbe. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:01:55.290354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-396dcfdb-fa7d-416b-9cd5-9479266e7a07 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Getting quotas for user 9884fe87dedd42bba0442aca48ebdc8d and project 35119286edb94a8fb711a37863321fbe. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:01:55.290733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.291426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.294115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.294813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.295478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.348120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:01:55.348290 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-396dcfdb-fa7d-416b-9cd5-9479266e7a07 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.453304 Sep 03 21:01:55.350352 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1789/3448] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:01:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:55.546532 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e28ed575-33c1-4434-a50b-1022ac979ebf tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 204 len: 0 microversion: 2.57 time: 0.287815 Sep 03 21:01:55.548979 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1660/3449] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:01:55 2022] DELETE /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:01:55.558358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:55.560830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:55.579850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.584267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.584852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.586060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.587148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.587600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.762634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.773952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.775963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:55.778610 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bb8cf88-dd0c-43d3-a84b-387d4dc9b61f tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1363 microversion: 2.57 time: 0.226556 Sep 03 21:01:55.780041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1790/3450] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:55 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:01:55.814209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:55.814856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:55.826693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.827196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.829373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:55.830186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:55.830675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:55.832627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.000404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:56.001170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:56.012641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.013596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.014323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.015380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.016021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.016685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.238178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:56.251629 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04edcb94-301a-448e-a254-a98047024e21 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1291 microversion: 2.1 time: 0.441185 Sep 03 21:01:56.252948 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1661/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:55 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1291 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:56.584220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:56.593975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-842a86c6-b8d9-4c5b-a1bb-6c1b2c036762 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1504 microversion: 2.1 time: 0.598074 Sep 03 21:01:56.594825 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1791/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:55 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:56.625897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1207938171"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:56.626809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:56.639104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.640348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.641281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.642462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.643346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.645160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.806015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:56.807040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:56.813621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.814416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.815132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.816067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:56.816743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:56.817486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:56.954675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:56.966855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:56.969868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:56.971773 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb81049c-cf26-4a0d-899c-2a3144ccb7a3 tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1363 microversion: 2.57 time: 0.169829 Sep 03 21:01:56.985964 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1792/3453] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:56 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:57.193217 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Adding security group 82bf1454-456b-4de6-98f2-59b82940edde to port d2e4b512-16e1-4c9d-9fc6-472386ef3667 Sep 03 21:01:57.279161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:57.280168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:57.292039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:57.293944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:57.296653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:57.297999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:57.298678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:57.299537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:57.436538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:57.445224 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-be5751ce-6538-41eb-90d4-e4a3c7420067 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1279 microversion: 2.1 time: 0.172198 Sep 03 21:01:57.446255 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1793/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:57 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:58.005725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:58.007799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:58.020302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.020966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.021811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.022712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.023343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.023988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.112965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.112965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.117653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.119353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lazy-loading 'fault' on Instance uuid aa799f36-976e-4072-8f27-48cffc157a63 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:01:58.206326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:58.222905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:58.224766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9abfaac1da5f41f7a522b009f8073ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a128c413284fcb96ecbdb84d33c862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:58.226305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac9ac88e-20de-4c84-8f53-59623c8b128e tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 200 len: 1368 microversion: 2.57 time: 0.230675 Sep 03 21:01:58.241321 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1794/3455] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:57 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:01:58.474778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:58.478455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:58.499381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.502184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.502649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.504966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.506418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.508661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.512543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0dbc124d-8235-49e0-b486-a682ccc67f48 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/action" status: 202 len: 0 microversion: 2.1 time: 1.891943 Sep 03 21:01:58.515228 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1662/3456] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:01:56 2022] POST /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/action => generated 0 bytes in 1897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:01:58.539051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc9f730-2fd0-4b46-bc41-0faad3d00cc9", "tag": "d2e4b512-16e1-4c9d-9fc6-472386ef3667"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:58.596609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.597719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.602427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.647182 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] Creating event network-changed:d2e4b512-16e1-4c9d-9fc6-472386ef3667 for instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 on nch1-master-1 Sep 03 21:01:58.654283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:01:58.664952 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d34b20cb-e4d8-45d0-9cc3-5b76429f76a8 req-01bbc676-407d-41b6-928f-cb82d49a2ae7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142934 Sep 03 21:01:58.668157 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1663/3457] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:01:58.669761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aea85e86-9f0a-43a5-87cb-dfbbe9d47b9b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1279 microversion: 2.1 time: 0.203184 Sep 03 21:01:58.670349 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1795/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:58 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:01:58.704922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-73111007"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:01:58.722153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:58.736878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.737498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.737952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:58.745972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:58.746471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:58.746926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:59.255439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:59.256258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] [instance: aa799f36-976e-4072-8f27-48cffc157a63] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:59.268162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:59.268657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:59.269202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:59.270202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:59.270924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:59.271563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:59.323833 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] HTTP exception thrown: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Request method failure captured: Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 HTTP/1.1 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CaNl84rfgEuMDfaiEiEB2g1HAVbNkOHlCwoqC6V33OBHUjdr6EHw921Z5-wUmu3NyOJM_7z6OzFiMRgWFVs5JLSTJeRQhbHiEOExlt2FslXCpwar3wNlIh8DddDn1aLc-4ilNMNvgu4Jbf3ug7fBGvmqD45UzQtzxcpCKtISebuto Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.57 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 75a128c413284fcb96ecbdb84d33c862 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerShowV257Test-1363594187 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75a128c413284fcb96ecbdb84d33c862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_75a128c413284fcb96ecbdb84d33c862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/75a128c413284fcb96ecbdb84d33c862"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/75a128c413284fcb96ecbdb84d33c862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerShowV257Test-1363594187 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 75a128c413284fcb96ecbdb84d33c862 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerShowV257Test-1363594187 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerShowV257Test-1363594187-project Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9abfaac1da5f41f7a522b009f8073ac8 Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerShowV257Test-1363594187-project Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'aa799f36-976e-4072-8f27-48cffc157a63'} Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:01:59.327622 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. Sep 03 21:01:59.331841 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:01:59.334026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] Returning 404 to user: Instance aa799f36-976e-4072-8f27-48cffc157a63 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:01:59.336395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e2035d1-4402-4789-ace8-adbaefebf6fe tempest-ServerShowV257Test-1363594187 tempest-ServerShowV257Test-1363594187-project] 10.222.0.16 "GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63" status: 404 len: 111 microversion: 2.57 time: 0.085063 Sep 03 21:01:59.337301 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1796/3459] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:01:59 2022] GET /compute/v2.1/servers/aa799f36-976e-4072-8f27-48cffc157a63 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:01:59.699324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:01:59.699972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:01:59.714064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:59.715211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:59.715689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:59.716396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:01:59.716860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:01:59.722898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:01:59.975525 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Adding security group 3cbdbcfc-9577-407d-90f2-0f801013927b to port d2e4b512-16e1-4c9d-9fc6-472386ef3667 Sep 03 21:02:00.041145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:00.054569 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5cf7f6b8-0ba6-4767-a063-55c8045902e8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.361202 Sep 03 21:02:00.055383 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1797/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:01:59 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:01.078976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:01.080478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:01.093117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:01.099304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:01.100094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:01.104250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:01.105150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:01.105806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:01.588644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:01.600538 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-54ad01f4-31e6-47c9-926e-010ef72c0ab3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.525097 Sep 03 21:02:01.617121 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1798/3461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:01 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:02.129365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b43774c-3689-4cb5-8351-e77787bc0b1e tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Action: 'create', calling method: .version_select at 0x7fae668760d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-466362275", "metadata": {"Type": "work"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b43774c-3689-4cb5-8351-e77787bc0b1e tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 121 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-466362275", "metadata": {"Type": "work"}}} Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-466362275', 'metadata': {'Type': 'work'}}}} Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '#$%' Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:02:02.163897 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b43774c-3689-4cb5-8351-e77787bc0b1e tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b43774c-3689-4cb5-8351-e77787bc0b1e tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181631 Sep 03 21:02:02.176040 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1799/3462] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 3 21:02:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:02:02.178055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f4c92eb-3be2-402f-95fb-244fa982c2fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Action: 'create', calling method: .version_select at 0x7fae6689e670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-248415759", "metadata": {"Type": "work"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f4c92eb-3be2-402f-95fb-244fa982c2fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 119 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-248415759", "metadata": {"Type": "work"}}} Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-248415759', 'metadata': {'Type': 'work'}}}} Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '0' Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:02:02.181964 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f4c92eb-3be2-402f-95fb-244fa982c2fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2f4c92eb-3be2-402f-95fb-244fa982c2fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010816 Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1800/3463] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 3 21:02:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:02:02.196369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a5edb4a-f1a2-431e-a94f-47929c1f86fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Action: 'create', calling method: .version_select at 0x7fae66941430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1181705958", "metadata": {"Type": "work"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a5edb4a-f1a2-431e-a94f-47929c1f86fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 119 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1181705958", "metadata": {"Type": "work"}}} Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1181705958', 'metadata': {'Type': 'work'}}}} Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '' Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:02:02.198503 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a5edb4a-f1a2-431e-a94f-47929c1f86fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a5edb4a-f1a2-431e-a94f-47929c1f86fe tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010986 Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1801/3464] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 3 21:02:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:02:02.213124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22e0869e-6764-48ed-85c9-97e941011696 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Calling method '.version_select at 0x7fae66fd54c0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:02.247323 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-22e0869e-6764-48ed-85c9-97e941011696 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] HTTP exception thrown: Volume tempest-invalid-1821982098 could not be found. Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22e0869e-6764-48ed-85c9-97e941011696 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1821982098 HTTP/1.1 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: exception: Volume tempest-invalid-1821982098 could not be found. Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'tempest-invalid-1821982098'} Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1821982098 could not be found. (HTTP 404) (Request-ID: req-f9286812-954f-45b1-9b7f-78b06e512c76) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 21:02:02.305291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1821982098 could not be found. Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1821982098 could not be found. Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1821982098 could not be found. Sep 03 21:02:02.310159 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.315529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22e0869e-6764-48ed-85c9-97e941011696 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 404 to user: Volume tempest-invalid-1821982098 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.316108 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22e0869e-6764-48ed-85c9-97e941011696 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1821982098" status: 404 len: 99 microversion: 2.1 time: 0.108636 Sep 03 21:02:02.316757 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1802/3465] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:02:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1821982098 => generated 99 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 21:02:02.330269 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62298824-ab9f-44a5-8bec-cd63e7ca7192 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004072 Sep 03 21:02:02.331443 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1803/3466] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 3 21:02:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 21:02:02.343506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7a68f9ac-0ea9-445f-9f46-7d47dffe968d tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005395 Sep 03 21:02:02.344571 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1804/3467] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:02:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 21:02:02.365574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99051cd0-12db-4695-a758-b27c3cc2865f tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Calling method '.version_select at 0x7fae6689e790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:02.416805 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-99051cd0-12db-4695-a758-b27c3cc2865f tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] HTTP exception thrown: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99051cd0-12db-4695-a758-b27c3cc2865f tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-volumes/f85f1c5d-98fb-48d8-ad7c-9d729252a242 HTTP/1.1 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: exception: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f85f1c5d-98fb-48d8-ad7c-9d729252a242'} Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. (HTTP 404) (Request-ID: req-9454479a-8969-4d02-927b-e31ac77099e4) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 21:02:02.420077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.426493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99051cd0-12db-4695-a758-b27c3cc2865f tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 404 to user: Volume f85f1c5d-98fb-48d8-ad7c-9d729252a242 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.437025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99051cd0-12db-4695-a758-b27c3cc2865f tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f85f1c5d-98fb-48d8-ad7c-9d729252a242" status: 404 len: 109 microversion: 2.1 time: 0.073594 Sep 03 21:02:02.437025 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1805/3468] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:02:02 2022] DELETE /compute/v2.1/os-volumes/f85f1c5d-98fb-48d8-ad7c-9d729252a242 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:02.443458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e4056a3-5f1d-4e8c-b616-a62e3ce7c0f9 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Calling method '.version_select at 0x7fae6689e790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:02.471387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f15cefc9-7f02-4b7f-97db-1d31694214a9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/action" status: 202 len: 0 microversion: 2.1 time: 3.801555 Sep 03 21:02:02.476455 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1664/3469] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:01:58 2022] POST /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/action => generated 0 bytes in 3806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:02.483430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:02.484396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:02.485464 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-3e4056a3-5f1d-4e8c-b616-a62e3ce7c0f9 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] HTTP exception thrown: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e4056a3-5f1d-4e8c-b616-a62e3ce7c0f9 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Request method failure captured: Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-volumes/dc4c912e-eb7d-4d19-94c4-ad1d607b1066 HTTP/1.1 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DJekpEDlWBTIUc5sJ5tkvygC1oELo90NNzxhB3je2y0fnXVmGV4MfiWpGaGeweQYXko4SHb4srLdAQUruuuXYmMHIKe9pjKxmJ4w4ul6vf888EPNhrhmq7XdDelsxKMUVHmCh0t0fW7nnwg5kWfhFLwoe543rEwcPdUQo0VKDMC30 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d8fde784a4a45308d5ae744f89b52c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0d8fde784a4a45308d5ae744f89b52c3 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesNegativeTest-1039600087 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 93c44a51d8254cfdaed58ef0fd9e0145 Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesNegativeTest-1039600087-project Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: exception: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'dc4c912e-eb7d-4d19-94c4-ad1d607b1066'} Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. (HTTP 404) (Request-ID: req-7b400830-ce60-409a-8633-e7d5a432f7b5) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 21:02:02.487413 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e4056a3-5f1d-4e8c-b616-a62e3ce7c0f9 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] Returning 404 to user: Volume dc4c912e-eb7d-4d19-94c4-ad1d607b1066 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:02.491544 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e4056a3-5f1d-4e8c-b616-a62e3ce7c0f9 tempest-VolumesNegativeTest-1039600087 tempest-VolumesNegativeTest-1039600087-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/dc4c912e-eb7d-4d19-94c4-ad1d607b1066" status: 404 len: 109 microversion: 2.1 time: 0.052132 Sep 03 21:02:02.497704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:02.497704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:02.497704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:02.497704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:02.497704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:02.498913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:02.520034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1806/3470] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:02:02 2022] GET /compute/v2.1/os-volumes/dc4c912e-eb7d-4d19-94c4-ad1d607b1066 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:02:02.570180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc9f730-2fd0-4b46-bc41-0faad3d00cc9", "tag": "d2e4b512-16e1-4c9d-9fc6-472386ef3667"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:02.582669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:02.583359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:02.583811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:02.597077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] Creating event network-changed:d2e4b512-16e1-4c9d-9fc6-472386ef3667 for instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 on nch1-master-1 Sep 03 21:02:02.604559 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-33764d36-2312-4ca5-849b-f9e50ad7961a req-f45469b5-d6a2-491c-83b4-3b4fe0e5d83b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050474 Sep 03 21:02:02.608544 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1807/3471] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:02.625391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:02.626360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:02.639539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:02.643475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:02.643940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:02.644398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:02.645245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:02.645718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:02.646159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:02.966209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:02.994836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=18 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:03.394004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:03.406961 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0691d847-e27c-44dc-ae8e-3fc224fb5159 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.786781 Sep 03 21:02:03.411284 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1808/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:02 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:03.421145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-447183424", "imageRef": "2e84b450-25cd-464a-8d4b-51ab8c2a5ce6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e58b3600-729d-4661-919e-58b4259900d0"}], "security_groups": [{"name": "tempest-securitygroup--1262285259"}], "key_name": "tempest-keypair-115549263", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:03.592046 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8560d910-d5ad-4e12-8096-ce32251606d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.114037 Sep 03 21:02:03.592676 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1665/3473] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Sep 3 21:02:02 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9/os-security-groups => generated 1156 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:03.619598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c2ececd-ab1a-4033-b726-ddf304807fcd tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae6b8addc0>, body: {"security_group": {"name": " tempest-securitygroup -397580626 ", "description": "tempest-description-446009254"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:03.701050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] validate_networks() for [('e58b3600-729d-4661-919e-58b4259900d0', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:02:04.860615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c2ececd-ab1a-4033-b726-ddf304807fcd tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.242681 Sep 03 21:02:04.867195 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1666/3474] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:03 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:04.878610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062d35a7-962c-4f18-bed1-d5ffcec17e48", "tag": "14d5226c-c9c1-42ed-bcc1-10c2d9dc519e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:04.951764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:04.952608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:04.954815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:04.985112 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] Creating event network-changed:14d5226c-c9c1-42ed-bcc1-10c2d9dc519e for instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 on nch1-master-1 Sep 03 21:02:04.992219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6f8e08e8-b536-474b-885b-a588ac7bb86f req-6d4a1980-a67b-47b9-acf2-27b02490ef77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123411 Sep 03 21:02:04.993607 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1667/3475] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:05.000433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:05.001396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:05.015298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:05.021772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:05.022995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:05.023970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:05.025320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:05.026625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:05.058393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:05.144358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:02:05.145066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:02:05.145512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:02:05.145921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:02:05.146346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:02:05.163833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:05.168379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:05.169203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:05.171151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:05.171898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:05.172549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:05.203871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Getting quotas for project 35119286edb94a8fb711a37863321fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:02:05.210031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Getting quotas for user 9884fe87dedd42bba0442aca48ebdc8d and project 35119286edb94a8fb711a37863321fbe. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:02:05.225149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:02:05.228097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e84b450-25cd-464a-8d4b-51ab8c2a5ce6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:02:05.303548 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd9b9d7d-eb6c-4e08-a82b-5ceb7e28b6a0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.890826 Sep 03 21:02:05.306942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1809/3476] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:02:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:02:05.317691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb", "tag": "8f999e56-718f-4e7d-9370-3efa7e4e4933"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:05.337865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:05.338377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:05.339027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:05.357977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] Creating event network-changed:8f999e56-718f-4e7d-9370-3efa7e4e4933 for instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb on nch2-master-1 Sep 03 21:02:05.365946 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7c5b1011-ba92-4dcb-8849-50fe05c74f8a req-2894eb09-0f06-4a7c-a807-1938ad507da1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057966 Sep 03 21:02:05.367037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1810/3477] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:05.376292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1196d57c-c3c1-467c-99aa-33e32b7c8f75 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66941670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:05.708072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:05.739188 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-843f9077-bafe-4ee6-83d0-c8361b875cfe tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.744002 Sep 03 21:02:05.746205 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1668/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:04 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:05.765390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-50b252e7-8b84-44ad-9ee1-ec6bef6e7de2 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:05.771763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-50b252e7-8b84-44ad-9ee1-ec6bef6e7de2 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:05.822202 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1196d57c-c3c1-467c-99aa-33e32b7c8f75 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a" status: 200 len: 222 microversion: 2.1 time: 0.453313 Sep 03 21:02:05.822803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1811/3479] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:05 2022] GET /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a => generated 222 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:05.838061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5edc938a-53d0-4446-af24-afe3f5019be1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae661eadc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:06.080994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-50b252e7-8b84-44ad-9ee1-ec6bef6e7de2 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:06.090232 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-50b252e7-8b84-44ad-9ee1-ec6bef6e7de2 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1244 microversion: 2.1 time: 0.339887 Sep 03 21:02:06.102267 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1669/3480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:05 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1244 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:06.769188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:06.770180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:06.779789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:06.780305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:06.780813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:06.781683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:06.782150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:06.782598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:06.827878 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5edc938a-53d0-4446-af24-afe3f5019be1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a" status: 202 len: 0 microversion: 2.1 time: 0.993317 Sep 03 21:02:06.831551 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1812/3481] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:05 2022] DELETE /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:02:06.837066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae661eab80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:06.911590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:06.912366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:06.913049 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.913049 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a HTTP/1.1 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9bba5d1a-a590-4f85-a9b4-0696c48c571a'} Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:06.931875 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] Sep 03 21:02:06.937987 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:06.950523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:06.950523 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-7b725ed4-5d40-4f5e-b475-6d23785403a8'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:06.955695 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13885c1d-5a46-4ebf-bfd4-c6c3a884697b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a" status: 404 len: 194 microversion: 2.1 time: 0.121323 Sep 03 21:02:06.957448 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1813/3482] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:06 2022] GET /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:02:06.970210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9484eb53-a7d8-4ef7-b468-1384c3fe2f5a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae66941430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94092365", "description": "tempest-description-1525701924"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:07.486881 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9484eb53-a7d8-4ef7-b468-1384c3fe2f5a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.520722 Sep 03 21:02:07.488176 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1814/3483] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:07.500263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:07.501044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:07.522142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:07.522770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:07.534039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:07.543523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:07.544092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:07.544555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:07.713739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:07.738575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f488dde-b9b3-472c-ae70-6ef2b9a5d5d0 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1248 microversion: 2.1 time: 0.248389 Sep 03 21:02:07.741250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1815/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:07 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1248 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:07.752722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdfadd6-48f2-4373-9453-a27d2919c6f6", "tag": "809cafe1-5246-4348-81ff-ab43f23ef668"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:07.779394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:07.779901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:07.780047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:07.784511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:07.792015 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e8458e18-5c0b-4f5f-b881-dfe78f5b0feb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 1.027157 Sep 03 21:02:07.796843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1670/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:06 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:07.804948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0066f8e9-582a-4fb5-839d-a1bc61de8610 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae66dc8a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1821839822", "description": "tempest-description-811649231"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:07.810473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] Creating event network-changed:809cafe1-5246-4348-81ff-ab43f23ef668 for instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 on nch2-master-1 Sep 03 21:02:07.834596 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-307d2a5c-177d-40c6-ab86-b0f9697b1710 req-b46f5a56-78f3-49a0-82fb-2f571c3a8cda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086271 Sep 03 21:02:07.836237 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1816/3486] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:08.767074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:08.767766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:08.780626 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0066f8e9-582a-4fb5-839d-a1bc61de8610 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.982484 Sep 03 21:02:08.781680 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1671/3487] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:08.787223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:08.788754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:08.795800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-35708496-842f-4c1a-8d9e-3f3c208a638c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae6b893ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1277384543", "description": "tempest-description-1395164740"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:08.800138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:08.805179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:08.810181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:08.810914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:09.189362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:09.207350 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6f10e8cb-e679-484b-90b0-67bb95738776 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1296 microversion: 2.1 time: 0.445751 Sep 03 21:02:09.208569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1817/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:08 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1296 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:09.230530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:09.233748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:09.246716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:09.248052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:09.250462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:09.251646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:09.253164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:09.254019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:09.450175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-35708496-842f-4c1a-8d9e-3f3c208a638c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.660051 Sep 03 21:02:09.451145 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1672/3489] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:09.474622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-063f6931-fdba-45f1-bedf-790f39f06435 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae6b855d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:09.783400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:09.793889 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92965b3d-63bd-426a-adbf-29052fb80409 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.583380 Sep 03 21:02:09.796925 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1818/3490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:09 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:10.216542 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-063f6931-fdba-45f1-bedf-790f39f06435 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.755640 Sep 03 21:02:10.217848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1673/3491] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 21:02:09 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:10.233037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90b33baa-f1e0-4a47-946c-47cc4b5f29a7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66973e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:10.239605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:10.240400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:10.252312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:10.253022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:10.254709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:10.256498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:10.257205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:10.259909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:10.861908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:10.871906 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d21d181-c3c1-40d4-9365-1657c741b694 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1302 microversion: 2.1 time: 0.636082 Sep 03 21:02:10.893167 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1674/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:10 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1302 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:10.893167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:10.893167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:10.920061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:10.921965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:10.922613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:10.926406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:10.928286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:10.930448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:11.062305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90b33baa-f1e0-4a47-946c-47cc4b5f29a7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a" status: 202 len: 0 microversion: 2.1 time: 0.833929 Sep 03 21:02:11.063389 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1819/3493] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:10 2022] DELETE /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:11.068747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d35a7-962c-4f18-bed1-d5ffcec17e48", "name": "network-vif-plugged", "status": "completed", "tag": "14d5226c-c9c1-42ed-bcc1-10c2d9dc519e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:11.098124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:11.100982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:11.104555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:11.183921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] Creating event network-vif-plugged:14d5226c-c9c1-42ed-bcc1-10c2d9dc519e for instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 on nch1-master-1 Sep 03 21:02:11.207747 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-03946209-f9f7-4f29-b62e-1170937d6e08 req-b2ef0e2c-9be8-48d9-a0f9-23e5923238e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142823 Sep 03 21:02:11.212706 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1820/3494] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:12.094342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5c5da221-3f88-436d-8def-eddf3f5e442b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Action: 'create', calling method: .version_select at 0x7fae661ea550>, body: {"keypair": {"name": "tempest-keypair-1899432498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa6Yo3lVoxcYE46PX1zduW6QXD0nF3PPzHln7ly6YLU5+8j9XWqLq65fxb56HicM4dZKcI410PUbGyEH2oRSCgZkKFvhUT3YOx2tWaM8mkH/wL9aKT181jz/li8c8V4Vw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:12.132506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5c5da221-3f88-436d-8def-eddf3f5e442b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:02:12.159045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5c5da221-3f88-436d-8def-eddf3f5e442b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for user 1b2dd96d938b41d4ba40007aa072288b and project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:02:12.233924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5c5da221-3f88-436d-8def-eddf3f5e442b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.016204 Sep 03 21:02:12.234886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1821/3495] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:02:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:12.247575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae668fbdc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:12.330367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:12.331514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:12.332368 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.332368 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a HTTP/1.1 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a'} Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:12.335149 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-c717e7ab-b576-4525-af85-c5c0a1825bc0'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7aeee72e-0e4b-45e6-9d24-67a5c99b8154 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a" status: 404 len: 194 microversion: 2.1 time: 0.100610 Sep 03 21:02:12.344444 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1822/3496] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:12 2022] GET /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:12.352824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:12.358061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:12.385385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:12.386488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:12.387111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:12.390318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:12.393875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:12.394668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:12.533613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:12.546363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0e772fc-c4b5-4093-a7a5-79504ccb824f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 1.659988 Sep 03 21:02:12.546970 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1675/3497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:10 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:12.584804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb261f77-cea2-4b16-bd93-a95ec5dda952 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae6718b670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:12.724238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:12.735664 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29804983-9176-44e0-ba7c-ec99df6eb29d tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1302 microversion: 2.1 time: 0.394448 Sep 03 21:02:12.739798 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1823/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:12 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1302 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:13.347510 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb261f77-cea2-4b16-bd93-a95ec5dda952 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7" status: 202 len: 0 microversion: 2.1 time: 0.784107 Sep 03 21:02:13.351382 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1676/3499] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:12 2022] DELETE /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:13.357751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66a61280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:13.505190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:13.506947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:13.509168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.509168 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 HTTP/1.1 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '637283e9-c5c9-4a99-9dd7-9f30e57dc6d7'} Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:13.511612 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-135afe1c-68ee-4627-bc1d-f752a9e9f2ad'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d349dd8-5aba-4f55-afc7-f8439a93d459 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7" status: 404 len: 194 microversion: 2.1 time: 0.160623 Sep 03 21:02:13.515496 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1824/3500] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:13 2022] GET /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:02:13.532349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-470198dd-4b16-44e8-8f54-cb7b6e25279e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66842f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:13.573664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:13.574396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:13.610470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:13.611246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:13.614221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:13.615152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:13.618149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:13.618793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:13.910924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:13.933065 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c38a18a5-79da-466c-8e61-15300ac1b8a6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1321 microversion: 2.1 time: 0.362273 Sep 03 21:02:13.953265 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1825/3501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:13 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:13.960552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:13.961282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:13.969471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:13.970306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:13.973793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:13.974819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:13.975546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:13.978296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:13.990040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:14.349072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:14.381521 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39e6efbf-6bf2-4b17-ba01-08a43950be9b tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.407007 Sep 03 21:02:14.381521 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1826/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:13 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:14.421448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb", "name": "network-vif-plugged", "status": "completed", "tag": "8f999e56-718f-4e7d-9370-3efa7e4e4933"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:14.458439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:14.458439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:14.458439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:14.510240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] Creating event network-vif-plugged:8f999e56-718f-4e7d-9370-3efa7e4e4933 for instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb on nch2-master-1 Sep 03 21:02:14.522698 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-988510d9-74ed-4d8c-b826-d4dad1c537dc req-7ce53577-8998-4053-8449-028dd1d368d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155755 Sep 03 21:02:14.523783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1827/3503] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:14.664910 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-470198dd-4b16-44e8-8f54-cb7b6e25279e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239" status: 202 len: 0 microversion: 2.1 time: 1.138272 Sep 03 21:02:14.665824 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1677/3504] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:13 2022] DELETE /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239 => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:14.677583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66907670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:14.760946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:14.761557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 not found {{(pid=140520) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:14.762093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.762093 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239 HTTP/1.1 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: exception: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '8e5ad52e-cf85-4192-aa9b-ba29b51a6239'} Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:14.766566 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-d5a34fcf-eafc-46ee-97f4-60d893f64ada'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:14.771033 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aff11a1c-98eb-443f-90cb-6fc1069e40c7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239" status: 404 len: 194 microversion: 2.1 time: 0.097667 Sep 03 21:02:14.777065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1828/3505] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:14 2022] GET /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:14.784704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-863c3390-6782-4db9-93e3-98b0db157d5c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66e6f0d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:14.959175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:14.959916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:14.974006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:14.974534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:14.974992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:14.975788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:14.976273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:14.976746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:15.195727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:15.387724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:15.404127 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d99f6d71-1cd7-4ee2-bf1b-fceb478e3641 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1510 microversion: 2.1 time: 0.449360 Sep 03 21:02:15.419102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1829/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:14 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:15.444282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:15.445198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:15.453393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:15.455752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:15.456454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:15.474609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:15.476597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:15.477365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.088347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:16.136135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:16.149678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cabb920d-1d57-4141-b821-852ec724efa7 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.715186 Sep 03 21:02:16.151267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1830/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:15 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:16.158515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:16.159544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:16.185444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:16.186327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:16.187834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.200556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:16.201536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:16.202221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.579834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:16.592057 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-17c8d03a-aee4-4aba-9e90-615c8755c170 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1321 microversion: 2.1 time: 0.439404 Sep 03 21:02:16.596370 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1831/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:16 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:16.607877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdfadd6-48f2-4373-9453-a27d2919c6f6", "name": "network-vif-plugged", "status": "completed", "tag": "809cafe1-5246-4348-81ff-ab43f23ef668"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:16.622944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:16.624082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:16.624860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.659403 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] Creating event network-vif-plugged:809cafe1-5246-4348-81ff-ab43f23ef668 for instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 on nch2-master-1 Sep 03 21:02:16.667923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-782530a5-ec32-4361-9aea-054e761c97ec req-58426126-1e38-4508-9af0-15fe6b3e79ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069548 Sep 03 21:02:16.669564 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1832/3509] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:16.701949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-863c3390-6782-4db9-93e3-98b0db157d5c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.922431 Sep 03 21:02:16.702716 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1678/3510] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 21:02:14 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:16.745652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-33a6e7bb-5ecf-4507-8de5-6ba4c2058183 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae66350b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-324493981", "description": "tempest-description-1383853065"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:16.800574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:16.830347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:16.832872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Searching by: {'deleted': False, 'project_id': '146fb657f35e47de8fbad6cacc39f501'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:16.863693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:16.864462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:16.866395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.867334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:16.870174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:16.875370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:16.966079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:17.059696 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-216ebaba-2494-49d0-acd3-d7709100266c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.264095 Sep 03 21:02:17.061118 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1679/3511] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 21:02:16 2022] GET /compute/v2.1/servers => generated 340 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:17.071820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-33a6e7bb-5ecf-4507-8de5-6ba4c2058183 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.353632 Sep 03 21:02:17.083138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1833/3512] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:17.085038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:17.091156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f172661f-6104-4f88-bc87-3a425903b32f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae661e6af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-675798796", "description": "tempest-description-293753230"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:17.094311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:17.101619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Searching by: {'deleted': False, 'project_id': '146fb657f35e47de8fbad6cacc39f501'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:17.110692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:17.111189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:17.111634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:17.114773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:17.115250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:17.115688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:17.168377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:17.353227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:17.382273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:17.382743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:17.386107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:17.731169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f172661f-6104-4f88-bc87-3a425903b32f tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.645512 Sep 03 21:02:17.732264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1834/3513] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:17 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:17.738961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:17.739949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:17.789277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:17.790985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:17.793821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:17.794798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:17.795435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:17.799948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:18.343697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a7a6293-f5c1-49dd-9897-14b77cb33e38 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.268267 Sep 03 21:02:18.344617 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1680/3514] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:02:17 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:18.354237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:18.362378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:18.363016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:18.365761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c847740d-8927-48ee-b96e-22d8f53a46b8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.632115 Sep 03 21:02:18.374145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:18.374785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:18.375327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:18.376156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:18.377849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:18.378208 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1835/3515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:17 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:18.378383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:18.416944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1326403449", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "49150632-99e2-4d38-875c-7389edde5823"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:18.603097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] validate_networks() for [('49150632-99e2-4d38-875c-7389edde5823', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:02:19.107632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:19.123182 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83dcc5e7-d4fe-4456-bb47-b21164de70d4 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1510 microversion: 2.1 time: 0.777441 Sep 03 21:02:19.147938 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1681/3516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:18 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1510 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:19.158012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17e09a38-aabe-46f6-86f0-a09d9bb0f23b tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:19.170934 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17e09a38-aabe-46f6-86f0-a09d9bb0f23b tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020871 Sep 03 21:02:19.172800 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1682/3517] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:02:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:19.201783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:19.203715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:19.214977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.216163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.216853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.218267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.218978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.219760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.496045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:19.509090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d6b17c96-bc7a-4b44-a33f-0337bfb55ecf tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1321 microversion: 2.1 time: 0.334914 Sep 03 21:02:19.525073 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1683/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:19 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:19.535249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:19.538078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:19.560155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.560663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.561170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.561938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.562369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.562808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.904696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:02:19.905220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:02:19.905642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:02:19.906057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:02:19.906467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:02:19.925836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:19.936729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-faf7f390-59f4-4685-96ef-cac4f2a2e0a8 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.410387 Sep 03 21:02:19.939808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=17 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:19.941370 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1684/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:19 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:19.944165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.947281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:19.947984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:19.953690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.954148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.954994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.955451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.955913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.959113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.960138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.961931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:19.976237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:19.977341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:19.978178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.038350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Getting quotas for project 30d39cd627084dda8cb00e993f5d19a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:02:20.042717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:02:20.047922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Getting quotas for user 3a394ae937c54b2a82c89628d4feeb72 and project 30d39cd627084dda8cb00e993f5d19a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:02:20.095381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:02:20.102260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:02:20.233935 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-890ed0a6-ba1e-447f-a3f0-6a336514b040 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838958 Sep 03 21:02:20.236474 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1836/3520] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:02:20.237623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-35e4d7e4-71f2-4d88-8e70-4f96dadde97c tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 204 len: 0 microversion: 2.1 time: 0.292168 Sep 03 21:02:20.238973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1685/3521] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:02:19 2022] DELETE /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:02:20.259893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6406841-4c7c-4de3-9ae4-d11d6e6d8237", "tag": "d75e0aee-26b7-462f-bfd0-d3c0b6aea591"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:20.265298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0342d14-621d-4b4a-b00e-213887106d6a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:20.268101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0342d14-621d-4b4a-b00e-213887106d6a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:20.319490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.320668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.321155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.351790 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] Creating event network-changed:d75e0aee-26b7-462f-bfd0-d3c0b6aea591 for instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 on nch1-master-1 Sep 03 21:02:20.364543 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9a1d4a91-52dc-4f76-b365-611a02907cae req-655af062-53ce-47e0-ac21-0d75265d981d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124235 Sep 03 21:02:20.366855 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1837/3522] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:20.378280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:20.381369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:20.398256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.400094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.400742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.403669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.407083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.407792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.580865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0342d14-621d-4b4a-b00e-213887106d6a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:20.589465 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0342d14-621d-4b4a-b00e-213887106d6a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1216 microversion: 2.1 time: 0.340104 Sep 03 21:02:20.590274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1686/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:20 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1216 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:20.614063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:20.615351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:20.647862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.650135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.650718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.652075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.653157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.654949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.802826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:20.812445 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b74033f-3bd8-44a6-a9a3-39d4ebc0620a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1715 microversion: 2.1 time: 0.444129 Sep 03 21:02:20.813609 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1838/3524] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:20 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1715 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:20.982999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:20.985255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:20.994576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.995478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.996255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:20.997360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:20.998977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:20.999443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.017763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:21.027202 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c07884d4-98f1-424c-9926-b2a234008a20 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1511 microversion: 2.1 time: 0.434526 Sep 03 21:02:21.027801 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1687/3525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:20 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:21.051255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:21.058604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:21.059715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:21.073336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:21.074147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:21.074750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.075509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:21.075976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:21.076411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.191021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:21.262448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:21.272599 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cafa467e-6732-46ff-bb3f-171de15e8537 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.306417 Sep 03 21:02:21.274100 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1839/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:20 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:21.289830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:21.289830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:21.289830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:21.289830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.299490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1100704220", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5780802-a1fc-4924-b8ce-277d6139e7c9"}], "security_groups": [{"name": "tempest-securitygroup--1289254284"}], "key_name": "tempest-keypair-1899432498", "user_data": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:21.473332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] validate_networks() for [('c5780802-a1fc-4924-b8ce-277d6139e7c9', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:02:21.518616 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15b08c0a-13fe-4c2d-8015-b6560aa35784 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.471466 Sep 03 21:02:21.519591 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1688/3527] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Sep 3 21:02:21 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:21.554232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:21.564728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:21.568677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1166462711', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:21.581028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:21.590787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:21.591781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.594236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:21.595852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:21.598059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:21.855511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:22.016450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:22.049358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.050236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.052400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.368621 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-99fb96c4-7ee3-4498-ae55-376a9cdee08b tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1166462711" status: 200 len: 1513 microversion: 2.1 time: 0.819681 Sep 03 21:02:22.389132 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1689/3528] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 21:02:21 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1166462711 => generated 1513 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:22.419911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:22.420542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:22.468116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.469657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.470367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.472154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.474246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.475008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.482475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:22.571177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:22.582424 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6f3795f-8776-4e3f-bfab-6d0b000b0a7c tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1268 microversion: 2.1 time: 0.198493 Sep 03 21:02:22.584149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1690/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:22 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:22.590528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:22.591415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:22.615650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.619046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.620729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.624570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.627720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.628562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.694933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:02:22.696059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:02:22.696852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:02:22.697505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:02:22.698124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:02:22.723229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.724320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.728961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.736131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:22.737879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:22.738609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:22.823149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:02:22.840009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for user 1b2dd96d938b41d4ba40007aa072288b and project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:02:22.890213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:02:22.897322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:02:22.992238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:23.031358 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28bc2540-1736-4869-9882-a7e38d2c5490 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.738829 Sep 03 21:02:23.050016 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1840/3530] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:02:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:02:23.055557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:23.083942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:23.121873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:23.122390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:23.122855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:23.123577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:23.124046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:23.124487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:23.590440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:23.602659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-237b89a1-e988-4076-bc55-82137a698f24 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1715 microversion: 2.1 time: 1.017124 Sep 03 21:02:23.608179 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1691/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:22 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1715 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:23.619486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:23.644325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:23.648812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:23.650955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:23.671906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:23.672418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:23.672874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:23.673654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:23.674116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:23.674556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:23.774268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:23.790281 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c7878823-367b-47d2-880a-18c08f78edf1 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.738307 Sep 03 21:02:23.793943 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1841/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:23 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:23.811789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df2d3f28-d54a-4f32-8413-611d340a93d3 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:23.813241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df2d3f28-d54a-4f32-8413-611d340a93d3 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:23.956808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df2d3f28-d54a-4f32-8413-611d340a93d3 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:23.972090 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df2d3f28-d54a-4f32-8413-611d340a93d3 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1238 microversion: 2.1 time: 0.175280 Sep 03 21:02:23.973026 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1842/3533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:23 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1238 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:24.007811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:24.008683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:24.029960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.034851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.037115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.039382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.039525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:24.040400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.043248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.226675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:24.244838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.245405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.251844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.317715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:24.336777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85858405-e478-4726-9edb-b6de70dc37a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1274 microversion: 2.1 time: 0.340509 Sep 03 21:02:24.337408 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1843/3534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:23 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:24.742193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b780568d-cb4f-467e-9bcf-848f311908c2 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Calling method '.version_select at 0x7fae6689ee50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:24.773459 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b780568d-cb4f-467e-9bcf-848f311908c2 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b780568d-cb4f-467e-9bcf-848f311908c2 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/images/d23f3ada-8b17-49b5-b81b-31acbc91b1be/metadata/os_distro HTTP/1.1 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'image_id': 'd23f3ada-8b17-49b5-b81b-31acbc91b1be', 'id': 'os_distro'} Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d23f3ada-8b17-49b5-b81b-31acbc91b1be Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:24.802341 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d23f3ada-8b17-49b5-b81b-31acbc91b1be could not be found. Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:24.808838 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:24.816198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b780568d-cb4f-467e-9bcf-848f311908c2 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:24.816198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b780568d-cb4f-467e-9bcf-848f311908c2 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "DELETE /compute/v2.1/images/d23f3ada-8b17-49b5-b81b-31acbc91b1be/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.477446 Sep 03 21:02:24.817576 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1844/3535] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Sep 3 21:02:24 2022] DELETE /compute/v2.1/images/d23f3ada-8b17-49b5-b81b-31acbc91b1be/metadata/os_distro => generated 62 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:24.826946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:24.828371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:24.836148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.836891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.837606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.838496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.839312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.840064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.888209 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9540dc04-51b8-4641-aa65-b7233b0d852f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 1.278494 Sep 03 21:02:24.889092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1692/3536] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Sep 3 21:02:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:24.893900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:24.894699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:24.926985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.926985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.926985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.926985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:24.927714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:24.927899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:24.952555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:24.965165 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95ba6103-5a59-4e23-9431-460b7193f926 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1647 microversion: 2.1 time: 0.146291 Sep 03 21:02:24.966179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1845/3537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:24 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1647 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:24.970810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac83b7da-4ea5-4617-b79a-39161069b075 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Calling method '.version_select at 0x7fae6689ea60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.006469 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-ac83b7da-4ea5-4617-b79a-39161069b075 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac83b7da-4ea5-4617-b79a-39161069b075 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/images/e16e9a54-326a-454f-89c1-246ec21ab75d/metadata/os_version HTTP/1.1 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'image_id': 'e16e9a54-326a-454f-89c1-246ec21ab75d', 'id': 'os_version'} Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e16e9a54-326a-454f-89c1-246ec21ab75d Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:25.008343 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e16e9a54-326a-454f-89c1-246ec21ab75d could not be found. Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac83b7da-4ea5-4617-b79a-39161069b075 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:25.013592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac83b7da-4ea5-4617-b79a-39161069b075 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "GET /compute/v2.1/images/e16e9a54-326a-454f-89c1-246ec21ab75d/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.042668 Sep 03 21:02:25.018775 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1846/3538] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Sep 3 21:02:24 2022] GET /compute/v2.1/images/e16e9a54-326a-454f-89c1-246ec21ab75d/metadata/os_version => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:25.021624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.027474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.027937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.servers [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Removing options 'limit' from query {{(pid=140520) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 03 21:02:25.029874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:25.040222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.040721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.041211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.041954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.042974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.043422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.108669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.124198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.128985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.129651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.239650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.248305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08f854d3-530f-4c5f-a330-2971ee2d3969 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.357911 Sep 03 21:02:25.262129 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1693/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:24 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.270261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.270892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:25.277442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.277943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.278402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.279087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.279617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.280058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.310086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e28da760-2b01-4f15-8132-4ca60a560d69 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.292084 Sep 03 21:02:25.310850 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1847/3540] 10.222.0.16 () {58 vars in 1161 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.315657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5c7e192-6df6-41e7-b9fd-e86b0e4c5513 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Calling method '.version_select at 0x7fae669d0a60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.342405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d5c7e192-6df6-41e7-b9fd-e86b0e4c5513 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5c7e192-6df6-41e7-b9fd-e86b0e4c5513 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/images/edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a/metadata HTTP/1.1 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'image_id': 'edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a'} Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:25.344484 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a could not be found. Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5c7e192-6df6-41e7-b9fd-e86b0e4c5513 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:25.348795 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5c7e192-6df6-41e7-b9fd-e86b0e4c5513 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "GET /compute/v2.1/images/edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034625 Sep 03 21:02:25.360539 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1848/3541] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/images/edc9e0c9-d2e9-4aa1-8bc0-b12f78cb8a0a/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:25.365089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44248bd8-d4ef-4152-9118-df5b56ff43d9", "name": "network-vif-deleted", "tag": "239bbbee-9280-4147-9d2e-62064fc60a52"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:25.378255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.378932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.379892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.392426 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] Creating event network-vif-deleted:239bbbee-9280-4147-9d2e-62064fc60a52 for instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 on nch1-master-1 Sep 03 21:02:25.398737 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cf252a3b-de0c-4786-9f0a-c92d2d93767b req-0e9ef5b4-0009-49eb-a94c-d8de15b4e5aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 Sep 03 21:02:25.400661 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1849/3542] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:25.408003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.408628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.414508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.415643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:25.416396 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-58a9b3d1-c32f-4410-84b0-919b3c9b7959 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1234 microversion: 2.1 time: 0.153146 Sep 03 21:02:25.429340 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1694/3543] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1234 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.429340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae96b6e2-7c28-4cf4-906a-8eb2ce2f3b4e tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Action: 'update_all', calling method: .version_select at 0x7fae662c64c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:25.441088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.442813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.445671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.447195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.449105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.449812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ae96b6e2-7c28-4cf4-906a-8eb2ce2f3b4e tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae96b6e2-7c28-4cf4-906a-8eb2ce2f3b4e tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/images/88ca87dd-8e18-41f1-9854-a0d922aafed5/metadata HTTP/1.1 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 57 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'image_id': '88ca87dd-8e18-41f1-9854-a0d922aafed5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 88ca87dd-8e18-41f1-9854-a0d922aafed5 Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:25.488221 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88ca87dd-8e18-41f1-9854-a0d922aafed5 could not be found. Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae96b6e2-7c28-4cf4-906a-8eb2ce2f3b4e tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:25.492184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae96b6e2-7c28-4cf4-906a-8eb2ce2f3b4e tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "PUT /compute/v2.1/images/88ca87dd-8e18-41f1-9854-a0d922aafed5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064116 Sep 03 21:02:25.496094 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1695/3544] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:02:25 2022] PUT /compute/v2.1/images/88ca87dd-8e18-41f1-9854-a0d922aafed5/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:25.499726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.504638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:25.509229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:25.526437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.526951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.527407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.529928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.530813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.532481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.615415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-86900d36-b36f-4394-a168-d114209b8706 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.213168 Sep 03 21:02:25.624633 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1850/3545] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.631592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edb39635-7019-437d-9801-396ddef3e474 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Action: 'update', calling method: .version_select at 0x7fae669638b0>, body: {"meta": {"os_distro": "alt"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:25.686760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-edb39635-7019-437d-9801-396ddef3e474 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edb39635-7019-437d-9801-396ddef3e474 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/images/a7cd9529-e8dc-43c7-ba87-c51e9d54885d/metadata/os_distro HTTP/1.1 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 30 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: {"meta": {"os_distro": "alt"}} Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: exception: Image not found. Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'image_id': 'a7cd9529-e8dc-43c7-ba87-c51e9d54885d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a7cd9529-e8dc-43c7-ba87-c51e9d54885d Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:25.689368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7cd9529-e8dc-43c7-ba87-c51e9d54885d could not be found. Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edb39635-7019-437d-9801-396ddef3e474 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-edb39635-7019-437d-9801-396ddef3e474 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "PUT /compute/v2.1/images/a7cd9529-e8dc-43c7-ba87-c51e9d54885d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.064874 Sep 03 21:02:25.693949 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1851/3546] 10.222.0.16 () {60 vars in 1310 bytes} [Sat Sep 3 21:02:25 2022] PUT /compute/v2.1/images/a7cd9529-e8dc-43c7-ba87-c51e9d54885d/metadata/os_distro => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:25.697264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.713200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.713660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.servers [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Removing options 'limit' from query {{(pid=140520) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 03 21:02:25.714946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:25.727725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.728219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.728658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.730260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.730735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.731169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.785076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:25.859186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.868941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c239075-e041-484a-b533-411188208bfc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.373388 Sep 03 21:02:25.873309 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1696/3547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.878119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f0d7966-1bf3-4ca6-ab8d-33459592d495 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Action: 'create', calling method: .version_select at 0x7fae662c6c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:25.878352 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f85a10ba-7645-4058-b608-fff4242edf4a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.179692 Sep 03 21:02:25.880213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1852/3548] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:25.896055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.901138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:25.902533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:25.906733 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-9f0d7966-1bf3-4ca6-ab8d-33459592d495 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] HTTP exception thrown: Image not found. Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f0d7966-1bf3-4ca6-ab8d-33459592d495 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Request method failure captured: Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/images/58c886c5-61bb-43f6-9f60-c2294467b925/metadata HTTP/1.1 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 57 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DfFIA-R-VdTOAmO-SCEIeEA-wtoNvlTo7KPKZge-NAToARefMjTX_ST-nLO7X2XTe8fVMNp78y-nSFYif27WcmN_MZZKvyG8PAoVL54gNSTfz5Z8TSUepLhwAHayt5mxnxQUVNBBDYUclTdHOMEjkkq3MEIJE50tKPpzbY3wnG-5c Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e50b6481544a30bce4e39f80dd6eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 58e50b6481544a30bce4e39f80dd6eae Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 2a51b34b13cf44d99b9d385a5f29ad1c Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1068610515-project Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: exception: Image not found. Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'image_id': '58c886c5-61bb-43f6-9f60-c2294467b925', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58c886c5-61bb-43f6-9f60-c2294467b925 Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 03 21:02:25.911704 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58c886c5-61bb-43f6-9f60-c2294467b925 could not be found. Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 03 21:02:25.918225 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:25.921505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f0d7966-1bf3-4ca6-ab8d-33459592d495 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] Returning 404 to user: Image not found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:25.922283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f0d7966-1bf3-4ca6-ab8d-33459592d495 tempest-ImagesMetadataNegativeTestJSON-1068610515 tempest-ImagesMetadataNegativeTestJSON-1068610515-project] 10.222.0.16 "POST /compute/v2.1/images/58c886c5-61bb-43f6-9f60-c2294467b925/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047873 Sep 03 21:02:25.924713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.925035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1697/3549] 10.222.0.16 () {60 vars in 1281 bytes} [Sat Sep 3 21:02:25 2022] POST /compute/v2.1/images/58c886c5-61bb-43f6-9f60-c2294467b925/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:02:25.925743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.926490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.932301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:25.940050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:25.941865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:25.977844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:25.994332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:25.995183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:26.007951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.008574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.021104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.021104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.021104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.021104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.059056 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6672321b-68d0-4567-bccf-302a4c659ffc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.167248 Sep 03 21:02:26.059657 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1853/3550] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers => generated 1012 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:26.075281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.082835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.086565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:26.107488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.107488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.110894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.111737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.112277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.112644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.195987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:26.216034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.219295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:26.226990 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98e103b4-9045-47a9-8fac-ddaedc821bed tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1647 microversion: 2.1 time: 0.239636 Sep 03 21:02:26.230448 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1698/3551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:25 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1647 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:26.274316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.274941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:26.286314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.287036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.287643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.288378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.288842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.289306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.323052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d5b2f3e-dd56-40a9-b4a5-e4c2891d8644 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.249929 Sep 03 21:02:26.323996 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1854/3552] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:26.341655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.360102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.361694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.compute.servers [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Removing options 'limit' from query {{(pid=140520) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 03 21:02:26.363634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:26.385143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.386412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.386859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.389170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.390278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.390870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.436579 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95ef5a1e-4825-4735-af20-91784da64a4c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.100817 Sep 03 21:02:26.436579 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1855/3553] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:02:26.457851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.459146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:26.474216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.475546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.476879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.478274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.478908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.479733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.565413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.588544 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5815b15-c79c-4ec1-9553-6b929c9caef5 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1234 microversion: 2.1 time: 0.150179 Sep 03 21:02:26.589728 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1856/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1234 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:26.595432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.606674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.615864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:26.616782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1166462711', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:26.624191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.625076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.625720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.625851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1f67da6-3e7e-4d43-89f5-8131ef5e4831 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.355202 Sep 03 21:02:26.626353 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1699/3555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:26.627156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.627858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.628354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.766657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:26.853660 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e3a599d8-5eda-4bb1-ad8c-8a81a44fa455 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1166462711" status: 200 len: 346 microversion: 2.1 time: 0.262592 Sep 03 21:02:26.867958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a76caa-3377-462f-ab5b-6c49c567b4c0", "tag": "b5038109-8580-455e-b7ab-ff026aa2b6ad"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:26.871871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1857/3556] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1166462711 => generated 346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:26.888327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:26.903727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.903912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.904374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.904514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.904830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.905402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.951087 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] Creating event network-changed:b5038109-8580-455e-b7ab-ff026aa2b6ad for instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 on nch2-master-1 Sep 03 21:02:26.960984 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6be5e09e-ce2f-47ff-b771-57b7f85a7b9e req-32c29ecb-b240-45f8-931a-a332f092c444 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100982 Sep 03 21:02:26.962733 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1700/3557] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:26.976201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:26.977335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:26.996171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:26.996694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:26.999486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:26.999924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.003336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.003822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.015282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:02:27.207851 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84563598-6c99-47e3-bbe7-d442166db560 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "POST /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.329199 Sep 03 21:02:27.213262 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1858/3558] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:02:26 2022] POST /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:27.237346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:27.238083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:27.263574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.270129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.270927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.271883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.272535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.273370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.340182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:27.351805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-33c4c48c-f5b2-44ca-94eb-dfb36aace8ba tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.387573 Sep 03 21:02:27.353437 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1701/3559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:26 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:27.369194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:27.370053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:27.383134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.383922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.384604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.386385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.388261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.389841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.563874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:27.573363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0e42d08-49eb-4e44-bda0-f85cc4b5333d tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1363 microversion: 2.1 time: 0.216280 Sep 03 21:02:27.582565 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1702/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:27 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:27.611858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:27.612729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:27.623165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.625245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.627150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.629972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.630547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.631527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.726404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:27.736237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e8a7129-4473-4347-8ade-bcb140088605 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.520678 Sep 03 21:02:27.743393 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1859/3561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:27 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:27.760473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:27.763542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:27.793040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.793780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.794821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.796964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:27.797427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:27.798019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:27.862427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:27.872220 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-589e72ea-492c-4e3c-aa38-eeae34d43d35 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1290 microversion: 2.1 time: 0.264166 Sep 03 21:02:27.875397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1703/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:27 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1290 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:28.014385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:28.022356 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19621ed1-43da-43c2-91ea-c3875e1e754f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.274473 Sep 03 21:02:28.023275 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1860/3563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:27 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:28.378632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:28.379252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:28.386105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.386589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.387467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.388771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.389592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.390096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.574151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:28.584314 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0509b509-2a8b-4348-a355-8de0310bbb00 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.209263 Sep 03 21:02:28.596685 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1704/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:28 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:28.597943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:28.598566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:28.605933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.606447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.607034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.608024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.608516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.608971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.643948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.644843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.645484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.645941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lazy-loading 'fault' on Instance uuid 44248bd8-d4ef-4152-9118-df5b56ff43d9 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:02:28.693496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:28.705073 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38d697ab-ac5e-4524-91ec-7470909fc6ac tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1368 microversion: 2.1 time: 0.111151 Sep 03 21:02:28.705809 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1861/3565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:28 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:28.766456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:28.767113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:28.773826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.774324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.774772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.775477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.776156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.776463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.899465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:28.900225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:28.908140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.908764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.909329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.910132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:28.910663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:28.911161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:28.978789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:28.989392 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-162f836a-060b-48ca-a237-dfb18fc4abd1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1290 microversion: 2.1 time: 0.093672 Sep 03 21:02:28.990035 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1862/3566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:28 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:29.046782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:29.047516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:29.053695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.054214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.054651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.055350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.055806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.056237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.241935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:29.260188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:29.263473 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a24d47d0-dac5-4f55-8c89-04e8eb57ba35 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.500150 Sep 03 21:02:29.267145 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1705/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:28 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:29.282921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08ae6054-6c7a-4ee2-b23d-dc9ff6808109 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.239383 Sep 03 21:02:29.284592 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1863/3568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:29 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:29.611787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:29.612471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:29.620968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.621468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.621905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.622662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.623416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.623952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.731170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:29.732304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:29.739439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.740333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.741070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.741874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.742793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.743480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.778574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:29.779440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:29.780095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:29.780767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lazy-loading 'fault' on Instance uuid 44248bd8-d4ef-4152-9118-df5b56ff43d9 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:02:29.844289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:29.857574 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2ea96d5-8f7d-43a7-a698-435ddb405a8f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1368 microversion: 2.1 time: 0.131637 Sep 03 21:02:29.859205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1864/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:29 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:29.928806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:29.938552 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de8e228a-3046-465d-885d-875af64b55b0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.331597 Sep 03 21:02:29.941915 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1706/3570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:29 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:30.015019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:30.015797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:30.023461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.024687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.024687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.025406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.025912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.026950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.102784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:30.115163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bc6072ed-4089-4da7-90c4-c37ecf0d8b30 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1290 microversion: 2.1 time: 0.104590 Sep 03 21:02:30.137957 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1865/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:30 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:30.297216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:30.297887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:30.306428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:30.307313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:30.318127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.318643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.320245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.321462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.323500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.324434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.326348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.328125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.328806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.334960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.335853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.336468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.523705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:30.536655 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-71ef4089-a29d-4104-bd82-f5adff8563de tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.233765 Sep 03 21:02:30.549552 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1866/3572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:30 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:30.750992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:30.770062 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9edf7768-dba7-4881-863a-d72572da2a4f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.483746 Sep 03 21:02:30.773530 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1707/3573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:30 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:30.881559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:30.884492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:30.896069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.896582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.897070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.897792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.898252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.900832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.963896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:30.964522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:30.966700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.967454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.968140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.969340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lazy-loading 'fault' on Instance uuid 44248bd8-d4ef-4152-9118-df5b56ff43d9 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:02:30.976487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.977028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.977480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:30.978204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:30.978667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:30.979101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.090458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8923b1af5fd54c31ac0af85564cfdd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146fb657f35e47de8fbad6cacc39f501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:31.100363 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a6eb42b5-4881-4aa8-b9fa-66c1710c5b3a tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 200 len: 1368 microversion: 2.1 time: 0.223275 Sep 03 21:02:31.101345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1867/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:30 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:31.158603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:31.171834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:31.195667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.202274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.213391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.214972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.215871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.216422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.300369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:31.417685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:31.431495 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58179ee2-04ff-4c37-8b19-1d87fadc43df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1298 microversion: 2.1 time: 0.282586 Sep 03 21:02:31.432251 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1868/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:31 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1298 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:31.561206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:31.562088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:31.573491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.574240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.574988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.575924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.576609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.577310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.806516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:31.814000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:31.825949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e5289a0-2467-48da-9cd6-7ee6d3afe76a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.866201 Sep 03 21:02:31.831261 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1708/3576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:30 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:31.836248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:31.842885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:31.858598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.858956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.860709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:31.861823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:31.864031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:31.864660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.061558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:32.078653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48c2749b-12a9-450c-8880-d21a408c44dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.520211 Sep 03 21:02:32.081420 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1869/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:31 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:32.150673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:32.159569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] [instance: 44248bd8-d4ef-4152-9118-df5b56ff43d9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:32.168055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.170278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.171326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.172290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.172942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.173612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.196885 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] HTTP exception thrown: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Request method failure captured: Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 HTTP/1.1 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8B1WMcNIL_qHX4Q6xktNYD7W-zFNrxu_NlTlCrZpXJ6tQ58H9p8864nN5zxCsSQgkcA2vk4CyYfmlIJvSSzhOkqBqx6xFbwDYBFL2_gHUmS_7EAoBUrPvePqpolQJ2nG0F9pdr5bRQPFyLmKv8CoLxu1tR3wyDf6Cqs0QYXY7gDdPM Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 146fb657f35e47de8fbad6cacc39f501 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestManualDisk-1423667210 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/146fb657f35e47de8fbad6cacc39f501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_146fb657f35e47de8fbad6cacc39f501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/146fb657f35e47de8fbad6cacc39f501"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/146fb657f35e47de8fbad6cacc39f501"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestManualDisk-1423667210 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 146fb657f35e47de8fbad6cacc39f501 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestManualDisk-1423667210 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestManualDisk-1423667210-project Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 8923b1af5fd54c31ac0af85564cfdd92 Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestManualDisk-1423667210-project Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '44248bd8-d4ef-4152-9118-df5b56ff43d9'} Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:32.203831 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:32.209283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Returning 404 to user: Instance 44248bd8-d4ef-4152-9118-df5b56ff43d9 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:32.210580 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1f464992-dde6-4eeb-b1ef-1ce9ca7ef387 tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9" status: 404 len: 111 microversion: 2.1 time: 0.084133 Sep 03 21:02:32.212315 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1870/3578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:32 2022] GET /compute/v2.1/servers/44248bd8-d4ef-4152-9118-df5b56ff43d9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:32.224471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f94b6103-160c-4391-b299-ac878cc9c20f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] Calling method '.version_select at 0x7fae65fbb280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:32.249624 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f94b6103-160c-4391-b299-ac878cc9c20f tempest-ServersTestManualDisk-1423667210 tempest-ServersTestManualDisk-1423667210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609962765" status: 202 len: 0 microversion: 2.1 time: 0.030918 Sep 03 21:02:32.254657 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1871/3579] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609962765 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:32.466713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:32.467642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:32.480952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.481869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.483372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.484336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.488341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.489710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.674872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:32.687857 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b2edd71-e689-4a1f-ba45-a8f9012c36df tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1296 microversion: 2.1 time: 0.231364 Sep 03 21:02:32.688475 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1872/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:32 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1296 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:32.722868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:32.735431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8604d2ed-e1c1-44ba-b304-d01852b8129c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.902762 Sep 03 21:02:32.738409 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1709/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:31 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:32.856806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:32.857381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:32.871049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.871603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.872062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:32.872811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:32.873313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:32.873816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.107304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:33.111653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:33.129020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.129692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.132020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.133164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.134908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.136067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.443533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:33.458679 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f0d1692-6f25-4033-ad43-7587b4661560 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.606694 Sep 03 21:02:33.462180 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1873/3582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:32 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:33.499173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6406841-4c7c-4de3-9ae4-d11d6e6d8237", "name": "network-vif-plugged", "status": "completed", "tag": "d75e0aee-26b7-462f-bfd0-d3c0b6aea591"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:33.535608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.536800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.537434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.567728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] Creating event network-vif-plugged:d75e0aee-26b7-462f-bfd0-d3c0b6aea591 for instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 on nch1-master-1 Sep 03 21:02:33.585749 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d9b72e9e-b953-4040-9813-2dec326bcc60 req-1bc11f53-53d6-4826-a08b-9dcbfaed8c54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121898 Sep 03 21:02:33.589863 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1874/3583] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:33.625581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:33.641695 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0cf2e99-70fa-4864-8257-ff1b3fe0b98f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.541507 Sep 03 21:02:33.660750 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1710/3584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:33 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:33.716590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:33.718909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:33.730795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.733155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.735289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.736234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.740198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.740873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.765146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:33.766007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:33.777747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.778499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.780301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.782618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:33.785128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:33.789077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:33.846865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:34.223286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:34.256445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:34.268630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5811ce09-126f-45ad-8745-b5dc9736ffc8 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.508914 Sep 03 21:02:34.269387 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1711/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:33 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:34.487631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:34.488280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:34.502059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:34.502569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:34.503354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:34.503737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:34.504197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:34.504635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:34.525717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:34.543143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c269b820-7622-415c-a25f-a92cc506dd31 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.829842 Sep 03 21:02:34.545205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1875/3586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:33 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:34.667284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:34.669164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:34.691051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:34.695901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:34.701284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:34.705004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:34.705516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:34.706144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:34.976009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:34.988099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb25a2f6-d49b-47b5-ba3a-747d18e89797 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.504231 Sep 03 21:02:34.989439 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1712/3587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:34 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:35.087265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:35.109346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=15 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:35.119177 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ecb0ffc2-7d9d-4af8-b6fc-d87ba94bc897 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1370 microversion: 2.1 time: 0.456006 Sep 03 21:02:35.120307 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1876/3588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:34 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1370 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:35.263353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d12188-0969-4024-9079-caf96bf2740e", "tag": "785913b1-b915-446e-93fd-ff6d31d72717"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:35.282897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.283412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.283846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.302697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] Creating event network-changed:785913b1-b915-446e-93fd-ff6d31d72717 for instance 68d12188-0969-4024-9079-caf96bf2740e on nch1-master-1 Sep 03 21:02:35.302925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:35.303678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:35.311002 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bcc990ac-4b4d-4759-b327-40f9b6f2c2c5 req-ae1c0740-5d4d-4c7c-93f1-11bc572b5678 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051817 Sep 03 21:02:35.311254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.312119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.312845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.313832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.318678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.319398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.327293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1713/3589] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:35.572587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:35.579180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:35.600818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.601434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.601896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.603272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:35.603738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.604129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.604659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.613179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e6f4bc8-cd52-41fd-aa0a-b75b9cf61149 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.321041 Sep 03 21:02:35.614426 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1877/3590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:35 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:35.619731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a76caa-3377-462f-ab5b-6c49c567b4c0", "name": "network-vif-plugged", "status": "completed", "tag": "b5038109-8580-455e-b7ab-ff026aa2b6ad"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:35.630448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:35.631650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:35.632337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:35.650339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] Creating event network-vif-plugged:b5038109-8580-455e-b7ab-ff026aa2b6ad for instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 on nch2-master-1 Sep 03 21:02:35.658593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fecd6baf-3960-40f9-b8d4-09bdcbe6d7a6 req-eacf5860-2d23-4f5b-9263-31009e5dc60d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042129 Sep 03 21:02:35.659212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1878/3591] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:36.014491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:36.015357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:36.022327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.023137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.024005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.024991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.025683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.026407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.267039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:36.284985 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f7d5a3d-8825-426b-8f31-44c617cfb7a1 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.276434 Sep 03 21:02:36.286036 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1879/3592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:36 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:36.293650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:36.294347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:36.311199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.311786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.312506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.313501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.314176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.314935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.423498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:36.433208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ce8af18-f2ea-4a67-bf4a-76c7c8bf212a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.864472 Sep 03 21:02:36.434085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1714/3593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:35 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:36.470772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:36.481652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8eca30a-6ca1-4259-81f7-da4c939f4106 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1557 microversion: 2.1 time: 0.194550 Sep 03 21:02:36.482683 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1880/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:36 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1557 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:36.506948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:36.507719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:36.515201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.515731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.516156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.516945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.517392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.517822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.640244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:36.641152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:36.653187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.653594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.654037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.654751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:36.655209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:36.655650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:36.682725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=18 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:36.698679 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22e37d63-8fea-43ca-a8e8-8fc79c507910 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196832 Sep 03 21:02:36.700719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1715/3595] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:02:36 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:37.000568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:37.012581 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14eb430d-bdf7-4722-a568-6bd446b6ef68 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.377592 Sep 03 21:02:37.013583 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1881/3596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:36 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:37.310836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:37.311695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:37.326753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:37.327282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:37.328866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:37.331909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:37.333396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:37.334218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:37.458376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:37.459457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:37.473252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:37.474052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:37.474494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:37.475217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:37.475675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:37.476100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:37.803162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:37.815992 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-47c68a65-b060-46fb-9730-ab48068a83cc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.359725 Sep 03 21:02:37.818041 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1882/3597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:37 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:38.012886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:38.021909 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c143f21-1217-4c08-a502-084dcdac309e tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1316 microversion: 2.1 time: 0.716105 Sep 03 21:02:38.023037 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1716/3598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:37 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:38.041276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:38.042621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:38.049062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:38.049775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:38.050391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:38.051432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:38.052309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:38.052930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:38.341329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:38.352721 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68aafe8e-8e48-4f3f-a1af-04705a9cc27c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.320749 Sep 03 21:02:38.357070 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1883/3599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:38 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:38.492484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6406841-4c7c-4de3-9ae4-d11d6e6d8237", "tag": "d75e0aee-26b7-462f-bfd0-d3c0b6aea591"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:38.523053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:38.523570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:38.526215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:38.543039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] Creating event network-changed:d75e0aee-26b7-462f-bfd0-d3c0b6aea591 for instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 on nch1-master-1 Sep 03 21:02:38.550755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-dda7f1b8-276b-42e0-af2e-e1edd5afafe0 req-fe7c860c-95d2-456c-8777-426cd87a57ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070332 Sep 03 21:02:38.553460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1717/3600] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:38.850234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:38.852888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:38.868605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:38.869392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:38.870983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:38.872244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:38.875282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:38.876107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:39.449885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2011919698", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:39.497921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:39.513844 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72edbaa1-8d55-4a4a-bdaa-704b1cecbddc tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.671836 Sep 03 21:02:39.529416 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1884/3601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:38 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:39.535090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:39.535952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:39.544629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:39.545648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:39.546337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:39.547279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:39.547959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:39.548626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:39.550919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:02:40.238020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:40.256308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e612a60a-ccf6-4719-bff0-d01288af24e8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1505 microversion: 2.1 time: 0.725698 Sep 03 21:02:40.256917 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1885/3602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:39 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1505 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:40.262181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:40.269216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:40.281373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.283256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.283900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.287349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.288001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.288630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.405404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:02:40.406234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:02:40.406871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:02:40.407499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:02:40.407999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:02:40.420076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.420706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.421236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.422101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.423061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.423613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.467047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:02:40.489337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:02:40.515541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:02:40.518549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:02:40.591875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11d7b089-7e9b-4fe8-863c-9ff21e4f45d7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687096 Sep 03 21:02:40.594039 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1718/3603] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:02:40.599572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-324493981"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:40.600345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:40.610325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.611012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.612121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.613958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.614792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.615482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.770023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:40.784035 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-836aa28b-db66-4483-b27d-8285e6150d88 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.525863 Sep 03 21:02:40.785016 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1886/3604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:40 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:40.803429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:40.804310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:40.815868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:40.821597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.822332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.823770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.826614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:40.827536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:40.828331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:40.869274 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Adding security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e to port b5038109-8580-455e-b7ab-ff026aa2b6ad Sep 03 21:02:41.331734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:41.358570 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7fb4f1f5-4c49-4746-8f13-e7f133398c84 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.571718 Sep 03 21:02:41.359360 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1887/3605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:40 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:41.365611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9351412-13b6-4343-b5e0-7343db157cdc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:41.366587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d9351412-13b6-4343-b5e0-7343db157cdc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:41.478597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d9351412-13b6-4343-b5e0-7343db157cdc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:41.488175 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9351412-13b6-4343-b5e0-7343db157cdc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1215 microversion: 2.1 time: 0.125401 Sep 03 21:02:41.488934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1888/3606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:41 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:41.537220 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93dca2ef-87c8-4354-8023-4b32068bdc20 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action" status: 202 len: 0 microversion: 2.1 time: 0.941246 Sep 03 21:02:41.538583 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1719/3607] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:02:40 2022] POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:41.547393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae65f91ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:41.558693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a76caa-3377-462f-ab5b-6c49c567b4c0", "tag": "b5038109-8580-455e-b7ab-ff026aa2b6ad"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:41.586553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:41.587066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:41.587483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:41.609335 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] Creating event network-changed:b5038109-8580-455e-b7ab-ff026aa2b6ad for instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 on nch2-master-1 Sep 03 21:02:41.620980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3f905040-f461-4e40-8470-a3ba05529cfb req-bd8957ee-00a3-448e-98c8-025e98e1892e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066075 Sep 03 21:02:41.622526 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1720/3608] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:41.814283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:41.816026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:41.829866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:41.830380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:41.830923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:41.832000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:41.832473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:41.832988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:41.953633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use.", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:41.954506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.954506 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e HTTP/1.1 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: exception: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'e3c13de0-d56e-4ae1-a988-cd5ecbceac3e'} Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:41.956738 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] Sep 03 21:02:41.960975 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:41.968954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 400 to user: Security Group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e in use. Sep 03 21:02:41.968954 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-14417058-8a1e-468c-a924-77e1a9cd9575'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:41.970283 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cdf0d999-accc-43f3-b272-d60bb3e250e9 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e" status: 400 len: 185 microversion: 2.1 time: 0.426752 Sep 03 21:02:41.975793 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1889/3609] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:41 2022] DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e => generated 185 bytes in 433 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:02:41.983620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:41.988441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:41.999331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:41.999924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.000445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.001323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.001867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.002365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.007630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:42.108847 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9961b434-e5fc-49d9-870b-32f241323daa tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action" status: 202 len: 0 microversion: 2.1 time: 0.130815 Sep 03 21:02:42.114098 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1890/3610] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:02:41 2022] POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:42.122475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:42.123559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:42.135167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.136584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.137162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.137926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.138437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.138870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.325911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:42.334666 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1af8b3f4-79c5-48c8-8e0a-47d83c69ca33 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.526052 Sep 03 21:02:42.336860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1721/3611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:41 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:42.383279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:42.383831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:42.390079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.390454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.390889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.391586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.392045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.392465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.469019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:42.480506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f64fbf1-f38f-4c48-91ae-67f56e073110 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1575 microversion: 2.1 time: 0.364735 Sep 03 21:02:42.484856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1891/3612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:42 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1575 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:42.521283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:42.522183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:42.537155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.537868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.538523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.539962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:42.541536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:42.542919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:42.560374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:42.569498 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc055ede-8807-4971-8bf2-6e22532edfa2 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.190098 Sep 03 21:02:42.586200 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1722/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:42 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:42.728596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:42.741845 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-795714f1-3285-432e-ba63-084927ab3e76 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1267 microversion: 2.1 time: 0.227599 Sep 03 21:02:42.777406 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1892/3614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:42 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:43.363989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:43.364617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:43.375693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.384850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.385634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:43.387157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.387654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.388258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:43.510859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:43.513194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:43.523965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.525088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.525830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:43.527264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.528761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.530134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:43.906403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:43.921678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0109a60b-3d62-48e1-a1bb-a925857fe7a4 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1575 microversion: 2.1 time: 0.416042 Sep 03 21:02:43.923239 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1893/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:43 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1575 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:43.935470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:43.941501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:43.949855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.950628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.951076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:43.951798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:43.953053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:43.953491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:44.097428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:44.110787 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0bab0c71-774d-4fc9-90a5-a3a27afec1b1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.751436 Sep 03 21:02:44.112718 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1723/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:43 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:44.127738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:44.128557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:44.148141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:44.150683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:44.153237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:44.155392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:44.156627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:44.158193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:44.227566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:44.240227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9589a8b2-0a90-473c-bfd3-48fe62137605 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.314783 Sep 03 21:02:44.240823 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1894/3617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:43 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:44.340552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:44.371851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9955df7c-9fa2-4489-92a3-2fa5bedca16b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1273 microversion: 2.1 time: 0.256966 Sep 03 21:02:44.374892 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1724/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:44 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:44.937503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d12188-0969-4024-9079-caf96bf2740e", "name": "network-vif-plugged", "status": "completed", "tag": "785913b1-b915-446e-93fd-ff6d31d72717"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:44.951241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:44.952517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:44.959627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:44.969576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:44.970030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:44.970764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:44.973543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:44.975857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:44.980225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:44.980950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:44.981551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.006837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] Creating event network-vif-plugged:785913b1-b915-446e-93fd-ff6d31d72717 for instance 68d12188-0969-4024-9079-caf96bf2740e on nch1-master-1 Sep 03 21:02:45.020990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-617a8d46-ce09-45e0-aa47-963fb7ed35d7 req-61075ef8-6d9a-4649-bc8c-266c6da4c2f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090704 Sep 03 21:02:45.023814 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1895/3619] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:45.145280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:45.146362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:45.153846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.154617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.155742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.156816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.157744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.158334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.476670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:45.488377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9a413a2a-9163-449b-a800-f5261ecf92b9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.350045 Sep 03 21:02:45.490901 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1896/3620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:45 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:45.496316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:45.497237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:45.504141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.504942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.507965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.514486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.515743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:45.520395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.523086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.531478 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b6583c4-ccf3-4f7f-8dd2-d7ee872e6277 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1575 microversion: 2.1 time: 0.580746 Sep 03 21:02:45.532110 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1725/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:44 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1575 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:45.539626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:45.541176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:45.560437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.560981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.561441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.566643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:45.568640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:45.569701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:45.915144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:45.928739 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6785da77-0a05-4cdc-83b6-582a7aae9d87 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.436448 Sep 03 21:02:45.930081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1897/3622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:45 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:45.932435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:45.957775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e088bcb-34b0-4224-96cc-4c0f36c057d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.424549 Sep 03 21:02:45.958433 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1726/3623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:45 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:46.345437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4a1eb3e-1dc6-41d4-b083-f66c74ac8485", "tag": "b24cf6c3-660e-44ea-8ead-ed97078285e2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:46.371153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.371677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.372114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.387111 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] Creating event network-changed:b24cf6c3-660e-44ea-8ead-ed97078285e2 for instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 on nch2-master-1 Sep 03 21:02:46.394767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-11e753e8-c28f-4b58-9023-3fd7c704b5dd req-488216b9-4704-4284-812b-afdbdc26fbf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051271 Sep 03 21:02:46.394767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1898/3624] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:46.515040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:46.516594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:46.531405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.533607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.535224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.535979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.536452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.543754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.566411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:46.567436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:46.576349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.577230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.578176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.579306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.580054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.580835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.851443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:46.854077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:46.862102 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b5952f78-3ec9-40cb-a7e1-a55d25848212 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1573 microversion: 2.1 time: 0.300186 Sep 03 21:02:46.862906 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1899/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:46 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1573 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:46.888062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-675798796"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:46.889134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:46.891493 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0797ddc-08d8-404c-889a-c7802fd2175c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.359983 Sep 03 21:02:46.895896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.896487 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1727/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:46 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:46.897311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.897921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.898773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.899634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.900210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.954902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:46.955942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:46.967433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.970398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.971077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:46.976372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:46.977339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:46.982852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.140152 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.network.security_group_api [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Adding security group 29ef5fa3-8d80-447d-87e8-4a692e991bda to port b5038109-8580-455e-b7ab-ff026aa2b6ad Sep 03 21:02:47.381174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:47.386541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:47.398562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-30e7f0f9-1237-4e51-9a51-98299ba7ee67 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1364 microversion: 2.1 time: 0.444222 Sep 03 21:02:47.400412 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1728/3627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:46 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:47.416077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:47.416790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:47.427424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.427929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.428388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.429107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.430468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.435324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.609212 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b5167c9a-9539-47f4-9e17-ba5c922ce8f8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action" status: 202 len: 0 microversion: 2.1 time: 0.726866 Sep 03 21:02:47.609767 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1900/3628] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:02:46 2022] POST /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:47.627579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae65f87310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:47.780000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG neutronclient.v2_0.client [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use.", "detail": ""}} {{(pid=140520) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:47.780924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.780924 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda HTTP/1.1 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: exception: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '29ef5fa3-8d80-447d-87e8-4a692e991bda'} Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:47.783792 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 400 to user: Security Group 29ef5fa3-8d80-447d-87e8-4a692e991bda in use. Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: Neutron server returns request_ids: ['req-38e6b436-4b7d-4eae-b375-2fed12f5cac5'] {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e56f102b-4fed-4c56-b268-46da28a078de tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda" status: 400 len: 185 microversion: 2.1 time: 0.169059 Sep 03 21:02:47.788359 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1901/3629] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:47 2022] DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda => generated 185 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:02:47.792403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:47.796055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a76caa-3377-462f-ab5b-6c49c567b4c0", "tag": "b5038109-8580-455e-b7ab-ff026aa2b6ad"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:47.802761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc20f00b-1de7-4225-894e-893e93e60d1d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.399960 Sep 03 21:02:47.803376 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1729/3630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:47 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:47.811348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.811936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.812875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.821599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:47.822537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:47.826718 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] Creating event network-changed:b5038109-8580-455e-b7ab-ff026aa2b6ad for instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 on nch2-master-1 Sep 03 21:02:47.836661 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cc2747ed-b2b1-47e7-aeab-11ce022e289f req-d9df1d6b-2d0e-48db-bf14-8bdaeb58ea6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050410 Sep 03 21:02:47.837348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.837876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.838542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.839435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.840833 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1902/3631] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:47.842282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.842742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.879515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:02:47.922326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:47.923118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:47.931116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.933162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.933856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:47.934790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:47.935444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:47.936040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.000445 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51ce6217-fb64-461b-a90b-b7f8bca3c129 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 204 len: 0 microversion: 2.1 time: 0.191164 Sep 03 21:02:48.001536 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1730/3632] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:02:47 2022] DELETE /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:02:48.016562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:48.017718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:48.047097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.047917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.048592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.049575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.050203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.051672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.184700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:48.193179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0209bcd-945d-4c92-8803-373a97c954f1 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1520 microversion: 2.1 time: 0.277649 Sep 03 21:02:48.200082 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1903/3633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:47 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:48.424138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:48.424954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:48.434266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.434913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.435570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.437412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.438212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.438813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.549921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:48.568077 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a632a9a3-c79e-4ce9-bc0b-944b0bc68df7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1647 microversion: 2.1 time: 0.557080 Sep 03 21:02:48.569835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1731/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:48 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1647 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:48.640599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:48.649741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e2cd4129-8751-4c42-86c0-b6dd2f2f4a90 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1550 microversion: 2.1 time: 0.229343 Sep 03 21:02:48.650626 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1904/3635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:48 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1550 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:48.681329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:48.682757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:48.697420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.698994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.699671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.700963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.705649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.706454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.839386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:48.840307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:48.850887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.851698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.855887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:48.858343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:48.862511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:48.863310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.231998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:49.254387 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa76e0a4-9d1e-4b5f-8380-43203f442405 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.424614 Sep 03 21:02:49.255760 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1905/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:48 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:49.261508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:49.262388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:49.275354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.276468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.276942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.277664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.278124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.278549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.492858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:49.502158 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59eedd8e-89d4-46de-9a73-333ea53b89be tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1497 microversion: 2.1 time: 0.244903 Sep 03 21:02:49.502983 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1906/3637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:49 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:49.531160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:49.542583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:49.543951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:49.557715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.558577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.565983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.567756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.568458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.570191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.602614 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3d871a3-4375-4c74-8dd8-f74387e3cc53 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.932693 Sep 03 21:02:49.603447 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1732/3638] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:02:48 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e/os-interface => generated 285 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:49.608564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:49.610197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:49.631198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:49.633861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.637413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.638007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.638556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:49.640678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.641857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.643486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.715479 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-519887a2-37e6-45d6-8cf2-f2130862cdb5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.190344 Sep 03 21:02:49.717196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1907/3639] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Sep 3 21:02:49 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:49.738815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:49.748635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.749576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.750254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.785077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Going to try to start instance {{(pid=140520) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 21:02:49.792647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:49.867014 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b09ba1d6-0727-4f50-8600-759340b97fae tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "POST /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.135220 Sep 03 21:02:49.868213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1908/3640] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:02:49 2022] POST /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:49.878471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:49.881394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:49.908315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.909153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.910179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:49.911192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:49.912969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:49.913654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:50.443504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:50.476875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:50.483417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:50.485259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78804e4c-aaf3-406f-adda-ff0eea6a88e5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1647 microversion: 2.1 time: 0.880916 Sep 03 21:02:50.486142 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1733/3641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:49 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1647 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:50.491280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:50.492172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:50.498452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:50.499233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:50.499918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:50.500846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:50.501585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:50.502464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:50.506116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94cba1a6-f072-44b3-a6bf-c75e8b458fcc tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1506 microversion: 2.1 time: 0.633098 Sep 03 21:02:50.506720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1909/3642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:49 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:50.507734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:50.959609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:50.973196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b3c1c742-987b-4b22-bdaa-9ad4f1a53045 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.485600 Sep 03 21:02:50.993598 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1734/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:50 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:51.508817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:51.509490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:51.515077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:51.532396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:51.533495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:51.544006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:51.545984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:51.548034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:51.549092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:51.549242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:51.549642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:51.553277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:51.553844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:51.554820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:51.556427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:51.558160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:51.558710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:51.857089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:51.869017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f18a1b0e-7a6d-4746-bd8f-b6b0aa3b21bc tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 200 len: 1469 microversion: 2.1 time: 0.365226 Sep 03 21:02:51.876646 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1910/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:51 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:51.890686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a76caa-3377-462f-ab5b-6c49c567b4c0", "name": "network-vif-deleted", "tag": "b5038109-8580-455e-b7ab-ff026aa2b6ad"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:51.931950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:51.934663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:51.935689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:51.966296 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] Creating event network-vif-deleted:b5038109-8580-455e-b7ab-ff026aa2b6ad for instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 on nch2-master-1 Sep 03 21:02:51.989031 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1988f56e-7d49-4982-991d-bd10e0c553f7 req-10e8b547-b72e-4436-812f-7f031c365b15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110725 Sep 03 21:02:51.990042 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1911/3645] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:52.000548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:52.001632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:52.014642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:52.022095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:52.022639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:52.023640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:52.024330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:52.025047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:52.368766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:52.387209 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ad8e131f-45ef-4eb0-9fce-6d15989d5a95 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1506 microversion: 2.1 time: 0.855006 Sep 03 21:02:52.388787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1735/3646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:51 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1506 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:52.545611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:52.556770 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9a115f7f-3c88-4851-a635-8704571fa381 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.560185 Sep 03 21:02:52.562636 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1912/3647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:51 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:52.900203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:52.901593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:52.913508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:52.914365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:52.915057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:52.916064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:52.917458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:52.918110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:52.936457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 HTTP/1.1 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'f0a76caa-3377-462f-ab5b-6c49c567b4c0'} Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:52.939494 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:52.944374 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16611ddc-bcc0-44bc-9658-4fb5553174bb tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 404 len: 111 microversion: 2.1 time: 0.048557 Sep 03 21:02:52.948402 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1736/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:52 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:52.953382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-743290aa-7a14-41f8-933a-c20da7f9a6b7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae65fc70d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:52.974165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4a1eb3e-1dc6-41d4-b083-f66c74ac8485", "name": "network-vif-plugged", "status": "completed", "tag": "b24cf6c3-660e-44ea-8ead-ed97078285e2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:52.989394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:52.990181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:52.990871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:53.019131 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] Creating event network-vif-plugged:b24cf6c3-660e-44ea-8ead-ed97078285e2 for instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 on nch2-master-1 Sep 03 21:02:53.031769 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fd73968b-3654-4d8a-a5d4-492d4db312fd req-1b13d581-46bb-4d43-a794-7b37b2a9fe6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057070 Sep 03 21:02:53.032809 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1737/3649] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:02:53.412859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:53.414513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:53.421248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:53.422046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:53.422833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:53.423733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:53.424485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:53.425129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:53.543364 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-743290aa-7a14-41f8-933a-c20da7f9a6b7 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e" status: 202 len: 0 microversion: 2.1 time: 0.593843 Sep 03 21:02:53.543958 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1913/3650] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:52 2022] DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:53.552122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd9bf4e7-6bde-4be8-92b7-6a2c0bf1a579 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae661ead30>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:53.709197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:53.720741 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15d84ef9-7113-4ec1-9c70-da2fcad721d6 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1510 microversion: 2.1 time: 0.313184 Sep 03 21:02:53.722029 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1738/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:53 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:53.735288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:53.738546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:53.750230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:53.751243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:53.754999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:53.757415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:53.758166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:53.759754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.054227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:54.068632 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da8b805c-3a3c-4d73-9577-2304b0afb848 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1315 microversion: 2.1 time: 0.343340 Sep 03 21:02:54.069293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1739/3652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:53 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:54.079373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:54.091838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:54.094944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.servers [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Removing options 'limit' from query {{(pid=140519) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 03 21:02:54.095795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:54.106082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.106781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.107109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.108163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.108814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.109919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.111928 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0fc38998-9ece-43cb-8d87-a27b4e2bf08c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.041318 Sep 03 21:02:54.114495 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1740/3653] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Sep 3 21:02:54 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:02:54.138225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d12188-0969-4024-9079-caf96bf2740e", "tag": "785913b1-b915-446e-93fd-ff6d31d72717"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:54.163752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.164649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.165548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.181046 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd9bf4e7-6bde-4be8-92b7-6a2c0bf1a579 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda" status: 202 len: 0 microversion: 2.1 time: 0.632699 Sep 03 21:02:54.183446 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1914/3654] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:53 2022] DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:54.198158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:54.199310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:54.206266 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] Creating event network-changed:785913b1-b915-446e-93fd-ff6d31d72717 for instance 68d12188-0969-4024-9079-caf96bf2740e on nch1-master-1 Sep 03 21:02:54.223080 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-39c68a62-a050-41d4-a611-68534db1b74f req-6e4f64a7-3156-4525-a206-631333ed77ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103952 Sep 03 21:02:54.224952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1741/3655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:54.233424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.233954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.235698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c85ec724-bf57-4859-91e1-764415d1e3a5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'create', calling method: .version_select at 0x7fae667b7160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-678847598", "description": "tempest-description-1294768857"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:54.240665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.243061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.245621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.246316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.503743 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c85ec724-bf57-4859-91e1-764415d1e3a5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.277313 Sep 03 21:02:54.505334 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1742/3656] 10.222.0.16 () {60 vars in 1180 bytes} [Sat Sep 3 21:02:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:54.518413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-09489f84-7770-41f2-8c44-6ce39958862b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Action: 'update', calling method: .version_select at 0x7fae660731f0>, body: {"security_group": {"name": "tempest-sg-hth-700824620", "description": "tempest-description-hth-1467517484"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:54.823477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:54.835930 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93f671ec-64cc-48e6-adcb-07587d83bbad tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1510 microversion: 2.1 time: 0.651024 Sep 03 21:02:54.836547 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1915/3657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:54 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:54.874154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:54.874925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:54.895430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.896319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.896965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:54.898947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:54.900053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:54.903747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.205993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-09489f84-7770-41f2-8c44-6ce39958862b tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261" status: 200 len: 217 microversion: 2.1 time: 0.691343 Sep 03 21:02:55.207829 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1743/3658] 10.222.0.16 () {60 vars in 1290 bytes} [Sat Sep 3 21:02:54 2022] PUT /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261 => generated 217 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:02:55.214159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:55.215829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:55.251254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.260702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.261342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.262142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.264629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.266122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.398885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:55.418340 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-77cf8a9d-4f90-43de-9a42-8a3deb2b875f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1511 microversion: 2.1 time: 0.558853 Sep 03 21:02:55.419125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1916/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:54 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:55.440434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-750017b4-f4c6-41da-a960-29270082f458 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae65f433a0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:55.509028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:55.518110 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d87fa69-a5db-4a6b-bb13-1e65449eebf8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1503 microversion: 2.1 time: 0.309038 Sep 03 21:02:55.537196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1744/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:55 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:55.544748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:55.545997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:55.552958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.553781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.554468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.555644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.556532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.557503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.809293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:55.818251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc900e5b-87a7-4b6d-846d-8d3591578600 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1510 microversion: 2.1 time: 0.279443 Sep 03 21:02:55.819525 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1745/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:55 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:55.841825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:55.843237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:55.857439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.861575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.863161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.864106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:55.864737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:55.878691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:55.929827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:02:55.998524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-750017b4-f4c6-41da-a960-29270082f458 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261" status: 200 len: 217 microversion: 2.1 time: 0.578156 Sep 03 21:02:56.000127 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1917/3662] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:02:55 2022] GET /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261 => generated 217 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:56.009203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.025187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:56.027598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:56.081208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c2f70177-9f86-4a14-8ee0-beb5c666edb5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 204 len: 0 microversion: 2.1 time: 0.259037 Sep 03 21:02:56.085480 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1746/3663] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:02:55 2022] DELETE /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:02:56.092744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81c3df4e-2985-4b6f-839e-17fbef31a020 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae676a9550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.299523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.301443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.304119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.306698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.308764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.312545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.361451 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81c3df4e-2985-4b6f-839e-17fbef31a020 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261" status: 202 len: 0 microversion: 2.1 time: 0.274527 Sep 03 21:02:56.362460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1747/3664] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/ecf51874-313d-49e4-a16b-45dd38e9c261 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:02:56.367209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.368228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:56.393201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.393710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.394225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.394953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.395409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.395843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.439989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:56.468008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:56.566682 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f4544ac-f2d4-4bd7-b6e3-3ca612f4f13f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.563011 Sep 03 21:02:56.569035 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1918/3665] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Sep 3 21:02:56 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:56.593820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.594806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:56.608542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.609447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.610383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.611305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.611779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.612269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.628035 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 HTTP/1.1 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f0a76caa-3377-462f-ab5b-6c49c567b4c0'} Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:02:56.630368 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.635881 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.636869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:56.638303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.639384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42359289-bec2-46f3-bc3c-6bf1bc8a7b99 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 404 len: 111 microversion: 2.1 time: 0.056066 Sep 03 21:02:56.641011 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1919/3666] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.645461 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8460a509-ab62-4250-8c37-2c271739241c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1509 microversion: 2.1 time: 0.281366 Sep 03 21:02:56.646062 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1748/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:56 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:56.646894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.647916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:56.652470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.653128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: f0a76caa-3377-462f-ab5b-6c49c567b4c0] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:56.656030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.656849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.657581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.658589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.659538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.660130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.660587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.661217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.661766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.662606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.663544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.664115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.681657 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 HTTP/1.1 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'f0a76caa-3377-462f-ab5b-6c49c567b4c0'} Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.687023 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Instance f0a76caa-3377-462f-ab5b-6c49c567b4c0 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-858f9cdf-60f2-4dfc-bcea-26585dad460d tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0" status: 404 len: 111 microversion: 2.1 time: 0.043522 Sep 03 21:02:56.691894 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1749/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:56 2022] GET /compute/v2.1/servers/f0a76caa-3377-462f-ab5b-6c49c567b4c0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.705467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66073550>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.755219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:56.755826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 29ef5fa3-8d80-447d-87e8-4a692e991bda not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:56.756355 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.756355 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda HTTP/1.1 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '29ef5fa3-8d80-447d-87e8-4a692e991bda'} Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:56.758292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 29ef5fa3-8d80-447d-87e8-4a692e991bda does not exist Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-ab1206b9-afeb-4acd-b400-992511994f3a'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ef00ec4-9678-4fb8-b127-0ddc4ee383a0 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda" status: 404 len: 194 microversion: 2.1 time: 0.064271 Sep 03 21:02:56.762796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1750/3669] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/29ef5fa3-8d80-447d-87e8-4a692e991bda => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.771511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae660cf940>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.805455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:56.806842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:56.807866 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.807866 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e HTTP/1.1 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e3c13de0-d56e-4ae1-a988-cd5ecbceac3e'} Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:56.811289 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] Sep 03 21:02:56.815713 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.820775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group e3c13de0-d56e-4ae1-a988-cd5ecbceac3e does not exist Sep 03 21:02:56.820775 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-be560715-24d1-4a50-bd5c-7dfcd8ef022b'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.820775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a6412c2-fb34-4580-b02f-6f03e4c5a325 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e" status: 404 len: 194 microversion: 2.1 time: 0.055499 Sep 03 21:02:56.820775 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1751/3670] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/e3c13de0-d56e-4ae1-a988-cd5ecbceac3e => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.831226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae660cf040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.874751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:56.875360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:56.875882 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.875882 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239 HTTP/1.1 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '8e5ad52e-cf85-4192-aa9b-ba29b51a6239'} Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:56.879024 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 8e5ad52e-cf85-4192-aa9b-ba29b51a6239 does not exist Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-c91d188a-4583-4faf-99a8-226e2569b2a5'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.884276 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-770667c5-eb78-46a7-9f7a-b7425086c1e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239" status: 404 len: 194 microversion: 2.1 time: 0.055411 Sep 03 21:02:56.888664 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1752/3671] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/8e5ad52e-cf85-4192-aa9b-ba29b51a6239 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.903553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae660735e0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.918726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:56.928676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2392794b-e581-4aa9-bfe0-cbeae702335e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1510 microversion: 2.1 time: 0.285874 Sep 03 21:02:56.942814 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1920/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:56 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:56.953943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:56.954662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:56.958652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:56.959265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:56.960330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.960330 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 HTTP/1.1 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '637283e9-c5c9-4a99-9dd7-9f30e57dc6d7'} Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:56.961639 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 does not exist Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-e718b851-3bf7-4803-a968-f8a7f3beff9b'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0aef6ac6-6905-403f-ba45-5012696c9316 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7" status: 404 len: 194 microversion: 2.1 time: 0.073447 Sep 03 21:02:56.967407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1753/3673] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/637283e9-c5c9-4a99-9dd7-9f30e57dc6d7 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:56.974892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.974892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.974892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.975501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:56.976173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:56.976614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:56.977022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae6607e670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.038774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:57.039625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:57.040357 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.040357 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a HTTP/1.1 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a'} Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:57.044296 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a does not exist Sep 03 21:02:57.050035 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-d7a0e75e-f721-411c-a202-d2b29461c8a4'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:57.053499 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41f11bcd-b31b-401d-ba98-c37642a8ddec tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a" status: 404 len: 194 microversion: 2.1 time: 0.078041 Sep 03 21:02:57.055365 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1754/3674] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:56 2022] DELETE /compute/v2.1/os-security-groups/5c5a3df7-a496-4eb3-8ecd-e5ebcfd9111a => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:57.061502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae66fcad30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.122616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG neutronclient.v2_0.client [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist", "detail": ""}} {{(pid=140519) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 03 21:02:57.123221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.security_group_api [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Neutron security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a not found {{(pid=140519) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 03 21:02:57.123748 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.123748 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a HTTP/1.1 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: exception: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '9bba5d1a-a590-4f85-a9b4-0696c48c571a'} Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 03 21:02:57.125618 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Security group 9bba5d1a-a590-4f85-a9b4-0696c48c571a does not exist Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: Neutron server returns request_ids: ['req-835c42e8-d05f-4add-b549-47d807b71e6f'] {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60c0369d-99ea-4956-84b2-d4e2a898e21a tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a" status: 404 len: 194 microversion: 2.1 time: 0.070667 Sep 03 21:02:57.130422 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1755/3675] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:02:57 2022] DELETE /compute/v2.1/os-security-groups/9bba5d1a-a590-4f85-a9b4-0696c48c571a => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:02:57.147804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.147991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:57.157372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.157953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.158276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.158765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.159478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.159939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.160367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.175432 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a246a2df-20a7-4650-a635-9bdca17cf44c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1511 microversion: 2.1 time: 0.226511 Sep 03 21:02:57.176636 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1921/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:56 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:02:57.190936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:02:57.207519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.208492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:57.220266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.220759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.221436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.222640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.223404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.225545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.389902 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-be0a0d86-069c-4594-99cb-0ad44fd53170 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 204 len: 0 microversion: 2.1 time: 0.257546 Sep 03 21:02:57.405095 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1756/3677] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:02:57 2022] DELETE /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:02:57.418849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.421678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:57.439476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.440241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.440722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.441541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.442151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.442599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.452105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.465661 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bdc8c8e2-25f4-4ca8-832f-9fc75ace5721 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1510 microversion: 2.1 time: 0.266709 Sep 03 21:02:57.478172 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1922/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:57 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:57.491896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.501648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.503257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:57.511458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.512016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.512463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.513439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.514102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.515139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.554533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:57.599751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.607840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.608575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.609340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.784032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.793813 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7f174da-9b90-4cdc-8b71-73cf09de7f14 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1646 microversion: 2.1 time: 0.384195 Sep 03 21:02:57.801166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1757/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:57 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1646 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:57.808091 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da47a228-c11b-41ff-8293-35544beb18da tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.322056 Sep 03 21:02:57.808843 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1923/3680] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:02:57 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:57.827347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.830857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:57.836841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:57.842075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.842481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.842945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.843655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:57.844117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:57.844551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:57.851446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:57.855830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:58.058854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.059474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.059932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.060684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.061322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.061759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.110295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:58.180593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52c9b5e7-3ce9-42d0-974a-7d500f30e66a tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.348686 Sep 03 21:02:58.184193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1924/3681] 10.222.0.16 () {58 vars in 1150 bytes} [Sat Sep 3 21:02:57 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:58.198764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:58.213261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:58.215533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:58.220567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:58.228504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.229510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.229955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.230717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.230928 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3426a57c-8c4c-4042-b6a6-0106bfcdaa49 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1509 microversion: 2.1 time: 0.416759 Sep 03 21:02:58.231187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.236957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.237277 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1758/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:57 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:58.383997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:58.550666 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1096f0ad-b014-4723-bfdf-3c702111ddc2 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.355700 Sep 03 21:02:58.553743 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1925/3683] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Sep 3 21:02:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:58.567438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:58.575560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:58.577139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:58.601127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.603462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.604552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.608798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.610246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.612553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.666460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4a1eb3e-1dc6-41d4-b083-f66c74ac8485", "name": "network-vif-deleted", "tag": "b24cf6c3-660e-44ea-8ead-ed97078285e2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:02:58.698132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.698630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.699069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.743338 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] Creating event network-vif-deleted:b24cf6c3-660e-44ea-8ead-ed97078285e2 for instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 on nch2-master-1 Sep 03 21:02:58.760525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ae10b51f-aedf-4049-ab52-2a9e30601771 req-e027c8eb-d3ff-405b-8e0e-da8870965a98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097699 Sep 03 21:02:58.763779 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1926/3684] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:58.828609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:58.830028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:58.841176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.849877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.850647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.852593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:58.854875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:58.855524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:58.911275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:59.112508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7dc09d75-2ec0-492f-a94f-e6208a93a7f3 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.551568 Sep 03 21:02:59.114005 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1759/3685] 10.222.0.16 () {58 vars in 1196 bytes} [Sat Sep 3 21:02:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:59.157346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:59.171441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:59.172141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': '1166462711', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:59.209624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.210129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.210574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.211546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.212182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.214182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.337265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:59.342812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:59.348311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75ca17f9-dc44-4d50-aa2e-38286b682db2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1646 microversion: 2.1 time: 0.523865 Sep 03 21:02:59.364755 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1927/3686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:58 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1646 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:59.383760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:59.385251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:02:59.392738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:59.404455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.405222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.406076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.407090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.409213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.410974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.530912 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-208f916b-dff7-4bca-847c-bfac938ef20d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=1166462711" status: 200 len: 346 microversion: 2.1 time: 0.403965 Sep 03 21:02:59.532580 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1760/3687] 10.222.0.16 () {58 vars in 1156 bytes} [Sat Sep 3 21:02:59 2022] GET /compute/v2.1/servers?name=1166462711 => generated 346 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:02:59.537310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.538441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.540294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.541082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'fault' on Instance uuid a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:02:59.547258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:02:59.574718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:59.575404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:02:59.593436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.593927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.594360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.595088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:02:59.595539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:02:59.595963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:02:59.735319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:02:59.773899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f407c583-6b87-47b7-a9c5-9801d5113b6f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 200 len: 1305 microversion: 2.1 time: 0.407531 Sep 03 21:02:59.774951 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1928/3688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:02:59 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 1305 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:02:59.882932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:02:59.980127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28467532-eaf9-4b94-82e5-47014b1286eb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.437820 Sep 03 21:02:59.982233 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1761/3689] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Sep 3 21:02:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:00.010947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:00.023485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:00.026998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-116646271', 'deleted': False, 'project_id': '250efefcd9e84269a090b0a7ec433c87'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:03:00.033917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:00.035490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:00.036346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:00.037511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:00.039290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:00.039994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:00.306937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-568778298", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8ec3d5b6-c129-4b71-9708-728f18cf3320"}, {"uuid": "6ad025cb-914f-457c-a5b1-248f11440653"}, {"uuid": "8ec3d5b6-c129-4b71-9708-728f18cf3320"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:00.396537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] validate_networks() for [('8ec3d5b6-c129-4b71-9708-728f18cf3320', None, None, None, None, None), ('6ad025cb-914f-457c-a5b1-248f11440653', None, None, None, None, None), ('8ec3d5b6-c129-4b71-9708-728f18cf3320', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:00.696565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:03:00.810540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db1ef80d-8ba7-49f3-a393-8df48fcf40c0 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-116646271" status: 200 len: 346 microversion: 2.1 time: 0.820184 Sep 03 21:03:00.812007 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1929/3690] 10.222.0.16 () {58 vars in 1228 bytes} [Sat Sep 3 21:02:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-116646271 => generated 346 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:00.817145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:00.818195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:00.826934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:00.827813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:00.828480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:00.829648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:00.830393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:00.831071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:00.883369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:00.884350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:00.890382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:00.891564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lazy-loading 'fault' on Instance uuid 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:00.977314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:00.994808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7dadcda0-2d45-49ad-8058-ea9e3ed6e6e2 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1306 microversion: 2.1 time: 0.181391 Sep 03 21:03:01.016347 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1930/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:00 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1306 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:01.034155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc9f730-2fd0-4b46-bc41-0faad3d00cc9", "name": "network-vif-deleted", "tag": "d2e4b512-16e1-4c9d-9fc6-472386ef3667"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:01.087697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:01.090953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:01.091600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:01.119682 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] Creating event network-vif-deleted:d2e4b512-16e1-4c9d-9fc6-472386ef3667 for instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 on nch1-master-1 Sep 03 21:03:01.138404 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-dfef107f-6a09-4a6b-879e-3d4267a0c1cd req-b1e718fc-b955-473a-bb4d-d596dc39e5f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108771 Sep 03 21:03:01.139369 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1931/3692] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:01.146145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:01.151039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:01.187469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:01.188801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:01.192698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:01.194350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:01.202522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:01.203232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:01.245639 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 HTTP/1.1 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a4a1eb3e-1dc6-41d4-b083-f66c74ac8485'} Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:01.247596 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:03:01.254506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:01.261197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:01.262314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2011f50f-64f3-4ea0-bedd-3a889500d380 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 404 len: 111 microversion: 2.1 time: 0.121592 Sep 03 21:03:01.263589 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1932/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:01 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:03:01.301607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:01.303604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:01.341266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:01.342073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:01.344612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:01.350786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:01.351415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:01.351982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:01.472432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:01.664910 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f2f5fe4-0893-4a76-8df4-c8ea787eeee5 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "DELETE /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 204 len: 0 microversion: 2.1 time: 0.399328 Sep 03 21:03:01.669833 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1933/3694] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:01 2022] DELETE /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:03:01.676771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-715860038", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:01.763539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:02.127902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:02.128380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:02.128822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:02.135623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:02.136360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:02.148456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.148930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.149381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.150135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.151123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.155071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.180638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Getting quotas for project 26e12c7419f641b4a7e56274a34826ee. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:02.188164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Getting quotas for user 77edcf09f5f84e51a4fb08dbaf763a67 and project 26e12c7419f641b4a7e56274a34826ee. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:02.207052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:02.211249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:02.299140 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8c011ed-35bd-4854-b41a-60a89878adcc tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.995980 Sep 03 21:03:02.300281 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1762/3695] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:03:02.306384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:02.307486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:02.314697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.315574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.316244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.317982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.318715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.319521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.417175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:02.419094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:02.419614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:02.420043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:02.420471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:02.455151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.456820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.457365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.461787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.463971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.464480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.497751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:02.501469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:02.510767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:02.567980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:02.570815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:02.645740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:02.656761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8778d2c-c8d5-42b1-bd18-60316fe18cc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984625 Sep 03 21:03:02.660099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c75ffed-6f1b-47f5-8328-0a1b2b0f1d64 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1516 microversion: 2.1 time: 0.358521 Sep 03 21:03:02.660762 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1763/3696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:02 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:02.666620 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1934/3697] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:03:02.678754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81f1a4aa-d9fd-4272-9746-a0c461e7e9ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:02.680212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81f1a4aa-d9fd-4272-9746-a0c461e7e9ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:02.685350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:02.687093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:02.696054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.696647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.697254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.698508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.699261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.699874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.796685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81f1a4aa-d9fd-4272-9746-a0c461e7e9ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:02.805139 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81f1a4aa-d9fd-4272-9746-a0c461e7e9ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1212 microversion: 2.1 time: 0.137435 Sep 03 21:03:02.805726 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1935/3698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:02 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1212 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:02.805991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:02.809243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:02.811321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:02.812206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lazy-loading 'fault' on Instance uuid 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:02.821504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84efec7f-8d18-4aa2-9f7e-cc3e4246fccd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:02.822133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84efec7f-8d18-4aa2-9f7e-cc3e4246fccd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:02.966083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84efec7f-8d18-4aa2-9f7e-cc3e4246fccd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:02.979598 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84efec7f-8d18-4aa2-9f7e-cc3e4246fccd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1214 microversion: 2.1 time: 0.167524 Sep 03 21:03:02.979766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a394ae937c54b2a82c89628d4feeb72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d39cd627084dda8cb00e993f5d19a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:02.980169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1936/3699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:02 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:03.013858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ec0c883-08ca-49d2-9ec0-28b53a2f4419 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 200 len: 1306 microversion: 2.1 time: 0.351078 Sep 03 21:03:03.015995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1764/3700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:02 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 1306 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:03.691032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:03.691916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:03.711419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:03.711940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:03.712397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:03.713698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:03.714168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:03.720416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:03.831589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:03.832232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:03.848177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:03.848724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:03.850922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:03.854460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:03.855261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:03.855961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:04.046251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:04.058041 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91075249-30ba-4869-83e9-204a3a4a3c24 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1264 microversion: 2.1 time: 0.231484 Sep 03 21:03:04.062296 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1765/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:03 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:04.073386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:04.077881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:04.096121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:04.097238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:04.097792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:04.099896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:04.101779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:04.102648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:04.302383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:04.328016 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6504c77f-938b-429d-905e-ccb1d562d63e tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1516 microversion: 2.1 time: 0.634224 Sep 03 21:03:04.334574 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1937/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:03 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1516 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:04.349219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:04.350251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] [instance: 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:04.361785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:04.362777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:04.363499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:04.364624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:04.367979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:04.368776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:04.394608 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] HTTP exception thrown: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Request method failure captured: Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 HTTP/1.1 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8CtDM3SLr3fVPpjEyjY-53dVNx8_6lAVOkjeh7TKGU2RxZtbEk9simHUZwex4f4WCNIT4ysyyy1N_Jfj7Dy-y-HLJxkpfSku2SJ0sWLas2QQvtTbX78LdtswvMB0m2rqFKaQn8-H8fQm1eXQXo23nPHOYRlhE2YT1Dc0muWWUJdT6w Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30d39cd627084dda8cb00e993f5d19a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 30d39cd627084dda8cb00e993f5d19a1 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-797637096 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3a394ae937c54b2a82c89628d4feeb72 Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-SecurityGroupsTestJSON-797637096-project Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2bc9f730-2fd0-4b46-bc41-0faad3d00cc9'} Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:04.396739 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. Sep 03 21:03:04.401028 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:04.403460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Returning 404 to user: Instance 2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:04.405991 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-86f097f2-a5a8-4522-a06e-5293bcc401f5 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9" status: 404 len: 111 microversion: 2.1 time: 0.070103 Sep 03 21:03:04.408221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1938/3703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:04 2022] GET /compute/v2.1/servers/2bc9f730-2fd0-4b46-bc41-0faad3d00cc9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:03:04.420925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e44f3bf-8a12-4dd5-ab0a-77ceff461ee3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae661b1b80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:04.694970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:04.704528 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63800202-797f-478a-9276-bf2a468354d6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1266 microversion: 2.1 time: 0.640845 Sep 03 21:03:04.708977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1766/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:04 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1266 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:04.825835 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e44f3bf-8a12-4dd5-ab0a-77ceff461ee3 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/3cbdbcfc-9577-407d-90f2-0f801013927b" status: 202 len: 0 microversion: 2.1 time: 0.414317 Sep 03 21:03:04.826786 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1939/3705] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:03:04 2022] DELETE /compute/v2.1/os-security-groups/3cbdbcfc-9577-407d-90f2-0f801013927b => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:03:04.834546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-744e1a13-b84d-4e9c-9c0e-8dfbef95f5d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] Calling method '.version_select at 0x7fae65df0f70>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:05.087745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:05.089970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:05.110476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.114275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.114942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.125968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.140156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.141678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.265293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:05.283876 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0debb1e-f34e-4a39-9a78-6a12eba6701a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1282 microversion: 2.1 time: 0.199769 Sep 03 21:03:05.307457 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1940/3706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:05 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:05.322979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062d35a7-962c-4f18-bed1-d5ffcec17e48", "name": "network-vif-deleted", "tag": "14d5226c-c9c1-42ed-bcc1-10c2d9dc519e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:05.364311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.365163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.365945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.420287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] Creating event network-vif-deleted:14d5226c-c9c1-42ed-bcc1-10c2d9dc519e for instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 on nch1-master-1 Sep 03 21:03:05.437543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-744e1a13-b84d-4e9c-9c0e-8dfbef95f5d8 tempest-SecurityGroupsTestJSON-797637096 tempest-SecurityGroupsTestJSON-797637096-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/82bf1454-456b-4de6-98f2-59b82940edde" status: 202 len: 0 microversion: 2.1 time: 0.606707 Sep 03 21:03:05.438116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1767/3707] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:03:04 2022] DELETE /compute/v2.1/os-security-groups/82bf1454-456b-4de6-98f2-59b82940edde => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:03:05.446412 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ccf38494-4492-4324-8a55-90704262329d req-2d9e4355-88f0-47f3-bdbb-6a377916a5b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138017 Sep 03 21:03:05.447101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:05.448279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:05.452712 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1941/3708] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:05.492308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.492824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.493304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.494035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.494542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.500177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.583090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.583974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.585423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.587345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lazy-loading 'fault' on Instance uuid 062d35a7-962c-4f18-bed1-d5ffcec17e48 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:05.733885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:05.735078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:05.775111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.779705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.781109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.782594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:05.783974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:05.789557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:05.935563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:05.962835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbf3c066-4bd8-46f8-9c9d-292b0ac6916d tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 200 len: 1311 microversion: 2.1 time: 0.523668 Sep 03 21:03:05.963633 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1768/3709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:05 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:06.140983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:06.151487 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5692d8b1-a7aa-4613-9dbc-a8f8fe931fb1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1272 microversion: 2.1 time: 0.426358 Sep 03 21:03:06.152827 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1942/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:05 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1272 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:06.323512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:06.324524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:06.337458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:06.338346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:06.339194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:06.340832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:06.341534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:06.342868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:06.466259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:06.483441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1f7ea07c-a0e3-43bf-897b-5e6d0e5aaa29 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1270 microversion: 2.1 time: 0.163350 Sep 03 21:03:06.499839 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1769/3711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:06 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:06.991013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:06.992255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 062d35a7-962c-4f18-bed1-d5ffcec17e48] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:07.009046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.009360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.009845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.010590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.011058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.011500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.052356 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] HTTP exception thrown: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Request method failure captured: Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 HTTP/1.1 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8C7zvixTayLwL6f_D-5n14CpIT-mu2tr5kk7S3-u3VeCzZPmpNVfGhokmb_CB_z8FP9c8mPDjn-RZb6zfEjySsUzOQXWR2ET4wpI6u5vFGhwsLg2_6s4YF3k-NJbNUNEbO7l68LfzgsEuFI4l65TQ9JMDYl1RtDS916Pzua8Rfzgnw Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f7e2c822238a45d9b4d01ecf2cebc29a Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '062d35a7-962c-4f18-bed1-d5ffcec17e48'} Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:07.054412 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. Sep 03 21:03:07.060352 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:07.062335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Returning 404 to user: Instance 062d35a7-962c-4f18-bed1-d5ffcec17e48 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:07.063923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e9764ec-8d4b-4691-b8f1-59bc9d9139dd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48" status: 404 len: 111 microversion: 2.1 time: 0.076274 Sep 03 21:03:07.068177 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1943/3712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:06 2022] GET /compute/v2.1/servers/062d35a7-962c-4f18-bed1-d5ffcec17e48 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:03:07.074494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:07.075169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:07.085558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.088234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.089695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.091225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.093525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.094974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.162555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:07.171044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:07.176132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:07.176945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:07.189116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.193266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.193982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.194754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.195373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.195827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.329407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c358caf-90a2-4a96-bd14-9b897c2881d7 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 204 len: 0 microversion: 2.1 time: 0.257489 Sep 03 21:03:07.331723 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1770/3713] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:07 2022] DELETE /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:03:07.353148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:07.355835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:07.369525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.370227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.371148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.372040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.372711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.373443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.606244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:07.621107 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d729d09e-5664-4e0c-8b47-4e2dd9fd2d63 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.449121 Sep 03 21:03:07.633486 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1944/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:07 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:07.642647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:07.655233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cdf5254f-213e-435f-800f-f79bb1f9cf6c tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1517 microversion: 2.1 time: 0.318617 Sep 03 21:03:07.674093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1771/3715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:07 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:07.675836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:07.676518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:07.684435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.685203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.685798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.686680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:07.687323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:07.687906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:07.918949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:07.928525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-901040ef-319a-40e0-81a3-af172dee858e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1312 microversion: 2.1 time: 0.280747 Sep 03 21:03:07.929105 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1945/3716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:07 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:08.645557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:08.646173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:08.658591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:08.659094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:08.662330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:08.663524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:08.666710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:08.667187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:08.688048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:08.689374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:08.711605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:08.714540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:08.716198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:08.723663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:08.724503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:08.725002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:09.054653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:09.071630 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-abde9ebf-df8e-40b5-835a-15c43331837f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1517 microversion: 2.1 time: 0.387324 Sep 03 21:03:09.084930 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1946/3717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:08 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1517 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:09.095062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:09.096127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:09.108928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:09.112394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:09.112951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:09.115139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:09.116327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:09.117784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:09.277550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:09.296779 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d79d2c32-5a55-4b61-9d0d-851c64954041 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.654806 Sep 03 21:03:09.312096 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1772/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:08 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:09.404568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:09.415571 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ecf54f81-a790-4e37-9af4-0a72921b779d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1333 microversion: 2.1 time: 0.338365 Sep 03 21:03:09.418819 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1947/3719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:09 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:10.103321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:10.104083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:10.127403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.127916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.142584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.142777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.143367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.143894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.321378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:10.322017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:10.333428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.335884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.336648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.341735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.342548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.343787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.730073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:10.734483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:10.755038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-44996fa1-a33c-418f-a4fc-df253cbc6c75 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.437316 Sep 03 21:03:10.755665 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1948/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:10 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:10.778289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:10.778863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:10.779037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:10.788945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.789707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.790750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.793149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.796037 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c60daae6-e141-4e58-a5d5-69c687f4a8fd tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 200 len: 1517 microversion: 2.1 time: 0.694183 Sep 03 21:03:10.796037 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1773/3721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:10 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 1517 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:10.796937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.797651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.812977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8de6ac6-a72f-415c-b514-05c2d6cc84be", "tag": "516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:10.835126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:10.835825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:10.836526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:10.863312 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] Creating event network-changed:516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb for instance e8de6ac6-a72f-415c-b514-05c2d6cc84be on nch2-master-1 Sep 03 21:03:10.870106 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ff7a0223-f132-4114-9410-46c9cec1c279 req-17650fd2-3111-4032-8de7-0a60d86bd1bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072971 Sep 03 21:03:10.873201 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1774/3722] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:11.156553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:11.167906 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1895bba-78cc-4a6d-a52c-8c208cc94972 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1333 microversion: 2.1 time: 0.411136 Sep 03 21:03:11.168510 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1949/3723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:10 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1333 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:11.778472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:11.780183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:11.799375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.800256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.800980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:11.801941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.802646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.803430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:11.824626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:11.825312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: 8fdfadd6-48f2-4373-9453-a27d2919c6f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:11.847262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.847820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.848285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:11.850384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.864261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.866480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:11.911941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] HTTP exception thrown: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Request method failure captured: Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 HTTP/1.1 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8C7zvixTayLwL6f_D-5n14CpIT-mu2tr5kk7S3-u3VeCzZPmpNVfGhokmb_CB_z8FP9c8mPDjn-RZb6zfEjySsUzOQXWR2ET4wpI6u5vFGhwsLg2_6s4YF3k-NJbNUNEbO7l68LfzgsEuFI4l65TQ9JMDYl1RtDS916Pzua8Rfzgnw Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: f7e2c822238a45d9b4d01ecf2cebc29a Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '8fdfadd6-48f2-4373-9453-a27d2919c6f6'} Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:11.913526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. Sep 03 21:03:11.919270 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:11.923286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Returning 404 to user: Instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:11.924828 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-acb65972-6ea6-440a-80cb-58765e666609 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6" status: 404 len: 111 microversion: 2.1 time: 0.105657 Sep 03 21:03:11.927387 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1950/3724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:11 2022] GET /compute/v2.1/servers/8fdfadd6-48f2-4373-9453-a27d2919c6f6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:03:11.942389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:11.944029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:11.962474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.964265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.965494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:11.967093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:11.969399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:11.970139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.032924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:12.137038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:12.150851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d987792e-90b5-4a9e-ba78-bd9ead607798 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.376261 Sep 03 21:03:12.152870 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a1133f11-3997-48ee-80c4-644633da2991 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 204 len: 0 microversion: 2.1 time: 0.216575 Sep 03 21:03:12.156197 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1951/3725] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:11 2022] DELETE /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:03:12.162063 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1775/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:11 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:12.174254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:12.176700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:12.190388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:12.190922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:12.191384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.192122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:12.192586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:12.193894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:12.194789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:12.198685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.209839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:12.210885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:12.211994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:12.213901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:12.218814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:12.221139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.222405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:12.226650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:12.227373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.450790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:12.462099 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c76cf866-c989-47ce-bfc1-8837431033bb tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1516 microversion: 2.1 time: 0.295513 Sep 03 21:03:12.465742 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1952/3727] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:12 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:12.530764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:12.539416 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb166ab3-1567-4662-8987-bc1a570cd204 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.349755 Sep 03 21:03:12.540213 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1776/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:12 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:12.907068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdfadd6-48f2-4373-9453-a27d2919c6f6", "name": "network-vif-deleted", "tag": "809cafe1-5246-4348-81ff-ab43f23ef668"}, {"name": "network-changed", "server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "tag": "64eb9915-9336-4bb7-8fd1-1044b6e40476"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:12.918343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=14 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:12.922679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:12.923590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:12.924153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:12.940780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Creating event network-vif-deleted:809cafe1-5246-4348-81ff-ab43f23ef668 for instance 8fdfadd6-48f2-4373-9453-a27d2919c6f6 on nch2-master-1 Sep 03 21:03:12.941620 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] Creating event network-changed:64eb9915-9336-4bb7-8fd1-1044b6e40476 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:12.955345 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-19718b32-096a-48e6-8d81-85646d1092d8 req-850a5f3e-d0c2-49bc-89c6-2adb65734bb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055529 Sep 03 21:03:12.957674 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1953/3729] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:13.184492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:13.185309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:13.193946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.196685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.199537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.200591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.202737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.203817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.495399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:13.497852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:13.504866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:13.517145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.517653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.518101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.518828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.519808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.519808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.524918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:13.546783 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2d7d6d0-2c13-4f4b-b33c-3ba25ddd9963 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.360807 Sep 03 21:03:13.548087 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1777/3730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:13 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:13.576604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:13.577635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:13.587080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.588292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.589860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.591108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:13.591682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:13.592198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:13.704558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:13.713565 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cba7da56-4a68-485b-bd39-5c82931f2843 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1516 microversion: 2.1 time: 0.228023 Sep 03 21:03:13.714412 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1954/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:13 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:13.927721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:13.937381 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42772cf8-3dc0-4243-a3b1-8532e55d3a80 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.365876 Sep 03 21:03:13.937953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1778/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:13 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:14.573644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:14.575086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:14.585209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:14.588405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:14.589923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:14.594555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:14.596479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:14.599695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:14.742856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:14.744791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:14.759520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:14.762285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:14.764369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:14.765819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:14.768146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:14.769632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:15.071010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:15.086181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-764912bc-2d07-4f59-adb4-5d0b3f8dcc0c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.516855 Sep 03 21:03:15.088880 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1955/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:14 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:15.097867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:15.100647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:15.111162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:15.112107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:15.112715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:15.114102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:15.114767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:15.115556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:15.391263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:15.414420 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-50aae94b-a522-41f8-a9f7-87a8e37d4414 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1474 microversion: 2.1 time: 0.674401 Sep 03 21:03:15.416347 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1779/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:14 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1474 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:15.436332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "tag": "a1bf790a-1061-4088-b1db-03136520f21f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:15.455460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:15.456662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:15.457356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:15.475784 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] Creating event network-changed:a1bf790a-1061-4088-b1db-03136520f21f for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:15.483898 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-306cd189-05b4-4850-ba0c-7fa0a7ae98a0 req-f1c9be68-1e6b-4253-be6e-2dbffd60ba51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065406 Sep 03 21:03:15.484741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1780/3735] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:15.884642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb", "name": "network-vif-deleted", "tag": "8f999e56-718f-4e7d-9370-3efa7e4e4933"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:15.894242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:15.917647 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5463c4e2-f198-49ac-8b62-a6be425ea164 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.827106 Sep 03 21:03:15.924614 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1956/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:15 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:15.927388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:15.928405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:15.929135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:15.952185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] Creating event network-vif-deleted:8f999e56-718f-4e7d-9370-3efa7e4e4933 for instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb on nch2-master-1 Sep 03 21:03:15.968135 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e2212b47-d103-42cf-93a9-34392f89fa5b req-f81f6db4-8a37-4681-9603-514f1ebbc097 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087640 Sep 03 21:03:15.975037 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1781/3737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:16.116784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:16.117899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:16.151892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.157147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.157891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.159384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.160384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.167785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.443957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:16.445204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:16.470694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.472127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.474340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.479706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.480411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.481063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.579015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.584284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.585126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.586563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lazy-loading 'fault' on Instance uuid e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:16.612239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:16.635965 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9ea263e9-7037-45bf-b8a2-c7de36751a83 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.522600 Sep 03 21:03:16.638167 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1957/3738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:16 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:16.694680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e2c822238a45d9b4d01ecf2cebc29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250efefcd9e84269a090b0a7ec433c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:16.711682 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-475b101a-1aa5-4a0a-8435-60460c465ec9 tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 200 len: 1311 microversion: 2.1 time: 0.272486 Sep 03 21:03:16.740349 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1782/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:16 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:16.959104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:16.960505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:16.983591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.985437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.987014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:16.987926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:16.988272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:16.988712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.290195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:17.304140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-add1c9f9-9bef-4cb4-b021-5a879ed6cd1c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.350098 Sep 03 21:03:17.304987 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1958/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:16 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:17.579995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "tag": "0ab5952e-0cc8-49c5-ab47-fb19ec2420a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:17.601304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:17.602071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:17.602717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.628153 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] Creating event network-changed:0ab5952e-0cc8-49c5-ab47-fb19ec2420a0 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:17.646786 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-dd033de6-3c14-41ad-aff6-23b266289420 req-4d6b9f27-87a1-47a2-9046-ba74b0a00fb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070801 Sep 03 21:03:17.651691 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1783/3741] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:17.666428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:17.668051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:17.682606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:17.687492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:17.688200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.689183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:17.694132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:17.694827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.745834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:17.747116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] [instance: e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:17.760364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:17.761822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:17.763003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.764144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:17.767417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:17.768304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:17.804522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] HTTP exception thrown: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Request method failure captured: Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb HTTP/1.1 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8C7zvixTayLwL6f_D-5n14CpIT-mu2tr5kk7S3-u3VeCzZPmpNVfGhokmb_CB_z8FP9c8mPDjn-RZb6zfEjySsUzOQXWR2ET4wpI6u5vFGhwsLg2_6s4YF3k-NJbNUNEbO7l68LfzgsEuFI4l65TQ9JMDYl1RtDS916Pzua8Rfzgnw Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/250efefcd9e84269a090b0a7ec433c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 250efefcd9e84269a090b0a7ec433c87 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1558645168 Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: f7e2c822238a45d9b4d01ecf2cebc29a Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ListServerFiltersTestJSON-1558645168-project Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb'} Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:17.811112 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] Returning 404 to user: Instance e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:17.816330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5beabe8-4955-42b2-b4fe-8b92f87fe62f tempest-ListServerFiltersTestJSON-1558645168 tempest-ListServerFiltersTestJSON-1558645168-project] 10.222.0.16 "GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb" status: 404 len: 111 microversion: 2.1 time: 0.075176 Sep 03 21:03:17.818915 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1784/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:17 2022] GET /compute/v2.1/servers/e7cb62b8-6c3f-49ee-ae77-b36130ac4cfb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:03:18.107814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de6ac6-a72f-415c-b514-05c2d6cc84be", "name": "network-vif-plugged", "status": "completed", "tag": "516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:18.119445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:18.119943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:18.120394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:18.138105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:18.146616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4012ec4-c85c-433e-ad35-9ce8f83d0f85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.484666 Sep 03 21:03:18.152299 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1959/3743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:17 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:18.162452 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] Creating event network-vif-plugged:516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb for instance e8de6ac6-a72f-415c-b514-05c2d6cc84be on nch2-master-1 Sep 03 21:03:18.170758 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e2abaa8a-e044-4033-b69b-3dd634fa7ac6 req-563ff33c-9580-4dc8-985e-a372cba41640 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067962 Sep 03 21:03:18.171392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1785/3744] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:03:18.329668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:18.330603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:18.343743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:18.344334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:18.344842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:18.345610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:18.346083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:18.346528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:18.658525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:18.680421 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f64b925-6e35-4e25-a9f7-af51a0390655 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.354174 Sep 03 21:03:18.701517 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1960/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:18 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:19.183876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:19.184598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:19.209081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:19.220933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:19.230544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:19.231412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:19.231906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:19.235054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:19.626140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:19.636203 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2970d300-aa05-47f5-8b01-54a385fe3964 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1314 microversion: 2.1 time: 0.462779 Sep 03 21:03:19.642631 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1786/3746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:19 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:19.717681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:19.718376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:19.741673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:19.742105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:19.742729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:19.743481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:19.744014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:19.744466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:20.200472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:20.210040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63918846-0d90-4b03-8d41-1058fa30f0bd tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.496991 Sep 03 21:03:20.210988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1961/3747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:19 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:20.674398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:20.675992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:20.686161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:20.689132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:20.691274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:20.694659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:20.696344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:20.701672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:21.029913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:21.051336 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88cad211-9c28-49a7-98a5-ca5cee845e3f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1502 microversion: 2.1 time: 0.385753 Sep 03 21:03:21.052352 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1787/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:20 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:21.239639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:21.240462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:21.255729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:21.256249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:21.256709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:21.257472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:21.257943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:21.258383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:21.867535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:21.882064 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1563a741-5d72-4b41-ab04-c411f1ae20c7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.648089 Sep 03 21:03:21.882700 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1962/3749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:21 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:22.917265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:22.918785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:22.930330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:22.930840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:22.931294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:22.932062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:22.932534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:22.933003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:23.139164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-538159483", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:23.235744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:23.266111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:23.270291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:23.277744 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8814f54-0fd1-44fb-b839-7b010b3efd43 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.364394 Sep 03 21:03:23.278771 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1788/3750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:22 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:23.940862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:23.944617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:23.948572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:23.949480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:23.950275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:24.001539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:24.002742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:24.006883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:24.008416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:24.019615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:24.020262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:24.074427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:24.088965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:24.138311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:24.141169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:24.217318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec6f9d4c-3bb4-4424-890b-cdea3f1ab1b6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082595 Sep 03 21:03:24.227151 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1963/3751] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:03:24.233335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0e04834-36db-4414-8eaa-24ed588ffed6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:24.233955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0e04834-36db-4414-8eaa-24ed588ffed6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:24.304490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:24.305306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:24.321682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:24.322282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0e04834-36db-4414-8eaa-24ed588ffed6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:24.323203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:24.326587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:24.327767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:24.330323 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0e04834-36db-4414-8eaa-24ed588ffed6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d" status: 200 len: 1214 microversion: 2.1 time: 0.100737 Sep 03 21:03:24.330646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:24.331662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:24.333703 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1789/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:24 2022] GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:24.357966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:24.358481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:24.392023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:25.011452 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.scheduler.client.report [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Deleted allocations for instance 93b40596-2c6a-486e-867a-0d43e82b3d0d Sep 03 21:03:25.018799 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Instance Mapping does not exist while attempting local delete cleanup. Sep 03 21:03:25.020135 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2536e7fc-d3e9-4224-8db6-4f7ca913f0db tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d" status: 204 len: 0 microversion: 2.1 time: 0.666632 Sep 03 21:03:25.023772 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1790/3753] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:24 2022] DELETE /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:03:25.030848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:25.031564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:25.047402 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d HTTP/1.1 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '93b40596-2c6a-486e-867a-0d43e82b3d0d'} Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:25.049608 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fc9024d5-5ac6-4871-8d30-4894e938e18b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d" status: 404 len: 111 microversion: 2.1 time: 0.026050 Sep 03 21:03:25.054753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1791/3754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:25 2022] GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:03:25.057044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:25.077733 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ac56465-27e5-4796-93fb-07a9c87a2f87 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.777457 Sep 03 21:03:25.078328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1964/3755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:24 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:25.302049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1817408475", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:25.377959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:26.106670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:26.107837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:26.115688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:26.116729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:26.119963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:26.121332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:26.121990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:26.122624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:26.338977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:26.349436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:26.351758 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab4ddf0d-0d11-4673-ac4d-e50f5d5a185d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.252611 Sep 03 21:03:26.355068 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1965/3756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:26 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:26.943449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:26.944521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:26.945042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:26.945464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:26.946261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:26.968658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:26.970903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:26.973744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:26.975123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:26.976869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:26.977683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:27.072482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:27.092350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:27.144301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:27.149961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:27.292168 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f746593d-d7cf-41df-8c5c-c41d86e09e22 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.003058 Sep 03 21:03:27.292831 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1792/3757] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:03:27.305039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2ce96eb3-6db8-4c86-80f1-9f079746561a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:27.306808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2ce96eb3-6db8-4c86-80f1-9f079746561a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:27.375269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:27.376305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:27.393114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:27.393469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:27.394180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:27.413428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:27.421352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:27.422166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:27.550989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2ce96eb3-6db8-4c86-80f1-9f079746561a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:27.560437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2ce96eb3-6db8-4c86-80f1-9f079746561a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1215 microversion: 2.1 time: 0.259762 Sep 03 21:03:27.569547 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1966/3758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:27 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:27.945041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-plugged", "status": "completed", "tag": "a1bf790a-1061-4088-b1db-03136520f21f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:27.992062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:27.992553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:27.993016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:28.060822 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] Creating event network-vif-plugged:a1bf790a-1061-4088-b1db-03136520f21f for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:28.075643 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-61158e68-b010-4bdc-af8b-fc0bb85e9c1a req-56102e00-54bb-4848-aff0-d8988be1e3cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134218 Sep 03 21:03:28.081872 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1967/3759] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:28.363006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:28.379118 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b5f6c63-30cd-4bde-9697-bd97740bb158 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 1.007817 Sep 03 21:03:28.381519 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1793/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:27 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:28.592850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:28.593777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:28.604500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:28.630116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:28.631449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:28.632109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:28.633052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:28.635981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:28.636671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:28.889643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:28.931235 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d42cd599-6d22-437b-b845-74cd28976a56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1211 microversion: 2.1 time: 0.341178 Sep 03 21:03:28.934744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1968/3761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:28 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1211 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:29.410733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:29.411413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:29.426709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:29.427224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:29.427675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:29.428558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:29.429071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:29.430920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:29.960425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:29.961223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:29.980887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:29.982844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:29.983017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:29.987072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:29.989237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:29.989734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:30.187071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:30.198074 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dee24c70-afb7-48ca-8fa5-17e04f9e5ab0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1273 microversion: 2.1 time: 0.242191 Sep 03 21:03:30.198652 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1969/3762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:29 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:30.230561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-plugged", "status": "completed", "tag": "0ab5952e-0cc8-49c5-ab47-fb19ec2420a0"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:30.252423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:30.254313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:30.255012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:30.285346 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] Creating event network-vif-plugged:0ab5952e-0cc8-49c5-ab47-fb19ec2420a0 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:30.315192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-212f8035-51ed-4a5a-8446-08d9b8669919 req-3289253b-db4c-40fe-ba75-cbe641dcfb70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090894 Sep 03 21:03:30.322533 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1970/3763] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:30.488876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:30.501359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a0865fee-080f-4539-bfb5-8b6c562e4d17 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 1.095350 Sep 03 21:03:30.502843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1794/3764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:29 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:31.223768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:31.224803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:31.239215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:31.239939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:31.242007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:31.243005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:31.253913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:31.255610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:31.527867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:31.530653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:31.549958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:31.551191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:31.551907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:31.552788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:31.553400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:31.553971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:31.754937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:31.768777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a1a636bc-af2f-4b51-94bc-0e38f91744b1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.549856 Sep 03 21:03:31.769442 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1971/3765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:31 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:31.981987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:31.995668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24cae3b5-0d7b-41e7-871d-572f69d7fb73 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.471457 Sep 03 21:03:32.010663 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1795/3766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:31 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:32.351850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-plugged", "status": "completed", "tag": "64eb9915-9336-4bb7-8fd1-1044b6e40476"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:32.362803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:32.363557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:32.364188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:32.377520 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] Creating event network-vif-plugged:64eb9915-9336-4bb7-8fd1-1044b6e40476 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:32.383363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a247250b-f795-4a35-8a56-8902a20f9278 req-6aaba1f3-28a6-4aa8-ae53-08a12bf515b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Sep 03 21:03:32.384502 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1796/3767] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:32.449631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c1f9dfc-1943-4da7-ae3a-6ecfb91c7b32 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: .version_select at 0x7fae66896f70>, body: {"keypair": {"name": "tempest-keypair-307655502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvEPxlzrrZidww7GfJwtqTLTJsU2OejPz6HCdD2RlKY5eMPmtqKAmDGl73qAXMRWxmPuf3U1cMEoVo9CI32S4PYkyHTxwEfb9cgniF28Ht7yJxpJUXxnF/SaRP91ah/kA=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:32.484147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4c1f9dfc-1943-4da7-ae3a-6ecfb91c7b32 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:32.491283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-4c1f9dfc-1943-4da7-ae3a-6ecfb91c7b32 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:32.542654 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c1f9dfc-1943-4da7-ae3a-6ecfb91c7b32 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260764 Sep 03 21:03:32.543873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1972/3768] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:03:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:32.799214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:32.800005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:32.813598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:32.814410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:32.815111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:32.816624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:32.831567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:32.832411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:33.048033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:33.048698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:33.069618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:33.070166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:33.070811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:33.071977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:33.073518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:33.075140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:33.285388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:33.306637 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9a9f5b0-46dc-4cd4-a712-97d63879a123 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.517210 Sep 03 21:03:33.307750 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1797/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:32 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:33.631581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:33.652995 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-258762f0-a0c0-4002-bf46-0b4688e056fe tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1354 microversion: 2.1 time: 0.615095 Sep 03 21:03:33.655698 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1973/3770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:33 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1354 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:34.192707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50684007-380d-46af-b423-a911129fcf8d", "tag": "bcca92b8-f21c-413b-9099-adf772a9aa90"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:34.225482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:34.226247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:34.226987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:34.254936 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] Creating event network-changed:bcca92b8-f21c-413b-9099-adf772a9aa90 for instance 50684007-380d-46af-b423-a911129fcf8d on nch1-master-1 Sep 03 21:03:34.265989 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b259af2b-ecc6-44ae-8e96-66cd10b6c77b req-2692232d-d9b7-47aa-ab01-edd83446ab06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077985 Sep 03 21:03:34.267043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1798/3771] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:34.335764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:34.336493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:34.338770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:34.348543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:34.349871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:34.350552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:34.351687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:34.352357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:34.353078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:34.683578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:34.684856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:34.707941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:34.709692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:34.710419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:34.711451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:34.712159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:34.712857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:34.924655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:34.939285 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c21c1aa-2ec4-490e-ac54-cc1e3f030fec tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.609113 Sep 03 21:03:34.963279 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1974/3772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:34 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:34.973787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1118595107", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1cd1193-a10d-479f-9da3-5114ed491f2f"}], "security_groups": [{"name": "tempest-securitygroup--761735080"}], "key_name": "tempest-keypair-307655502", "user_data": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:35.067046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:35.118227 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73059055-b836-4c61-8d9e-6f74e8d7641e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1802 microversion: 2.1 time: 0.440593 Sep 03 21:03:35.118891 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1799/3773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:34 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1802 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:35.142777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:35.144005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:35.152147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.152659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.153141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.153863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.154417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.154856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.182144 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68a05788-987a-45fe-b343-c7ef5429b69f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff/ips" status: 200 len: 216 microversion: 2.1 time: 0.043404 Sep 03 21:03:35.191499 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1800/3774] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:03:35 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff/ips => generated 216 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:03:35.204622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:35.207005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:35.215737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.216525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.217174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.218105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.218747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.219359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.256638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:35.370979 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc3c1682-223b-4820-912c-e021fb133d3d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 204 len: 0 microversion: 2.1 time: 0.175540 Sep 03 21:03:35.371805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1801/3775] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:35 2022] DELETE /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:03:35.385923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:35.387602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:35.396158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.396814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.397496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.398597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.399490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.400763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.517756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] validate_networks() for [('b1cd1193-a10d-479f-9da3-5114ed491f2f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:35.653997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:35.662251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dfd14f13-19e0-4637-8f43-ec26de497522 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1808 microversion: 2.1 time: 0.283972 Sep 03 21:03:35.663735 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1802/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:35 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:35.967929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:35.969697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:35.977401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.978936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.979567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:35.980464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:35.981124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:35.982286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:36.241996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:36.252840 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e16c4bd3-b2d2-4948-881a-5825b55c7884 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.288575 Sep 03 21:03:36.254213 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1803/3777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:35 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:36.597406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:36.598457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:36.599262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:36.600552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:36.601212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:36.642316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:36.643463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:36.644152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:36.645257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:36.645969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:36.646672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:36.687831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:36.688466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:36.691784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:36.697510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:36.698029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:36.698481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:36.699219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:36.699686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:36.700130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:36.705507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:36.750220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:36.755881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:36.843033 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc703cc6-90bf-4a64-b048-6487a96a0484 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.878026 Sep 03 21:03:36.844338 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1975/3778] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:03:36.868123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1f39acf-9a03-459c-979e-aba016765dee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:36.871595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1f39acf-9a03-459c-979e-aba016765dee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:37.005887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:37.126241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:37.227030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e1f39acf-9a03-459c-979e-aba016765dee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:37.238333 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1f39acf-9a03-459c-979e-aba016765dee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1238 microversion: 2.1 time: 0.383110 Sep 03 21:03:37.239410 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1976/3779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:36 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1238 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:37.271760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:37.279517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:37.280334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:37.283410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e903087-9893-4692-a979-a7359fdc1b4d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1808 microversion: 2.1 time: 0.599808 Sep 03 21:03:37.284015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1804/3780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:36 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1808 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:37.297491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:37.302421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:37.303001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:37.304094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:37.304758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:37.305719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:37.621172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:37.643227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5fc3ebcf-27a3-4053-8dc0-fcecee90f0c8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.366857 Sep 03 21:03:37.657762 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1977/3781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:37 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:37.948982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-deleted", "tag": "0ab5952e-0cc8-49c5-ab47-fb19ec2420a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:37.971205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:37.973804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:37.974501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.008858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] Creating event network-vif-deleted:0ab5952e-0cc8-49c5-ab47-fb19ec2420a0 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:38.022650 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bfdf9273-1ded-4e2e-b1e2-eba6e0f91aec req-92159e72-06ba-4fbd-9864-2e9e49c7d405 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078672 Sep 03 21:03:38.026646 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1805/3782] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:38.269015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:38.269015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:38.288520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.289420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.290102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.292081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.294291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.294899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.314209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:38.316545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:38.340133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.343532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.344330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.346116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.349459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.350883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.533614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:38.545248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49c9f305-9eda-4513-b7b1-661f1700c82b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1234 microversion: 2.1 time: 0.282575 Sep 03 21:03:38.561959 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1978/3783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:38 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1234 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:38.670548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:38.671911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:38.688997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.690933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.691422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.692173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:38.699470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:38.701501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:38.710820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:38.727263 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-34915c79-d9c5-41d7-987c-7c12b43af6ca tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1673 microversion: 2.1 time: 0.423072 Sep 03 21:03:38.732019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1806/3784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:38 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1673 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:39.169225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:39.186546 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6996d6e-80b2-454f-8d6f-29e8ee7193c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.516865 Sep 03 21:03:39.187473 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1979/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:38 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:39.577086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:39.577878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:39.615953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:39.617473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:39.618194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:39.619244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:39.620028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:39.620793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:39.759604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:39.760246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:39.773535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:39.774054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:39.774513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:39.776144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:39.776629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:39.777997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:39.848834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:39.876089 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e6e0344-89c6-4a6f-8dca-1ae814ec0d86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1308 microversion: 2.1 time: 0.302029 Sep 03 21:03:39.879010 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1807/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:39 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:40.036989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:40.057748 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e9062b3-8c0f-4464-ba3c-8b01ec3e5a91 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1652 microversion: 2.1 time: 0.305569 Sep 03 21:03:40.059866 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1980/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:39 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1652 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:40.213911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:40.214932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:40.224327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:40.225043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:40.225717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:40.226591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:40.227191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:40.228429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:40.341728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-deleted", "tag": "a1bf790a-1061-4088-b1db-03136520f21f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:40.362366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:40.364283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:40.366120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:40.418692 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] Creating event network-vif-deleted:a1bf790a-1061-4088-b1db-03136520f21f for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:40.433715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-506bcb48-8343-4995-be63-b4609767e474 req-554fc0c2-372a-40df-8b7e-e5cbc9fa902b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097168 Sep 03 21:03:40.434402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1981/3788] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:03:40.749666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:40.758562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d80f041-c8b1-417b-a213-44e296e2f341 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.548749 Sep 03 21:03:40.759668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1808/3789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:40 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:40.902685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:40.903377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:40.916921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:40.917502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:40.917971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:40.918695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:40.919163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:40.919604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:41.035602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:41.056318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-10d1cdee-ed97-4c5f-8033-0cbbb7feca99 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1296 microversion: 2.1 time: 0.157766 Sep 03 21:03:41.061657 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1982/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:41.083267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:41.083910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:41.086806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:41.096182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:41.096698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:41.097440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:41.098164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:41.098632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:41.099074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:41.146360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:41.146935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:41.147522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:41.148159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lazy-loading 'fault' on Instance uuid 3f347941-74ba-4e12-8749-b782c09e62ff {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:41.152963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:41.236136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:41.246656 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dda4c29c-7964-4cd9-aaa6-aae9eff64370 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 200 len: 1302 microversion: 2.1 time: 0.167728 Sep 03 21:03:41.248040 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1809/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:41 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 1302 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:41.784337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:41.788142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:41.796680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:41.797627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:41.798510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:41.799484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:41.800684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:41.801668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.070460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:42.088176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:42.089259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:42.094653 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-edca6dd2-a3ca-41f5-9bec-e7737f5e789a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.307021 Sep 03 21:03:42.097621 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1983/3792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:41 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:42.145368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:42.148750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:42.154687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.156049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:42.156740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:42.157237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.270871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:42.271501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:42.281838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:42.282432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:42.282753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.283480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:42.283928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:42.290695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.322077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff HTTP/1.1 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3f347941-74ba-4e12-8749-b782c09e62ff'} Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:42.324079 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:03:42.330748 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:42.333971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:42.335520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea2d5185-d0e5-41af-bd5d-bb37df0edc7f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 404 len: 111 microversion: 2.1 time: 0.069276 Sep 03 21:03:42.337773 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1984/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:42 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:03:42.491797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f347941-74ba-4e12-8749-b782c09e62ff", "name": "network-vif-deleted", "tag": "64eb9915-9336-4bb7-8fd1-1044b6e40476"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:42.513168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:42.516522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:42.517102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:42.552634 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] Creating event network-vif-deleted:64eb9915-9336-4bb7-8fd1-1044b6e40476 for instance 3f347941-74ba-4e12-8749-b782c09e62ff on nch2-master-1 Sep 03 21:03:42.561777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-896c5402-0258-43a0-98b2-929eef6aeafe req-1cbcbf6b-4fd8-4317-9595-d0c4e1826b7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080371 Sep 03 21:03:42.563634 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1985/3794] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:42.647739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:42.659801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d71da442-e635-4fb2-a4ac-58964c80658c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.576553 Sep 03 21:03:42.661019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1810/3795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:43.127448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:43.129601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:43.147292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:43.148506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:43.149454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:43.151656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:43.153040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:43.153737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:43.297934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50684007-380d-46af-b423-a911129fcf8d", "name": "network-vif-plugged", "status": "completed", "tag": "bcca92b8-f21c-413b-9099-adf772a9aa90"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:43.338011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:43.338525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:43.347457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:43.374274 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] Creating event network-vif-plugged:bcca92b8-f21c-413b-9099-adf772a9aa90 for instance 50684007-380d-46af-b423-a911129fcf8d on nch1-master-1 Sep 03 21:03:43.388146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ffa7dc0c-b769-4ab8-a88c-d19b266a0f14 req-ec6e4422-a876-4604-861a-fa8bc83b5c77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095959 Sep 03 21:03:43.389104 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1811/3796] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:43.397394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:43.406303 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-10b6e1bd-1f88-47f0-82cb-04e9e2dbab91 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.287987 Sep 03 21:03:43.407369 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1986/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:43 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:43.685014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:43.685857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:43.692598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:43.699986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:43.699986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:43.699986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:43.699986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:43.699986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:44.252436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:44.276834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ad405766-da35-4ef8-8d6b-978c0440b223 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.585130 Sep 03 21:03:44.277950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1812/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:43 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:44.432213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:44.433598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:44.446237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:44.447636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:44.447789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:44.448747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:44.455016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:44.455768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:44.685479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:44.695732 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8205ff9-7110-445e-a9e0-3a4c378f186b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1315 microversion: 2.1 time: 0.270033 Sep 03 21:03:44.696374 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1987/3799] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:44 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:45.029911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:45.043526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:45.044324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:45.045010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:45.059992 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] Creating event network-changed:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:03:45.069023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-be65c750-e6df-45d4-8596-9817359d9486 req-70e16f9e-8eec-43f2-9a59-75975088f0e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042766 Sep 03 21:03:45.071216 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1813/3800] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:45.309392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:45.312863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:45.341763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:45.342857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:45.346204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:45.347928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:45.350985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:45.353331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:45.720246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:45.721280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:45.734648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:45.735483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:45.736415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:45.737489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:45.738183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:45.738987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:45.739786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:45.748362 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a99f9485-3044-44dd-a1e1-11c2765f76d0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.450814 Sep 03 21:03:45.759428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1988/3801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:45 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:46.201712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:46.238895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-33663610-cf87-492c-9b41-4ad9b173272d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1502 microversion: 2.1 time: 0.518474 Sep 03 21:03:46.241132 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1814/3802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:45 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1502 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:46.265293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:46.265795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:46.273643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.274145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.275582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.275841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.276272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.276706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.316494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:46.426146 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e08d173b-4b2f-4b38-b340-3b4387507282 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.164659 Sep 03 21:03:46.444575 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1989/3803] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:03:46 2022] POST /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:03:46.449882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:46.451338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:46.467898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.478644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.491387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.492433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.493839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.501101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.783812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:46.784534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:46.804356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:46.817512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.823622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.825129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.826668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:46.827153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:46.827592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:46.905381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:46.920236 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b22fef34-d78d-4ce7-b9e8-6dce20f0d89f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1507 microversion: 2.1 time: 0.475458 Sep 03 21:03:46.933221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1815/3804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:46 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:47.232057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=20 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:47.250236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:47.261943 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-02d9dca0-a524-4807-a806-1d5650a39714 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.483483 Sep 03 21:03:47.263049 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1990/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:47.957585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:47.960049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:47.979229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:47.979739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:47.980182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:47.981156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:47.981846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:47.982441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.287478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:48.288155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:48.298752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.299290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.299770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.300536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.301106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.301544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.581140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:48.591234 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7214d40e-5172-44ce-ae53-dbcf6a8aef61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1487 microversion: 2.1 time: 0.646088 Sep 03 21:03:48.593104 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1816/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:47 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1487 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:48.619247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:48.619892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:48.626793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.627590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.628246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.629221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.629912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.630570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.665965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:48.777233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f46e6ebb-2b81-430e-a736-084ef3399e4f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 204 len: 0 microversion: 2.1 time: 0.161344 Sep 03 21:03:48.782083 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1817/3807] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:48 2022] DELETE /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:03:48.789364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:48.790843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:48.798600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.799199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.799768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.800587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:48.801197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:48.801747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:48.974349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:48.982290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:48.990203 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-843f9326-680d-4643-9e07-eb1503695951 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1493 microversion: 2.1 time: 0.206307 Sep 03 21:03:48.990785 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1818/3808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:48 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1493 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:48.993354 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9092c8b-e76c-421a-9d6a-3b395ebed385 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.709991 Sep 03 21:03:48.994059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1991/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:50.019640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:50.022330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:50.023090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:50.024069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:50.049262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:50.050811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:50.051456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:50.052561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:50.053369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:50.053847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:50.054282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:50.054583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:50.055050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:50.055789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:50.056247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:50.058847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:50.477402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:50.490869 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-788f6c55-1cb9-4e93-9bd4-65a86dcb0ced tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1493 microversion: 2.1 time: 0.479472 Sep 03 21:03:50.501341 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1819/3810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:50 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1493 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:50.745553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:50.760316 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53b36503-823b-4849-8e36-7e834856ab5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.743428 Sep 03 21:03:50.773450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1992/3811] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:50.792050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-652485349", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "471aa287-52d6-4f7e-9866-99abf28315f2"}, {"uuid": "6a6fcbfa-37cf-49a0-9925-de93108a28f0"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:50.898450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] validate_networks() for [('471aa287-52d6-4f7e-9866-99abf28315f2', None, None, None, None, None), ('6a6fcbfa-37cf-49a0-9925-de93108a28f0', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:51.530242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:51.531038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:51.541188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:51.545511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:51.546081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:51.546944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:51.548798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:51.549398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:51.818745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:51.831734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28494484-e561-4612-8f9d-fb774ccf1279 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1493 microversion: 2.1 time: 0.305515 Sep 03 21:03:51.852138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1993/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:51 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1493 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:51.861387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:51.862656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:51.871764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:51.872949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:51.873628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:51.874715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:51.875410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:51.876090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:52.298467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:52.331284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff738ba1-5589-49df-aa74-3b3ffb53f0bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.476655 Sep 03 21:03:52.333648 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1994/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:51 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:52.687564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50684007-380d-46af-b423-a911129fcf8d", "name": "network-vif-deleted", "tag": "bcca92b8-f21c-413b-9099-adf772a9aa90"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:52.723454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:52.723968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:52.724445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:52.752921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] Creating event network-vif-deleted:bcca92b8-f21c-413b-9099-adf772a9aa90 for instance 50684007-380d-46af-b423-a911129fcf8d on nch1-master-1 Sep 03 21:03:52.796359 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-23b75ce1-0f08-4cfd-9c36-b8637670ada2 req-16f451fc-bdbb-4d49-b96b-aad2dc8c2dcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113133 Sep 03 21:03:52.802077 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1995/3814] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:52.857194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:52.858185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:52.867662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:52.868210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:52.868664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:52.891985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:52.892832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:52.910662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:52.988354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:52.988939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:52.989416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:52.989901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'fault' on Instance uuid 50684007-380d-46af-b423-a911129fcf8d {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:03:53.054017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:53.057672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:53.061585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:53.062283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:53.063560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:53.074485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:53.083305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d7543ae-657f-477f-b9d2-034b1805c0b4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 200 len: 1305 microversion: 2.1 time: 0.230953 Sep 03 21:03:53.088890 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1996/3815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:52 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:53.091945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:53.092660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:53.093285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:53.094180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:53.094792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:53.096136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:53.190345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Getting quotas for project 26e12c7419f641b4a7e56274a34826ee. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:53.203998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Getting quotas for user 77edcf09f5f84e51a4fb08dbaf763a67 and project 26e12c7419f641b4a7e56274a34826ee. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:53.225683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:53.229400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:53.296133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f79e53e6-399e-45e3-90b2-ddc883d04a07 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508773 Sep 03 21:03:53.296795 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1820/3816] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:03:53.308012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f030d9d7-e78d-40b6-b805-2de59ced9b33 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:53.308729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f030d9d7-e78d-40b6-b805-2de59ced9b33 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:53.363450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:53.364771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:53.374774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:53.377553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:53.378297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:53.380616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:53.381358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:53.383358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:53.395080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f030d9d7-e78d-40b6-b805-2de59ced9b33 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:53.407053 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f030d9d7-e78d-40b6-b805-2de59ced9b33 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1212 microversion: 2.1 time: 0.103070 Sep 03 21:03:53.420146 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1997/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:53 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:53.864783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:53.874690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47c24a06-290d-421e-aa18-843162f05ded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.515499 Sep 03 21:03:53.881539 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1821/3818] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:53 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:54.112531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:54.113194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:54.123484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.131196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.135959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.140489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.150956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.151723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.183819 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d HTTP/1.1 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '50684007-380d-46af-b423-a911129fcf8d'} Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:03:54.188862 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:03:54.194520 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:03:54.198019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:03:54.201278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8e91069c-821c-47df-bcff-5e89c362cf9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 404 len: 111 microversion: 2.1 time: 0.092872 Sep 03 21:03:54.205343 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1998/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:54 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:03:54.383119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-60881650", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:54.432324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:54.435448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:54.454875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.463282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.463994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.464877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.465499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.466053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.552864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:03:54.715519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:54.754098 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8af635b8-f209-4e1a-ad35-87c26e264698 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1264 microversion: 2.1 time: 0.326224 Sep 03 21:03:54.758611 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 1999/3820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:54 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1264 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:54.780401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:54.782271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:54.802871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.802871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.803380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.806967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:54.811193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:54.811784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:54.874710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:03:55.092731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:55.099863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c3152e2d-66a8-484f-9c2d-062c9205106f tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 204 len: 0 microversion: 2.1 time: 0.339320 Sep 03 21:03:55.107444 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2000/3821] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:03:54 2022] DELETE /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:03:55.117844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:55.126015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:55.135415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:55.136312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:55.137358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:55.138352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:55.140314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:55.141129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:55.576843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:55.591040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4521a963-d602-4e8e-8a8b-d829fc330100 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.481185 Sep 03 21:03:55.605368 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2001/3822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:55.623519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:55.628157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:55.643197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:55.643887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:55.644435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:55.645556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:55.646263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:55.646932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:55.910738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:55.922137 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cac9eb9a-ed82-498c-8cdb-28c388bd6e93 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1682 microversion: 2.1 time: 0.315434 Sep 03 21:03:55.922719 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2002/3823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:55 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1682 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:55.939556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-plugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:03:55.973980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:55.974469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:55.974929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.003456 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] Creating event network-vif-plugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:03:56.015360 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9131c652-f1b1-4f84-82e0-f960e1881a0d req-9584743b-fd0b-41ad-ac32-92f9d742b807 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082531 Sep 03 21:03:56.020085 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2003/3824] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:03:56.028797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:56.029961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:56.036565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.037366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.037983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.038866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.039481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.040647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.164539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:56.175597 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62229d3c-5a8b-43ef-8d26-19029234f51e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1270 microversion: 2.1 time: 0.151980 Sep 03 21:03:56.176609 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2004/3825] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:56 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:56.431224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:03:56.432354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:03:56.433156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:03:56.433826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:03:56.434502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:03:56.452102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.453059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.455222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.456387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.459561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.460405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.485690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:03:56.493996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:03:56.514194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:03:56.518839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:03:56.596390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d09bcfdf-b1d8-44ea-84f9-2b3888eaa0c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223060 Sep 03 21:03:56.599044 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1822/3826] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:03:56.609574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6c0a9bf-7646-484f-9846-777056a7daf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:56.610911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6c0a9bf-7646-484f-9846-777056a7daf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:56.626280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:56.630641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:56.652085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.654914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.658582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.659492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.663606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.664459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.809616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6c0a9bf-7646-484f-9846-777056a7daf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:56.823860 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6c0a9bf-7646-484f-9846-777056a7daf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1213 microversion: 2.1 time: 0.218657 Sep 03 21:03:56.829735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2005/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:56 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:56.958571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:56.959295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:56.975317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.975868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.976325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:56.979030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:56.981416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:56.981969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:57.329596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:57.343886 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41c6bd41-a5b9-47d2-9369-42d934c50d1c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.724741 Sep 03 21:03:57.346973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1823/3828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:56 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:57.360478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:57.361819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:57.372848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:57.373514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:57.374064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:57.375081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:57.376144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:57.376834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:57.539984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:57.569108 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18c42dc3-8fc0-43de-8a0d-211c23aef260 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1270 microversion: 2.1 time: 0.220102 Sep 03 21:03:57.574558 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1824/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:57 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:57.646539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:57.657189 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0259d5df-ef04-4f2c-a65f-98868db0b273 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1682 microversion: 2.1 time: 0.707998 Sep 03 21:03:57.658530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2006/3830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:56 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1682 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:57.862706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:57.863355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:57.876799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:57.890637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:57.891575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:57.894734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:57.895877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:57.898901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:58.234994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:58.266408 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2aa9ef0d-32d5-45d7-bb4b-e7da437a577b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1209 microversion: 2.1 time: 0.413738 Sep 03 21:03:58.270085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1825/3831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:57 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1209 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:58.369565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:58.370536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:58.388772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:58.391586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:58.392197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:58.394254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:58.396504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:58.397182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:58.416631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:58.601962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:58.603810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:58.624535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:58.625958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:58.629949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:58.630602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:58.631156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:58.631770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:59.040877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:59.041124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:59.049753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec9878f0-b8cc-4066-9ecd-5942a30f2acf tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1312 microversion: 2.1 time: 0.453826 Sep 03 21:03:59.054151 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1826/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:58 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:59.055284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82bd790d-dae3-48e0-84a0-81bc8422a9c9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1363 microversion: 2.1 time: 0.691103 Sep 03 21:03:59.061140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:59.063366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2007/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:58 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1363 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:03:59.067490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:59.084585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:59.085130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:59.085911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:59.086641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:59.094501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:59.095068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:59.124858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:59.296133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:03:59.299011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:03:59.314359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:59.315994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:59.318502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:59.320098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:03:59.321277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:03:59.325964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:03:59.464362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:59.474485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72285d29-9ad6-4aff-b6c7-22fe1f5cf1fe tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1271 microversion: 2.1 time: 0.183874 Sep 03 21:03:59.475289 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2008/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:59 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:03:59.584806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:03:59.597351 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37de87ff-ed5f-4efa-a534-00c987ba8bde tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1682 microversion: 2.1 time: 0.540973 Sep 03 21:03:59.599201 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1827/3835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:03:59 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1682 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:00.076178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:00.078115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:00.086197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:00.089214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.089732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.090168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.091020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:00.101471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.102220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.102844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.120484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.124197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.124704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.125501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.125981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.126419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.418946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:00.435616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eae335fa-8c5d-4882-b1ba-3c1246d2aad7 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.363502 Sep 03 21:04:00.436604 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2009/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:00 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:00.451367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6406841-4c7c-4de3-9ae4-d11d6e6d8237", "name": "network-vif-deleted", "tag": "d75e0aee-26b7-462f-bfd0-d3c0b6aea591"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:00.463898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.464612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.465339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.478928 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] Creating event network-vif-deleted:d75e0aee-26b7-462f-bfd0-d3c0b6aea591 for instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 on nch1-master-1 Sep 03 21:04:00.484702 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8c563112-1ffd-4742-8614-dc39898d4b6d req-0dbd7e17-887e-461c-a189-27deb9134f6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046703 Sep 03 21:04:00.485881 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2010/3837] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:00.501409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:00.502391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:00.512410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.513283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.513958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.515167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.515837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.516586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.688995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:00.699464 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a020963-252d-47f2-b161-4cddae70076e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1271 microversion: 2.1 time: 0.203872 Sep 03 21:04:00.714637 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2011/3838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:00 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:00.714637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:00.714637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:00.723648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.724299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.724864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.725641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.726111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.726549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.818909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:00.819535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:00.820589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:00.821116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lazy-loading 'fault' on Instance uuid d6406841-4c7c-4de3-9ae4-d11d6e6d8237 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:04:00.911806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9884fe87dedd42bba0442aca48ebdc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35119286edb94a8fb711a37863321fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:00.926883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8507df0a-e8e5-4f85-94cc-6024d4462b83 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 200 len: 1330 microversion: 2.1 time: 0.223736 Sep 03 21:04:00.929711 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2012/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:00 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 1330 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:01.086685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:01.102969 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a0e6778-86db-4054-abf4-7592b25be0c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1551 microversion: 2.1 time: 1.022773 Sep 03 21:04:01.103763 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1828/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:00 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1551 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:01.132490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:01.133079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:01.152258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.152769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.153248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.153981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.154441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.154875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.466566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:01.467353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:01.479766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.480463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.481642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.482490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.482971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.483409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.659407 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8af93f4a-29ae-43b5-ba1a-0745864afee6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.531345 Sep 03 21:04:01.673155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2013/3841] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:04:01 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/os-interface => generated 285 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:01.753028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:01.758594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:01.766780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.767905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.768604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.770004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:01.770904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:01.771571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:01.998350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:02.010390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c5dd681-0fc1-49ea-bfd7-c609d1743a0c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.553504 Sep 03 21:04:02.011973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1829/3842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:01 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:02.025184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:02.026064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:02.034705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:02.038090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:02.038775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:02.039523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:02.040029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:02.045550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:02.068690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] HTTP exception thrown: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:02.076723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Request method failure captured: Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 HTTP/1.1 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CW-HSLxwhO5TNMLdZsFhIwLDFuGsKRgyDxntc-XsOf57Ts46r-z-pI7r8whP56bvBl02qs6t7wL-9JqMr1rZ2wgJFrh9_A7KNdqEpMu2i2QMfMwdybG_lCfD7HBLzoumNkNTANyGhbL2wf-ewLCdExVHYlXC3j5e221hKmW-95GtA Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_35119286edb94a8fb711a37863321fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/35119286edb94a8fb711a37863321fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9884fe87dedd42bba0442aca48ebdc8d Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd6406841-4c7c-4de3-9ae4-d11d6e6d8237'} Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:02.078706 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Returning 404 to user: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b3c6243-93ac-45ad-9bfa-b6a61fb9e0af tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 404 len: 111 microversion: 2.1 time: 0.067234 Sep 03 21:04:02.083460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1830/3843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:02 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:02.090079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aafbd02f-27f5-4075-8b20-14d6572f8aae tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '.version_select at 0x7fae65e4fdc0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:02.092661 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-543164be-ac84-4bdc-88de-140057550a9c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.373160 Sep 03 21:04:02.097555 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2014/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:01 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:02.148788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aafbd02f-27f5-4075-8b20-14d6572f8aae tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115549263" status: 202 len: 0 microversion: 2.1 time: 0.062558 Sep 03 21:04:02.150712 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1831/3845] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:04:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115549263 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:02.751896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "tag": "e3f1b3d8-1151-493a-8453-ca76aebea545"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:02.770034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:02.770590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:02.771085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:02.793307 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] Creating event network-changed:e3f1b3d8-1151-493a-8453-ca76aebea545 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:02.803160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-25acf043-1cc8-4012-9f80-a1bc5ab28f9d req-4278d522-43b2-4541-b599-29d3452ea369 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055721 Sep 03 21:04:02.804415 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2015/3846] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:03.038967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:03.039917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:03.080363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:03.086226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:03.087528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:03.088871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:03.089671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:03.102252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:03.122820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:03.124560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:03.143023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:03.148002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:03.151205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:03.154292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:03.155280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:03.157787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:03.805620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:03.817092 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3a45f54-e7aa-4b5b-bab9-9c20ac77bd42 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.701473 Sep 03 21:04:03.818393 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2016/3847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:03 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:04.230210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:04.251254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-187f1fcb-2b3a-45b6-85da-06b3ea86aa60 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 1.218691 Sep 03 21:04:04.257276 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1832/3848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:03 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:04.839935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:04.840557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:04.850843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:04.852060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:04.853344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:04.854422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:04.855104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:04.855920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:05.287491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:05.288170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:05.302182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:05.306191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:05.306670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:05.307516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:05.308010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:05.308505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:05.471587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:05.483959 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-502dc2f7-29e3-43f1-b456-6b0d65a80db0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.647890 Sep 03 21:04:05.497484 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2017/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:04 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:05.508137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c32ba7b-42f6-4302-bdbb-df7d317ebc33", "tag": "b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:05.530203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:05.531126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:05.532067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:05.549101 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] Creating event network-changed:b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb for instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 on nch2-master-1 Sep 03 21:04:05.554813 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fd603338-5553-41b9-8a43-42b2aa6c7761 req-77ab1670-5dee-4eb5-ab07-e98db76bf1db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054116 Sep 03 21:04:05.556853 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2018/3850] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:06.221245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:06.241185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74740301-e87f-4ce6-8aed-8f45eb3c2e8f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.954980 Sep 03 21:04:06.267324 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1833/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:05 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:06.525726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:06.527084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:06.548012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.549008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.552985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.555905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.557812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.559102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.687084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:06.687681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:06.701161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:06.702411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:06.705375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.705949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.707185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.709734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.711484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.713000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.737996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] HTTP exception thrown: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Request method failure captured: Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 HTTP/1.1 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CW-HSLxwhO5TNMLdZsFhIwLDFuGsKRgyDxntc-XsOf57Ts46r-z-pI7r8whP56bvBl02qs6t7wL-9JqMr1rZ2wgJFrh9_A7KNdqEpMu2i2QMfMwdybG_lCfD7HBLzoumNkNTANyGhbL2wf-ewLCdExVHYlXC3j5e221hKmW-95GtA Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_35119286edb94a8fb711a37863321fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/35119286edb94a8fb711a37863321fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9884fe87dedd42bba0442aca48ebdc8d Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd6406841-4c7c-4de3-9ae4-d11d6e6d8237'} Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:06.743134 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.749162 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.751667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Returning 404 to user: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:06.753594 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60e536be-7da7-41b8-92c8-c2dd7ccb04dd tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 404 len: 111 microversion: 2.1 time: 0.077587 Sep 03 21:04:06.757368 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1834/3852] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:04:06 2022] DELETE /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:06.765452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:06.766084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] [instance: d6406841-4c7c-4de3-9ae4-d11d6e6d8237] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:06.772520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.773047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.784237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.786606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:06.787463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:06.791807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:06.814113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:06.820383 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] HTTP exception thrown: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Request method failure captured: Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 HTTP/1.1 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8CW-HSLxwhO5TNMLdZsFhIwLDFuGsKRgyDxntc-XsOf57Ts46r-z-pI7r8whP56bvBl02qs6t7wL-9JqMr1rZ2wgJFrh9_A7KNdqEpMu2i2QMfMwdybG_lCfD7HBLzoumNkNTANyGhbL2wf-ewLCdExVHYlXC3j5e221hKmW-95GtA Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_35119286edb94a8fb711a37863321fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/35119286edb94a8fb711a37863321fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/35119286edb94a8fb711a37863321fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 35119286edb94a8fb711a37863321fbe Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1275961717 Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9884fe87dedd42bba0442aca48ebdc8d Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1275961717-project Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd6406841-4c7c-4de3-9ae4-d11d6e6d8237'} Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:06.824125 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. Sep 03 21:04:06.828991 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:06.833460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] Returning 404 to user: Instance d6406841-4c7c-4de3-9ae4-d11d6e6d8237 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:06.835247 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab56aec0-8578-4ed5-9309-0b745d12adc4 tempest-AttachSCSIVolumeTestJSON-1275961717 tempest-AttachSCSIVolumeTestJSON-1275961717-project] 10.222.0.16 "GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237" status: 404 len: 111 microversion: 2.1 time: 0.075362 Sep 03 21:04:06.838788 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1835/3853] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:06 2022] GET /compute/v2.1/servers/d6406841-4c7c-4de3-9ae4-d11d6e6d8237 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:07.113492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:07.125626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-771dc8fc-04a7-4ccf-9928-0fff0dd3318f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.609260 Sep 03 21:04:07.137670 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2019/3854] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:06 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:07.267120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:07.267886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:07.277996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:07.279929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:07.280733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:07.282122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:07.286555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:07.287197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:07.598066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}, {"name": "network-changed", "server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "tag": "6c94b8af-65fa-4bda-bf13-c9e5ae9a2492"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:07.621970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:07.622587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:07.623125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:07.662817 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Creating event network-changed:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:04:07.663995 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] Creating event network-changed:6c94b8af-65fa-4bda-bf13-c9e5ae9a2492 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:07.687705 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-67f24fb0-4bfd-4fa4-9a33-2f5dfa974584 req-0a31212c-fc0a-4dbc-9990-baf88e7cb680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093482 Sep 03 21:04:07.689552 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2020/3855] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:04:07.887724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:07.916141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:07.920596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:07.938039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64670c82-81d2-4bba-ab05-cca4d8ea995b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.675472 Sep 03 21:04:07.964774 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1836/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:07 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:07.966536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:07.969454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:07.971182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:07.974407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:07.980035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:07.980696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:08.053739 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ebd73d9-6d9f-43a5-9c2c-b4c94d328bac tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e/ips" status: 200 len: 146 microversion: 2.1 time: 0.174008 Sep 03 21:04:08.056707 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2021/3857] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:04:07 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e/ips => generated 146 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:04:08.157970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:08.158897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:08.177067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:08.178873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:08.181698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:08.183850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:08.185464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:08.188322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:08.988829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:08.989664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:09.009746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:09.010340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:09.010807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:09.011554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:09.014377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:09.014869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:09.059693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:09.071898 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f6044da-f751-4e52-9798-e0a4c69d970e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.918677 Sep 03 21:04:09.072651 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1837/3858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:08 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:10.111199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:10.111815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:10.139473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:10.139985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:10.140431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:10.141178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:10.141729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:10.142043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:10.385634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:10.394380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0e15928-3c3f-47b0-89e1-4c773249241d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 1.410333 Sep 03 21:04:10.394966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2022/3859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:08 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:10.819106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:10.832321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5354709c-00d7-48aa-87ed-4bfaaf01d181 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.727105 Sep 03 21:04:10.834715 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1838/3860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:10 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:10.959248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:10.960396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:10.974141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:10.975105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:10.976350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:10.978650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:10.980867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:10.981729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.023417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:04:11.184986 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66ddef6f-dae6-40bb-980f-364fe5a87925 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 204 len: 0 microversion: 2.1 time: 0.229604 Sep 03 21:04:11.185600 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2023/3861] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:04:10 2022] DELETE /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:04:11.194461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:11.200137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:11.218542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.219055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.219626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.220354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.220818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.221400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.324700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2139445525", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "f60ab7d8-b63f-4451-af9f-36959d1b4c40"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:11.344782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:11.434657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] validate_networks() for [('f60ab7d8-b63f-4451-af9f-36959d1b4c40', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:04:11.505476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:11.518019 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-588d62ed-7097-4e89-a693-d2d9b63b0730 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1675 microversion: 2.1 time: 0.327761 Sep 03 21:04:11.518996 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2024/3862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:11 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1675 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:11.531020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:11.533244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:11.546458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.550081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.552240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.553194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.560242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.560851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.565918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:11.817709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:11.833304 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-96c99af3-6a22-4327-bf69-ef95a9450f67 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.309461 Sep 03 21:04:11.834320 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2025/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:11 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:11.859566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:11.860441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:11.874593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.875974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.877678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:11.878610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:11.887293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:11.888009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.143771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:12.152454 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c8c99f20-2411-4527-991c-e1532e9cc36b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.297065 Sep 03 21:04:12.156264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2026/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:11 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:12.161093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c32ba7b-42f6-4302-bdbb-df7d317ebc33", "name": "network-vif-plugged", "status": "completed", "tag": "b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:12.194833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.195680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.196803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.225498 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] Creating event network-vif-plugged:b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb for instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 on nch2-master-1 Sep 03 21:04:12.242625 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-de167cee-1602-4c95-b02f-9df1be9a9aa7 req-b1b6e3f0-f34c-4433-9e1f-7b773ecaf743 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085044 Sep 03 21:04:12.243948 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2027/3865] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:12.543925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:12.544825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:12.561568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.562365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.562913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.565400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.567133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.567703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.849581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:12.867994 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d8161412-6029-47d9-88c3-fc82b98272c1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1675 microversion: 2.1 time: 0.329167 Sep 03 21:04:12.882368 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2028/3866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:12 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:12.893351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:12.896059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:12.906502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.907779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.908402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.909364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.910041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.910643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.970890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:04:12.972546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:04:12.973662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:04:12.974501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:04:12.975615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:04:12.993848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.994812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:12.995731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:12.998556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:12.999275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:13.000606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:13.054191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Getting quotas for project 484597f6a0554dd2af819e55e8e7b7d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:13.061465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Getting quotas for user c897f757440d479790743e6a8c1dfd91 and project 484597f6a0554dd2af819e55e8e7b7d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:13.084773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:04:13.089729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:04:13.179832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bff36792-ea5e-4f5f-a071-522c79278d64 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.146414 Sep 03 21:04:13.186850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1839/3867] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:04:13.205841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:13.206802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:13.234174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:13.234796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:13.235320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:13.236119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:13.239838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:13.240371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:13.932217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:13.946471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4479ed0d-280d-4d33-a729-78a4c1b05e23 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 1.062304 Sep 03 21:04:13.948034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2029/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:12 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:13.960141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:13.964336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:14.020879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:14.044593 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cd1b3df-a7d5-4b3a-81d5-4f4b043658cd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1313 microversion: 2.1 time: 0.855145 Sep 03 21:04:14.051966 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1840/3869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:13 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1313 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:14.084922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:14.089585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:14.124632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:14.126007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:14.126650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:14.128765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:14.129585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:14.130429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:14.312213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:14.322929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:14.340439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:14.345192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98414df2-b692-4991-8530-780051499cd3 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1259 microversion: 2.21 time: 0.391763 Sep 03 21:04:14.363460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2030/3870] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:13 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1259 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:14.770660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:14.788733 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63026238-f4d6-48f5-a5c4-b595ed7f0d28 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1675 microversion: 2.1 time: 0.729365 Sep 03 21:04:14.792800 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1841/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:14 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1675 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:14.974310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:14.975988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:14.985645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:14.987173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:14.987870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:14.989269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:14.992327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.003773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.077975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:15.078868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:15.090636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.091161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.091620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.092353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.092828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.093300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.452377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:15.465242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01150b5f-aa36-4d51-bf31-95812352f460 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1500 microversion: 2.1 time: 0.393526 Sep 03 21:04:15.468310 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1842/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:15 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:15.503054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:15.503933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:15.519240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.519828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.527480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.528561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.529342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.529982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.841605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:15.842779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:15.866648 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f08fecf8-3148-4eb7-8c5c-02499f3dda0d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.897354 Sep 03 21:04:15.867263 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2031/3873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:14 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:15.876137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:15.879559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:15.882491 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c5357ae-b177-477a-a52a-e3c5f4c3fab9 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1319 microversion: 2.21 time: 0.412084 Sep 03 21:04:15.896352 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1843/3874] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:15 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:15.910815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:15.911756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:15.916127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:15.917603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:15.936139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.938642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.940045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.941116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.942151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.942953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.943695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.944573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.945693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:15.946840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:15.950480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:15.951644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:16.022010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'flavor' on Instance uuid 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:04:16.232695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:16.247917 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56f9c636-5d3b-48b5-b100-3e65d347cb98 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 200 len: 1607 microversion: 2.1 time: 0.348653 Sep 03 21:04:16.256174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1844/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:15 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 1607 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:16.382839 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-889653a6-5082-494a-82d6-588a1e00b871 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33/action" status: 202 len: 0 microversion: 2.1 time: 0.501482 Sep 03 21:04:16.386169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2032/3876] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:04:15 2022] POST /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:16.394616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:16.395244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:16.409946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:16.410864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:16.412045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:16.413090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:16.433584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:16.434552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:16.988280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d12188-0969-4024-9079-caf96bf2740e", "name": "network-vif-deleted", "tag": "785913b1-b915-446e-93fd-ff6d31d72717"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:17.036166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.037497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.039294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.095651 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] Creating event network-vif-deleted:785913b1-b915-446e-93fd-ff6d31d72717 for instance 68d12188-0969-4024-9079-caf96bf2740e on nch1-master-1 Sep 03 21:04:17.111954 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-36bec971-f2a6-4159-b398-1fdf317a0a23 req-504748db-2f0f-4d62-a6cf-1d0011ed8642 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356580 Sep 03 21:04:17.117451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2033/3877] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:17.138822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:17.139491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:17.159767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.160344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.173341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.182431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.183324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.184228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.687785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:17.704609 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cc62728-3532-4eb5-9cde-689fd17cbc1e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 1.313829 Sep 03 21:04:17.719950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1845/3878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:16 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:17.719950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:17.722944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:17.734813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.735326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.737696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:17.740180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.740986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.742177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.744254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.750610 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-982022ca-808d-4f4a-bbb7-ab4b88e5cb27 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.629239 Sep 03 21:04:17.765010 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2034/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:17 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:17.766091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:17.766863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:17.785569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.787058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.788947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.792162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:17.794101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:17.796031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:17.837661 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e HTTP/1.1 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '68d12188-0969-4024-9079-caf96bf2740e'} Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:17.839480 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:04:17.844795 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:17.851516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:17.851516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e2a9495-69a1-4010-b27d-1c32ddf85c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 404 len: 111 microversion: 2.1 time: 0.094475 Sep 03 21:04:17.855588 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2035/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:17 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:17.866714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-65c4f2cb-440d-4010-afdc-5f9b68402069 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '.version_select at 0x7fae66908280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:17.900204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-65c4f2cb-440d-4010-afdc-5f9b68402069 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899432498" status: 202 len: 0 microversion: 2.1 time: 0.041976 Sep 03 21:04:17.902071 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2036/3881] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:04:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899432498 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:04:18.275174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:18.287231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:18.290263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:18.293419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d00f038-00d1-459d-b19f-c807792b8bce tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.583383 Sep 03 21:04:18.294755 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1846/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:17 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:18.735587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:18.740417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:18.756233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:18.760831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:18.762519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:18.766489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:18.767441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:18.768128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:18.780034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:18.780664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:18.796601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:18.797445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:18.798063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:18.798970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:18.799609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:18.800210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:18.832825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:19.160073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:19.168672 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60c89ad1-3cf6-4113-be79-2804729af86b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.392696 Sep 03 21:04:19.185391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1847/3883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:18 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:19.321608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:19.322754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:19.336092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:19.339503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:19.340028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:19.340793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:19.341786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:19.342224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:19.379271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:19.393693 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d4f09c4-3382-4933-81a0-b370dcb4beda tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.668702 Sep 03 21:04:19.394317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2037/3884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:18 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:19.626772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:19.647538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:19.655967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:19.659076 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-717df69d-0767-437a-8dbe-d601de02bfd7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.343687 Sep 03 21:04:19.699294 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1848/3885] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:19 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:19.833206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6115ed3f-d577-48ba-8408-20ba418e01ce", "tag": "bc8d2b8b-313b-4390-8c0d-7cbc34f96637"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:19.863324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:19.863833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:19.864289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:19.896825 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] Creating event network-changed:bc8d2b8b-313b-4390-8c0d-7cbc34f96637 for instance 6115ed3f-d577-48ba-8408-20ba418e01ce on nch1-master-1 Sep 03 21:04:19.920471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6419cf24-f73c-406f-b5ec-98df54c339e8 req-f943bf87-0f1d-4417-a388-37f33325cc72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091115 Sep 03 21:04:19.921189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2038/3886] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:19.963566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "name": "network-vif-plugged", "status": "completed", "tag": "e3f1b3d8-1151-493a-8453-ca76aebea545"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:20.005591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.006023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.006462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.058707 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] Creating event network-vif-plugged:e3f1b3d8-1151-493a-8453-ca76aebea545 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:20.078637 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a3377b7a-79b6-4a8b-a51b-5cf62be3efed req-d9ea7b03-5f99-461b-8aa2-9d71362ec793 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120541 Sep 03 21:04:20.082669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1849/3887] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:20.194219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:20.195346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:20.203872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.204718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.205289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.206274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.206965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.207645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.419472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:20.421597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:20.433588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.434084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.434527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.435241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.435698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.436134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.677541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:20.693257 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80da79da-fe2c-4b91-9363-dc8d5e9f9b80 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.277946 Sep 03 21:04:20.706455 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1850/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:20 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:20.707181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:20.717889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-50a9b439-089d-4f89-a010-45c34f059cd6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Action: 'create', calling method: .version_select at 0x7fae6b8930d0>, body: {"keypair": {"name": "tempest-keypair-681708298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrN4fPCBWKHKowJ09oHWlCh1OoZ5rPyyh2RxzKRlpGbBOibtFa5oDI3BTH+Z7+wSe5jlNW7F/KNKBUHbpEJDaoI348/MmvwpH4unAbhrSpsxNmVd5r3i7SD2IEYjk6Nqg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:20.727803 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3fe014d-6203-4e49-8972-7b30b37d73b1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.539500 Sep 03 21:04:20.730326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2039/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:20 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:20.736678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:20.737327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:20.749781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.750647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.751396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.752370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:20.753103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:20.754062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:20.755532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-50a9b439-089d-4f89-a010-45c34f059cd6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:20.762572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-50a9b439-089d-4f89-a010-45c34f059cd6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for user 1b2dd96d938b41d4ba40007aa072288b and project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:20.804126 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-50a9b439-089d-4f89-a010-45c34f059cd6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090200 Sep 03 21:04:20.804876 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1851/3890] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:21.087894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:21.118487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:21.120394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:21.122567 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2537d4b8-7f3b-4ec1-8d73-3c60d6fbc904 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.390304 Sep 03 21:04:21.148607 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2040/3891] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:20 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:21.719762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:21.745633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:21.751625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:21.752264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:21.763337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:21.763845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:21.764300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:21.765061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:21.765531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:21.765970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:21.767082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:21.768625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:21.769852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:21.771154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:21.773370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:21.774584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:22.051734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:22.063117 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ebceb67-1011-459d-8ae9-583937b351ae tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.347214 Sep 03 21:04:22.080068 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1852/3892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:21 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:22.100292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "name": "network-vif-plugged", "status": "completed", "tag": "6c94b8af-65fa-4bda-bf13-c9e5ae9a2492"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:22.110188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:22.110665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:22.111106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:22.124993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] Creating event network-vif-plugged:6c94b8af-65fa-4bda-bf13-c9e5ae9a2492 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:22.138195 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-aa0baed8-851e-4c8f-93d9-19d8f5377001 req-740a419c-b770-4536-bea3-bbc2e0e1959b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041270 Sep 03 21:04:22.138751 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1853/3893] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:22.155086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:22.155862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:22.163234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:22.163805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:22.164364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:22.165391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:22.166025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:22.166629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:22.219652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:22.228880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a718442f-fe41-4222-b272-c1633c7dbc8e tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.481269 Sep 03 21:04:22.230770 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2041/3894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:21 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:22.462900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:22.473199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:22.475151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:22.476554 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c2e0abc-cc7d-4808-befe-c572016dc6af tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.326399 Sep 03 21:04:22.492983 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1854/3895] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:22 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:04:22.729409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-853818759", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5780802-a1fc-4924-b8ce-277d6139e7c9"}], "security_groups": [{"name": "tempest-securitygroup--94613607"}], "key_name": "tempest-keypair-681708298", "user_data": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:22.740594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:22.918052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] validate_networks() for [('c5780802-a1fc-4924-b8ce-277d6139e7c9', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:04:23.104320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:23.105841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:23.114241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:23.116493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.117665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.118420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:23.119413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.120118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.120784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:23.457488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:23.469184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a08b4f8-b126-46bf-9924-e72ad87c7cb9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.369434 Sep 03 21:04:23.486050 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1855/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:23 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:23.487574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:23.491253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:23.501584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.502117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.510619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:23.511715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.512202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.512643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:23.928753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:23.941663 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0616f7a2-8e26-4c6b-b583-08697931369a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1333 microversion: 2.1 time: 0.464575 Sep 03 21:04:23.945477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1856/3897] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:23 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1333 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:23.956774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:23.957738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:23.968616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.970542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.971668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:23.973532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:23.974104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:23.974887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.032861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:04:24.034032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:04:24.034715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:04:24.035851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:04:24.036452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:04:24.059284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.059791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.060242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.061200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.061671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.062156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.086097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:24.092442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Getting quotas for user 1b2dd96d938b41d4ba40007aa072288b and project a5a5c2699a4b42f5a60fd808e824296b. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:24.108987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:04:24.112292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:04:24.188166 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4b74e7d-ae63-4429-b5a1-7287648b8c96 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.463898 Sep 03 21:04:24.196888 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2042/3898] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:04:22 2022] POST /compute/v2.1/servers => generated 400 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:04:24.202691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3e44bba-d187-4393-9c33-9533f7efaa51 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:24.203630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b3e44bba-d187-4393-9c33-9533f7efaa51 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:24.215521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:24.231304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:24.236740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:24.240011 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-35559c5b-d1c2-4fe9-b876-5eea67bb8a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.290300 Sep 03 21:04:24.264046 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1857/3899] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:23 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:24.357101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b3e44bba-d187-4393-9c33-9533f7efaa51 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:24.375990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3e44bba-d187-4393-9c33-9533f7efaa51 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1236 microversion: 2.1 time: 0.177342 Sep 03 21:04:24.380655 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2043/3900] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:24 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:24.498317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:24.498768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:24.516052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.516775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.517504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.518434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.518915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.519498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.728481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:24.739670 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d6c9b822-0674-4a13-9f56-3a943f319bd1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.245433 Sep 03 21:04:24.741464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1858/3901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:24 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:24.971736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:24.973339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:24.993895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.994402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.994844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:24.995562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:24.996025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:24.996454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.283029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.284348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.292636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.293464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.294075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.295002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.295837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.296446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.327960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:25.339567 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-87b0b4b8-4920-4829-aa35-e82e9e570274 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1669 microversion: 2.1 time: 0.372309 Sep 03 21:04:25.340340 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2044/3902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:24 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1669 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:25.386571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.388098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.395199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.396507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.397175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.398070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.398698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.402298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.458395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0803acfc-86d5-49a8-9126-88fd9eb71fa0 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15/ips" status: 200 len: 180 microversion: 2.1 time: 0.076378 Sep 03 21:04:25.468557 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2045/3903] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:04:25 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15/ips => generated 180 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:25.474576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.475440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.490005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.491076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.497102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.498155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.498934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.499663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.563853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:25.653368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:25.663839 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f9d73bd-7951-4765-a00f-d9dacdea9486 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1288 microversion: 2.1 time: 0.193875 Sep 03 21:04:25.664957 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2046/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:25 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1288 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:25.683583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.684141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.698567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.699515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.700718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.701899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.702933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.703472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.740311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:04:25.787758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:25.807283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:25.810647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:25.813044 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89eeff97-c378-4355-9f1e-97fe8d2498c7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.545964 Sep 03 21:04:25.814044 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1859/3905] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:25 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:04:25.819289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.820318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.827051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.827903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.828553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.829511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.853749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.854557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.918812 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5c43187b-9eda-4b99-a6e1-f1421f05e313 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 204 len: 0 microversion: 2.1 time: 0.239685 Sep 03 21:04:25.920307 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2047/3906] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:04:25 2022] DELETE /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:04:25.936452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:25.937609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:25.952264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.953446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.954247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:25.956033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:25.957716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:25.958500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:26.215363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:26.226013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6ee08ba3-0c0e-49f0-9554-08c96ddf3382 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.410295 Sep 03 21:04:26.232229 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1860/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:25 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:26.436758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:26.454226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-820ecec5-49e0-4b71-80b2-9578937df82f tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1675 microversion: 2.1 time: 0.523892 Sep 03 21:04:26.455955 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2048/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:25 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1675 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:26.689594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:26.690783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:26.703384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:26.703891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:26.704347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:26.705115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:26.705775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:26.706382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:26.844168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:26.844791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:26.852181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:26.852721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:26.853204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:26.853929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:26.854397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:26.854834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:26.864796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:26.880574 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fcb5521b-1809-4520-a995-7542bfd3ad15 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1294 microversion: 2.1 time: 0.194744 Sep 03 21:04:26.881666 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1861/3909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:26 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:27.099092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:27.109223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:27.111156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:27.112587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a486ea4e-593e-4b5e-bff5-ec96ac65fb01 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.272994 Sep 03 21:04:27.113437 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2049/3910] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:26 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:04:27.254677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:27.255833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:27.269477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.269983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.270427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.271144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.271602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.272031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.480336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:27.481645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:27.498390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.501566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.502151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.503034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.503920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.504170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.725850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:27.735933 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d54476d0-ee08-4b3c-aaee-70c24c3d56a8 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1675 microversion: 2.1 time: 0.260579 Sep 03 21:04:27.736533 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2050/3911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:27 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:27.776957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6115ed3f-d577-48ba-8408-20ba418e01ce", "name": "network-vif-plugged", "status": "completed", "tag": "bc8d2b8b-313b-4390-8c0d-7cbc34f96637"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:27.804682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.805739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.806183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.829514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] Creating event network-vif-plugged:bc8d2b8b-313b-4390-8c0d-7cbc34f96637 for instance 6115ed3f-d577-48ba-8408-20ba418e01ce on nch1-master-1 Sep 03 21:04:27.841246 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-27eaae5d-4720-497e-8679-bb4c5069d3a7 req-52d00549-eea0-4689-abce-23397f86aa91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069616 Sep 03 21:04:27.842511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2051/3912] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:04:27.901238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:27.906051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:27.907111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:27.910570 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3509e12-a7b8-48a7-94d3-a8ca967df1ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.664494 Sep 03 21:04:27.922479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1862/3913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:27 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:27.933017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.935147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.935635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:27.936559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:27.937045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:27.937666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.140478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:28.140775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:28.148257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.149775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.150806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.151725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.152363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.153037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.362118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:28.372266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab82bf05-34f6-4992-b8d4-b8e26a31e6e0 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.471684 Sep 03 21:04:28.378673 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2052/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:27 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:28.524851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:28.533745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:28.535205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:28.536571 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d400ae39-e0d1-4a0a-8914-74fc9327db90 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.400490 Sep 03 21:04:28.537183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1863/3915] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:28 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:04:28.771186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:28.775955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:28.786951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "name": "network-vif-deleted", "tag": "6c94b8af-65fa-4bda-bf13-c9e5ae9a2492"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:28.800594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.801572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.802035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.802449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.802742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.803272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.812628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.813148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.813674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.818756 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] Creating event network-vif-deleted:6c94b8af-65fa-4bda-bf13-c9e5ae9a2492 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:28.842947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fbfddc64-b09a-4bac-989a-644726bd25a7 req-611c1f2b-3246-4225-a345-6413df0ad1b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060071 Sep 03 21:04:28.843864 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1864/3916] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:28.944432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:28.946474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:28.958055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.958605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.959844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:28.960557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:28.961059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:28.962049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:29.280427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.289450 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d2c507e-d9f4-4e4d-9647-f727ff2d662e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.349271 Sep 03 21:04:29.290127 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1865/3917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:28 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:29.346931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.356864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d34cf6f-cfe6-48ea-a2b9-d84b7cd8764b tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1654 microversion: 2.1 time: 0.598696 Sep 03 21:04:29.357481 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2053/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:28 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1654 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:29.400929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:29.401630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:29.408077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:29.408814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:29.409500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:29.410463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:29.411101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:29.411846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:29.565359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:29.566455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:29.574879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:29.575490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:29.576081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:29.576958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:29.577545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:29.578174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:29.748924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.759133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2349b709-1b78-4831-8dd6-3538dda4bed7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.362692 Sep 03 21:04:29.761532 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1866/3919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:29 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:29.786782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.797218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.799228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:29.800576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a19094dd-d3be-4b93-a3b3-a706e161ca28 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1359 microversion: 2.21 time: 0.242346 Sep 03 21:04:29.802110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2054/3920] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:29 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:30.318002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:30.318636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:30.327905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.328818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.329579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.330567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.331232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.331925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.337279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:30.381594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:30.382565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:30.394266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.395187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.396093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.397108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.397804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.398466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.478822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77edcf09f5f84e51a4fb08dbaf763a67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e12c7419f641b4a7e56274a34826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:30.489133 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cce8a76-6a72-4f9e-98ad-5db2431bfb8a tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 200 len: 1297 microversion: 2.1 time: 0.112304 Sep 03 21:04:30.489908 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2055/3921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:30 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:30.741859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3ac4adf1-b397-470d-8770-d9d97a6170ff tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae67229a60>, body: {"keypair": {"name": "tempest-keypair-2061668215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFk0Jt1g34kqkaWF24JZfU2pmvoNVw2KDTMKVTEB6PJ3oFpf5Imaa7DGsTuoyPxuGJY83G3M5jeg8B8C3AlO6p9rUikVAJWdLsQmmEB3Mn1BT2xtS5S5ZS81u4+EdtYvQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:30.759614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3ac4adf1-b397-470d-8770-d9d97a6170ff tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:30.766428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-3ac4adf1-b397-470d-8770-d9d97a6170ff tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:30.773317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:30.821223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3ac4adf1-b397-470d-8770-d9d97a6170ff tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.262064 Sep 03 21:04:30.821906 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2056/3922] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:30.830725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:30.831370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:30.838364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.838865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.839314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.840041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.840506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.840974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.860994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:30.872702 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11a6bd1a-a39e-4c5c-b0ae-123c2ab15777 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.560925 Sep 03 21:04:30.877296 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1867/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:30 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:30.884611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:30.885553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:30.894456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.895349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.896050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:30.897051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:30.898369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:30.899661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.039623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.049815 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce27a316-8a55-47a6-87f9-c60cd5c47135 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.226657 Sep 03 21:04:31.050676 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2057/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:30 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:31.056006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82170fb4-df0a-44ba-a47a-e7c14a5c0ae6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae6721fee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.069240 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82170fb4-df0a-44ba-a47a-e7c14a5c0ae6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-2061668215" status: 200 len: 498 microversion: 2.1 time: 0.016847 Sep 03 21:04:31.070086 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2058/3925] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:04:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2061668215 => generated 498 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.075862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99b545d-35ed-4719-85ed-8f0476fb7c94", "tag": "0a8504b2-d5ec-4da6-bdc5-349e04195d77"}, {"server_uuid": "c9b58726-bb43-4935-8705-a4c674aaee15", "name": "network-vif-deleted", "tag": "e3f1b3d8-1151-493a-8453-ca76aebea545"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.088854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.089376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.089819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.105951 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Creating event network-changed:0a8504b2-d5ec-4da6-bdc5-349e04195d77 for instance c99b545d-35ed-4719-85ed-8f0476fb7c94 on nch1-master-1 Sep 03 21:04:31.106472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] Creating event network-vif-deleted:e3f1b3d8-1151-493a-8453-ca76aebea545 for instance c9b58726-bb43-4935-8705-a4c674aaee15 on nch2-master-1 Sep 03 21:04:31.116363 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2e4d026b-9dff-4829-9045-fcac0dd1b136 req-fcd6fa84-291c-4b79-b2fc-e896242ef5af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044125 Sep 03 21:04:31.117084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2059/3926] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.123835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc53c3da-697f-43a7-a4c1-6ce35b889f8f tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae66896700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.145284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc53c3da-697f-43a7-a4c1-6ce35b889f8f tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061668215" status: 202 len: 0 microversion: 2.1 time: 0.026586 Sep 03 21:04:31.146011 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2060/3927] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061668215 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:31.159115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb8ed512-1980-4cea-be48-3ce2d77fdbe6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae6718f040>, body: {"keypair": {"name": "tempest-keypair-11920951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW46YLVE7f5zzZ/TIB+KM1nIgqwfLrbH2JlYcC8guOMQhzdgbdTK4E1RtXxXGDTo/p0UxRvvfpFgh4zYeIT0rzntbt/6DRVPmscxCILYhN+htaQfWMoRxm8iMYmQLa5qg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.175522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb8ed512-1980-4cea-be48-3ce2d77fdbe6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:31.181104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bb8ed512-1980-4cea-be48-3ce2d77fdbe6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:31.194364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.205309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.206340 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb8ed512-1980-4cea-be48-3ce2d77fdbe6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.051277 Sep 03 21:04:31.207405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.207587 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2061/3928] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.208591 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab7b02e6-002b-424d-b9a6-ca69158b9a21 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1552 microversion: 2.21 time: 0.329966 Sep 03 21:04:31.209188 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1868/3929] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:30 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1552 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:31.219761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a8c90d5-8d5b-4646-8972-1f270bdb1f31 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae6698a700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.234680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.235220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:31.240271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a8c90d5-8d5b-4646-8972-1f270bdb1f31 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-11920951" status: 202 len: 0 microversion: 2.1 time: 0.024979 Sep 03 21:04:31.241426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.241919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.243085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.244886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.245786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.246223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.247023 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2062/3930] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-11920951 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:04:31.263933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-095c33ec-a93b-4e69-ab08-9c5dfba22435 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae67034700>, body: {"keypair": {"name": "tempest-keypair-1568788096", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.284636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-095c33ec-a93b-4e69-ab08-9c5dfba22435 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:31.296467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-095c33ec-a93b-4e69-ab08-9c5dfba22435 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:31.309557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:04:31.319792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:31.326714 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-095c33ec-a93b-4e69-ab08-9c5dfba22435 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.072013 Sep 03 21:04:31.338546 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2063/3931] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.355051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52e9f784-2fa6-4ef8-aa15-aa3d61b02cf6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae66896700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.392776 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52e9f784-2fa6-4ef8-aa15-aa3d61b02cf6 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568788096" status: 202 len: 0 microversion: 2.1 time: 0.048885 Sep 03 21:04:31.393942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2064/3932] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568788096 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:31.411499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5c47230-d7c6-4312-a99e-c1ca60449af7 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae6718f700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-242965766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpE4YZnrHxaOb62OLhhOTtmGN6p0ZQpgt2HmrSbWd7rpOB0Y+YDzAyBgBb63OnwHzlmPgOyxfiQtb1rgzkz5ykmqwlgVkaE0i0/2XjuJCGK1FweGo1C5eiISmPIjdzCqw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.429687 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fcf1bb73-3546-4a96-8e69-7711b475f8ca tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 204 len: 0 microversion: 2.21 time: 0.199043 Sep 03 21:04:31.430730 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1869/3933] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:04:31.436385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5c47230-d7c6-4312-a99e-c1ca60449af7 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:31.441019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.442318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:31.443114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c5c47230-d7c6-4312-a99e-c1ca60449af7 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:31.448872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.449525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.450127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.451293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.453319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.453844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.481292 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5c47230-d7c6-4312-a99e-c1ca60449af7 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.073958 Sep 03 21:04:31.482206 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2065/3934] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.501272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7842dfba-e853-4c01-a910-980ee3f62446 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae671d2310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1745972324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMijNdJ1MacNl7wYZJJ3Gn21uXzmFUzDMp5FjzGFO/dRho1qedRgiWW6UYW23L4vUc9R7qZmsucpFUF1cGmJ3CiLJPmbbrY9zJnzLD/7zLNPAc2UhcOUeNPz6Z3n2GrTOA=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.524303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7842dfba-e853-4c01-a910-980ee3f62446 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:31.529921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7842dfba-e853-4c01-a910-980ee3f62446 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:31.561340 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7842dfba-e853-4c01-a910-980ee3f62446 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063190 Sep 03 21:04:31.569858 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2066/3935] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.569858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.569858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:31.574049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.574552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.575004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.575726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.576191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.576626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.591798 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 HTTP/1.1 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c9b58726-bb43-4935-8705-a4c674aaee15'} Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:31.593811 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c685119e-83a6-4bab-b5b0-e782ea9b158c tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 404 len: 111 microversion: 2.1 time: 0.032264 Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2067/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:31 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:31.605715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-727792ca-74ab-4e39-ab1d-fafcb3735f67 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Action: 'create', calling method: .version_select at 0x7fae66a5e700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1100371499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ6cBW3hGKKzx6jhCRFk4QK9Iq+vO1JLEo+e2TbSzFQicx01B4P1FCzaexjEJQo8Cb2YCqnqoP+87sjpyIN9JwEBak/AxTA7syhs1S8M/gXm3kZVWhhLSdwXOPLGvCx3A=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:31.625613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-727792ca-74ab-4e39-ab1d-fafcb3735f67 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:31.632088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-727792ca-74ab-4e39-ab1d-fafcb3735f67 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Getting quotas for user d849e4bde6d747ccba99fd5ac15edd17 and project 536376886c2c4f3080f06afffcbb9563. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:31.667923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-727792ca-74ab-4e39-ab1d-fafcb3735f67 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.070616 Sep 03 21:04:31.668732 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2068/3937] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:31.683185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e90bc5b-3625-4bab-b77a-b12f3d5adaa8 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae66907670>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.683391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.687972 ncdv-master-1 devstack@n-api.service[140520]: WARNING oslo_db.sqlalchemy.utils [None req-0e90bc5b-3625-4bab-b77a-b12f3d5adaa8 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 21:04:31.692548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.694131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:31.695292 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e90bc5b-3625-4bab-b77a-b12f3d5adaa8 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.016227 Sep 03 21:04:31.696693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e295b02-3f04-4e5a-bffa-2739fe752afb tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1558 microversion: 2.21 time: 0.261075 Sep 03 21:04:31.697758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2069/3938] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:04:31 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:31.698995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1870/3939] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:31 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1558 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:04:31.717246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-37cec8e3-1b44-40c9-83a1-a2bb536d396e tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae66a61310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.740848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-37cec8e3-1b44-40c9-83a1-a2bb536d396e tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1100371499" status: 202 len: 0 microversion: 2.1 time: 0.036182 Sep 03 21:04:31.741783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2070/3940] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1100371499 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:31.750787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eaf3631b-0072-4db7-8d98-e34e88fba296 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae670261f0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.779020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eaf3631b-0072-4db7-8d98-e34e88fba296 tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1745972324" status: 202 len: 0 microversion: 2.1 time: 0.032879 Sep 03 21:04:31.780030 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1871/3941] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1745972324 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:04:31.789881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b53e68d6-f8d3-4ad9-b1f6-4c571b6f644b tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] Calling method '.version_select at 0x7fae6718fdc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.813298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b53e68d6-f8d3-4ad9-b1f6-4c571b6f644b tempest-KeyPairsV2TestJSON-1956581210 tempest-KeyPairsV2TestJSON-1956581210-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-242965766" status: 202 len: 0 microversion: 2.1 time: 0.029039 Sep 03 21:04:31.814693 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2071/3942] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-242965766 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:04:31.908351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:31.913348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:31.928115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.929267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.937387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:31.938459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:31.939262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:31.939996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:32.074180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:32.075058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:32.087518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:32.088033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:32.091415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:32.093558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:32.096316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:32.097066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:32.203344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:32.226659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f0390ab-b639-479c-afb6-344221cce122 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.327731 Sep 03 21:04:32.228474 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1872/3943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:31 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:32.528116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:32.547975 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4368428f-8371-4fa1-8221-ef61a3820fb6 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.479462 Sep 03 21:04:32.549939 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2072/3944] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:32 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:32.726212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:32.728194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:32.730852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:32.740147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:32.740643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:32.741136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:32.741865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:32.742332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:32.743352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:32.944796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:32.954785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:32.957263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:32.959416 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0ff90022-2094-4a2d-b056-1a5eb1eee9d1 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1558 microversion: 2.21 time: 0.237817 Sep 03 21:04:32.960400 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1873/3945] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:32 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:33.254179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:33.256269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:33.298848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:33.300525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:33.301909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:33.305697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:33.309332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:33.310064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:33.553074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:33.567048 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b0a30f1-f8ce-4cdd-ad81-7ec754bba0ca tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.319736 Sep 03 21:04:33.579679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:33.579679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:33.581576 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2073/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:33 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:33.586854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:33.587472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:33.588049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:33.588873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:33.590334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:33.591922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:33.970799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:33.980326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5580c44-d261-4592-9e44-4db8b6d0b5d9 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.412152 Sep 03 21:04:33.994260 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1874/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:33 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:34.006564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:34.007615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:34.015980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.016953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.017561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.018476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.019099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.019697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.077429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:34.144256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Calling method '.version_select at 0x7fae67034040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:34.160336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.160838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.161328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.162340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.162844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.163285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.186266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cca3d10-1afb-4603-8639-5b12b70ae6f9 tempest-AbsoluteLimitsTestJSON-1466330584 tempest-AbsoluteLimitsTestJSON-1466330584-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.249334 Sep 03 21:04:34.187091 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2074/3948] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 3 21:04:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:34.505688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:34.519002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:34.544157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:34.546325 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-259998bd-fc2c-4612-855f-932343bde08f tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1558 microversion: 2.21 time: 0.546575 Sep 03 21:04:34.567464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1875/3949] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:33 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1558 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:34.596324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:34.597328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:34.607320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.608283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.608946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.609997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:34.610693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:34.611305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:34.830054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:34.845452 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-847330d2-a4c2-43f8-b296-aa8d9378a3e9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.254448 Sep 03 21:04:34.846659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2075/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:34 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:35.009248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:35.011019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:35.019706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.020483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.020949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.022484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.023130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.024265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.603490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:35.604607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:35.628102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.628966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.629666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.630707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.631429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.632113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.739023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:35.752122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:35.766316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c897f757440d479790743e6a8c1dfd91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484597f6a0554dd2af819e55e8e7b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:35.769931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-174e6e56-b256-48f2-bbb1-692789789600 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 200 len: 1516 microversion: 2.21 time: 0.184909 Sep 03 21:04:35.772007 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2076/3951] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:35 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:35.783920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6115ed3f-d577-48ba-8408-20ba418e01ce", "name": "network-vif-deleted", "tag": "bc8d2b8b-313b-4390-8c0d-7cbc34f96637"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:35.809258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.809660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.812197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.822735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:35.843708 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] Creating event network-vif-deleted:bc8d2b8b-313b-4390-8c0d-7cbc34f96637 for instance 6115ed3f-d577-48ba-8408-20ba418e01ce on nch1-master-1 Sep 03 21:04:35.849880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-be186992-aea0-4e97-b9f1-92b4b89d727e req-30244771-f039-4ee0-a7e4-08a223e4478e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074581 Sep 03 21:04:35.854569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2077/3952] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:35.856505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:35.872643 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f1fbcc3-d61b-47b9-a8fd-2ad97eef4bf1 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.870192 Sep 03 21:04:35.881585 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1876/3953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:35 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:35.881585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:35.881585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:35.894323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.895332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.895997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:35.896814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:35.898049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:35.899154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.089898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99b545d-35ed-4719-85ed-8f0476fb7c94", "name": "network-vif-plugged", "status": "completed", "tag": "0a8504b2-d5ec-4da6-bdc5-349e04195d77"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:36.104335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.105111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.105875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.127421 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] Creating event network-vif-plugged:0a8504b2-d5ec-4da6-bdc5-349e04195d77 for instance c99b545d-35ed-4719-85ed-8f0476fb7c94 on nch1-master-1 Sep 03 21:04:36.135109 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-92abb0e5-5018-4f30-b5a0-0a45cdf8c3bc req-10f04ec3-a7d9-4bca-8a82-421b8955f1c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278821 Sep 03 21:04:36.137081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2078/3954] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:36.215055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:36.228339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5aff1c30-9645-4681-8056-702253b00dc7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.353183 Sep 03 21:04:36.229261 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1877/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:35 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:36.239224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.239972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.247434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.248176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.248671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.249433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.249898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.250359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.267338 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 HTTP/1.1 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c9b58726-bb43-4935-8705-a4c674aaee15'} Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:36.269038 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2c3720c7-d65c-486a-883d-587efe0d4ec3 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 404 len: 111 microversion: 2.1 time: 0.043345 Sep 03 21:04:36.277849 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2079/3956] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:04:36 2022] DELETE /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:36.281282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.281911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: c9b58726-bb43-4935-8705-a4c674aaee15] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.288292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.288827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.289595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.290332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.292046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.292591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.308085 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 HTTP/1.1 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c9b58726-bb43-4935-8705-a4c674aaee15'} Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.310076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance c9b58726-bb43-4935-8705-a4c674aaee15 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:36.317644 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3348816f-e15b-49e6-87a2-4a682468900d tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15" status: 404 len: 111 microversion: 2.1 time: 0.035424 Sep 03 21:04:36.321428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.322035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.325119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1878/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:36 2022] GET /compute/v2.1/servers/c9b58726-bb43-4935-8705-a4c674aaee15 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:36.328317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.328858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.329444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.330462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.330934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.331378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.350273 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff HTTP/1.1 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3f347941-74ba-4e12-8749-b782c09e62ff'} Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:36.352340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:36.357952 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95e4cbdd-366b-40d5-85de-4abc5fb540e1 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 404 len: 111 microversion: 2.1 time: 0.037301 Sep 03 21:04:36.362904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.363538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] [instance: 3f347941-74ba-4e12-8749-b782c09e62ff] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.368940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2080/3958] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:04:36 2022] DELETE /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:36.370301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.371475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.371937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.372671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.373188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.373665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.402208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] HTTP exception thrown: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Request method failure captured: Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff HTTP/1.1 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8EAWnnTkjg-DbU7c_2GilXWofUAVRl7eupmC523eRsi093IaYaU2-wUNxzX7u6F4r4AwMPWd5w2gT0wVYA4AhP4x17uBznCi964r7zkRl1CXpSw2qsFd1214Xw_tAUw4_zZkuYrJzrS4Mj6hSL9nJWYQcgicV5AbcsvXLFRsZZGQA4 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e12c7419f641b4a7e56274a34826ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 26e12c7419f641b4a7e56274a34826ee Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestMultiNic-5979346 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 77edcf09f5f84e51a4fb08dbaf763a67 Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestMultiNic-5979346-project Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '3f347941-74ba-4e12-8749-b782c09e62ff'} Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.407044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] Returning 404 to user: Instance 3f347941-74ba-4e12-8749-b782c09e62ff could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5c5d6fc-a71f-414b-adef-3a1c30840359 tempest-ServersTestMultiNic-5979346 tempest-ServersTestMultiNic-5979346-project] 10.222.0.16 "GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff" status: 404 len: 111 microversion: 2.1 time: 0.052040 Sep 03 21:04:36.413260 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1879/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:36 2022] GET /compute/v2.1/servers/3f347941-74ba-4e12-8749-b782c09e62ff => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:04:36.814503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.815237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.829929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.830553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.831048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.831861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.832389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.832885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.862753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] HTTP exception thrown: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Request method failure captured: Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce HTTP/1.1 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8FKni4PChKyrOKAD5-vXK5KZCWf8QE-JhePx0I_iRvHGemS6W34RLo_0rqNSDBaD7S8fccSGNpxPfbSLyQQDVR2nb5xCm4VXTSPLXHduaU45OfdVRvH2ikCSr3hkczLAZT9iV1j-z6u48aQ13VmFBU633kK0kXjF6mND8CIAlvk2YY Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.21 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c897f757440d479790743e6a8c1dfd91 Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6115ed3f-d577-48ba-8408-20ba418e01ce'} Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.864389 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Returning 404 to user: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3b9db29-63d8-44f1-861a-9914dabf8cef tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 404 len: 111 microversion: 2.21 time: 0.058663 Sep 03 21:04:36.869656 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2081/3960] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:36 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:04:36.881732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '.version_select at 0x7fae6718be50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.882518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.891403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.892174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.893470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.894364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.894903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.896107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.898058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:36.899358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:36.906009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.906505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.907048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.907813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:36.908276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:36.908702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:36.998816 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d23fb3a-20c0-43e6-89fd-976c7864e3e7 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.126158 Sep 03 21:04:36.999442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1880/3961] 10.222.0.16 () {60 vars in 1337 bytes} [Sat Sep 3 21:04:36 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce/os-instance-actions => generated 611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:04:37.020079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:37.021545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:37.034952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.035715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.036367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.038388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.038954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.040015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.058921 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] HTTP exception thrown: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Request method failure captured: Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce HTTP/1.1 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8FKni4PChKyrOKAD5-vXK5KZCWf8QE-JhePx0I_iRvHGemS6W34RLo_0rqNSDBaD7S8fccSGNpxPfbSLyQQDVR2nb5xCm4VXTSPLXHduaU45OfdVRvH2ikCSr3hkczLAZT9iV1j-z6u48aQ13VmFBU633kK0kXjF6mND8CIAlvk2YY Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.21 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c897f757440d479790743e6a8c1dfd91 Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6115ed3f-d577-48ba-8408-20ba418e01ce'} Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:37.060817 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.065820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.067469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Returning 404 to user: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:37.068494 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bb473992-76cb-4fcb-8d78-8627f0502f06 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 404 len: 111 microversion: 2.21 time: 0.053186 Sep 03 21:04:37.069578 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1881/3962] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:04:37 2022] DELETE /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:04:37.078346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:37.079370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] [instance: 6115ed3f-d577-48ba-8408-20ba418e01ce] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:37.086824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.087594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.088210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.089121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.089748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.090346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.106271 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] HTTP exception thrown: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Request method failure captured: Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce HTTP/1.1 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8FKni4PChKyrOKAD5-vXK5KZCWf8QE-JhePx0I_iRvHGemS6W34RLo_0rqNSDBaD7S8fccSGNpxPfbSLyQQDVR2nb5xCm4VXTSPLXHduaU45OfdVRvH2ikCSr3hkczLAZT9iV1j-z6u48aQ13VmFBU633kK0kXjF6mND8CIAlvk2YY Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.21 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/484597f6a0554dd2af819e55e8e7b7d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 484597f6a0554dd2af819e55e8e7b7d2 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-613099144 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c897f757440d479790743e6a8c1dfd91 Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-InstanceActionsV221TestJSON-613099144-project Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6115ed3f-d577-48ba-8408-20ba418e01ce'} Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.108053 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] Returning 404 to user: Instance 6115ed3f-d577-48ba-8408-20ba418e01ce could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c914382-ebf6-47d1-a5da-a88db77c7f82 tempest-InstanceActionsV221TestJSON-613099144 tempest-InstanceActionsV221TestJSON-613099144-project] 10.222.0.16 "GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce" status: 404 len: 111 microversion: 2.21 time: 0.036541 Sep 03 21:04:37.113425 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1882/3963] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:37 2022] GET /compute/v2.1/servers/6115ed3f-d577-48ba-8408-20ba418e01ce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:04:37.202916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:37.211750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6322868-bcb6-4119-88a1-8aef98219368 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1360 microversion: 2.1 time: 0.317044 Sep 03 21:04:37.224922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2082/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:36 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1360 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:37.255344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:37.255961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:37.263396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.263886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.264530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.265263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:37.265994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:37.266516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:37.632478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:37.642178 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37dd431e-6bb0-4e28-8b36-4593b8927515 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.390574 Sep 03 21:04:37.653501 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1883/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:37 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:38.241334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:38.243572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:38.268105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.269392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.270382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:38.271506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.272158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.272951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:38.667324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:38.668019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:38.678041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.683948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.684623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:38.685608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.689103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.689738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:38.805067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:38.827476 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-414147e0-8f8a-4958-bcbe-d1df13faf1a7 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1545 microversion: 2.1 time: 0.595351 Sep 03 21:04:38.829589 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2083/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:38 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1545 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:38.858500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:38.859261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:38.866023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.866532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.867495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:38.868259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:38.868890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:38.869660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:39.123562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:39.132776 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce65f38b-3c42-46a8-9c48-a5ceed93e621 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.470469 Sep 03 21:04:39.148361 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1884/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:38 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:39.197280 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e64a57cf-7d2d-4796-ba0e-20c62b0b7b61 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.346774 Sep 03 21:04:39.198021 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2084/3968] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:04:38 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:40.155772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:40.156812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:40.165869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:40.167048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:40.168140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:40.169134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:40.169937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:40.170718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:40.697006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:40.702548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:40.711421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f244ef65-440f-4283-8ccf-748c869a341b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.559493 Sep 03 21:04:40.727515 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1885/3969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:40 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:41.739523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:41.740154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:41.760941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:41.761587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:41.761907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:41.762662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:41.763130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:41.763573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:42.442388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:42.456229 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59fd3c97-1c0c-44b6-a38a-a3d95882caa2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1506 microversion: 2.1 time: 0.721676 Sep 03 21:04:42.456830 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2085/3970] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:41 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:43.017275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99b545d-35ed-4719-85ed-8f0476fb7c94", "tag": "0a8504b2-d5ec-4da6-bdc5-349e04195d77"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:43.034212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:43.036056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:43.036703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:43.063497 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] Creating event network-changed:0a8504b2-d5ec-4da6-bdc5-349e04195d77 for instance c99b545d-35ed-4719-85ed-8f0476fb7c94 on nch1-master-1 Sep 03 21:04:43.070636 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1082c809-8d51-4d2e-9488-5909eda5e0bb req-257db794-1e67-4fef-83dc-41df1f44f9fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056853 Sep 03 21:04:43.071770 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1886/3971] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:43.487693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:43.488322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:43.505415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:43.525755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:43.525755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:43.525755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:43.525755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:43.525755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:44.159440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=36 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:44.172928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:44.317300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:44.331850 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6e715c4-9b50-4bf8-8cdc-bf5a167e933e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1527 microversion: 2.1 time: 0.847936 Sep 03 21:04:44.344929 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2086/3972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:43 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1527 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:44.951516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f381ef4-c1cc-4346-a0a3-f35decf3725c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Action: 'create', calling method: .version_select at 0x7fae6718b160>, body: {"keypair": {"name": "tempest-keypair-115742647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3QPlop2LGP2HUFjUTrtAVUIEAnphwkTl2xusoY6zHZVoti2pr7fov4gsNbe9igmF5kbt0KOIpMKPbcVM40p+9wDm65zAJb+dCoFvpLFegK1vNBzvIFUXvAQG4ZLPVqyw=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:44.991355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2f381ef4-c1cc-4346-a0a3-f35decf3725c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for project a6bda3914676415c8c173972749ef368. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:44.998249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-2f381ef4-c1cc-4346-a0a3-f35decf3725c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for user ac6eac3e9b65428ba9430970e9cbccaf and project a6bda3914676415c8c173972749ef368. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:45.026893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f381ef4-c1cc-4346-a0a3-f35decf3725c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.287459 Sep 03 21:04:45.027872 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1887/3973] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:04:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:04:45.368880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:45.374118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:45.402835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:45.403600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:45.406903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:45.409070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:45.413202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:45.413202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:46.976103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:46.986787 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa4dc99c-fcd2-4ed7-968c-a068f71ec2e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 1.625975 Sep 03 21:04:47.004929 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2087/3974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:45 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:48.020189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:48.021366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:48.041041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:48.042309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:48.044320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:48.048396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:48.052016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:48.053909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:48.412221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c32ba7b-42f6-4302-bdbb-df7d317ebc33", "name": "network-vif-plugged", "status": "completed", "tag": "b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:48.462837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:48.463356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:48.463810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:48.495280 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] Creating event network-vif-plugged:b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb for instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 on nch2-master-1 Sep 03 21:04:48.512781 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a2b0bae7-c222-49dc-90cd-76e032febb74 req-082daa6d-9b8f-414b-8d7e-97ecf54477c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104240 Sep 03 21:04:48.514788 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2088/3975] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:04:48.705378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:48.729533 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbfd22f7-e3a9-4555-a7c3-eb48091e3895 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.707869 Sep 03 21:04:48.731513 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1888/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:48 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:49.182547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-683374075", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8706e205-4723-4cd8-a711-e91c65b36081"}], "security_groups": [{"name": "tempest-securitygroup--138175980"}], "key_name": "tempest-keypair-115742647", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:49.563228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] validate_networks() for [('8706e205-4723-4cd8-a711-e91c65b36081', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:04:49.759274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:49.760018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:49.777470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:49.780566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:49.783539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:49.784752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:49.787249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:49.792739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:50.493727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:50.502577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54d0c2b4-3d61-4f45-924d-f1956a0f4459 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.747659 Sep 03 21:04:50.506833 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1889/3977] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:49 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:50.893480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-289010572", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": "none"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:51.102607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:04:51.104408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:04:51.105259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:04:51.105912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:04:51.107898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:04:51.182596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.183119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.188149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.193764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.194359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.194819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.249815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Getting quotas for project 30db100f9ded4cd48da8e5f7b67fe09c. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:51.256836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Getting quotas for user 52bf5760e9ef43379e60159d3d2ed744 and project 30db100f9ded4cd48da8e5f7b67fe09c. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:51.273655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:04:51.276181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:04:51.346316 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-44d548d8-92ce-45e4-9530-bc560fa4945d tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.835118 Sep 03 21:04:51.348219 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1890/3978] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:04:51.366672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:51.368228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:51.448370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:51.461706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:51.464182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:51.465755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a11cb0f4-e501-45ee-948a-36ce892a5dd3 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1280 microversion: 2.47 time: 0.109132 Sep 03 21:04:51.467235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for project a6bda3914676415c8c173972749ef368. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:51.468316 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1891/3979] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:51 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:51.480681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for user ac6eac3e9b65428ba9430970e9cbccaf and project a6bda3914676415c8c173972749ef368. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:51.483660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:51.496338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:04:51.497119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:04:51.497918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:04:51.498543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:04:51.499301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:04:51.513379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.514121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.514898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.516029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.517107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.517747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.533761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:51.534676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:51.544441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for project a6bda3914676415c8c173972749ef368. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:04:51.546530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.548312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.548667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.550607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:51.551928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:51.552496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Getting quotas for user ac6eac3e9b65428ba9430970e9cbccaf and project a6bda3914676415c8c173972749ef368. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:04:51.552960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:51.572324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:04:51.575473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:04:51.649945 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-993d3f25-c745-4b8e-97bd-b7068f63bdea tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.472080 Sep 03 21:04:51.657512 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2089/3980] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:04:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:04:51.664636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61defcc0-3816-419a-b05e-65455f79cc07 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:51.665668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61defcc0-3816-419a-b05e-65455f79cc07 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:51.753900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-61defcc0-3816-419a-b05e-65455f79cc07 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:51.808135 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61defcc0-3816-419a-b05e-65455f79cc07 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1268 microversion: 2.1 time: 0.145423 Sep 03 21:04:51.823897 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2090/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:51 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:51.873376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:51.883519 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-904c3766-33bb-41ee-94cc-178c4e8d58d1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.354798 Sep 03 21:04:51.900672 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1892/3982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:51 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:04:52.501073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:52.502580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:52.517015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.518330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.519159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:52.520519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.521338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.524548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:52.723520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:52.748718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:52.760252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:52.763608 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-89eaf8f8-ed6d-4ae5-bdd7-a1dbe030a9e9 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1284 microversion: 2.47 time: 0.267441 Sep 03 21:04:52.767762 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2091/3983] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:52 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:52.831506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:52.832376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:52.848152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.848831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.849454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:52.850361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.851114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.852250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:52.908934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:52.909845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:52.921291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.921808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.922265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:52.922998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:52.929035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:52.930320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:53.016956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:53.026838 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ecaec39-79af-4106-b7bf-1ff8ae99d7c2 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1264 microversion: 2.1 time: 0.199290 Sep 03 21:04:53.027441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1893/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:52 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:53.249534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:53.261692 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d4768f5c-58fe-4054-a305-f3789577db61 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.356989 Sep 03 21:04:53.278336 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2092/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:52 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:53.794766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:53.795837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:53.802928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:53.804002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:53.804780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:53.806294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:53.806923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:53.807537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:53.963845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:53.984527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:53.988124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:53.990797 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-502cd31e-83d2-4207-ae46-4ae164eaf333 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1332 microversion: 2.47 time: 0.201645 Sep 03 21:04:53.994310 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1894/3986] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:53 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:54.055994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:54.056625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:54.076545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:54.077345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:54.079189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:54.080487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:54.084019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:54.084684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:54.228289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:54.239495 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b8120d5-078d-46bc-bd54-d101071151bb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1328 microversion: 2.1 time: 0.191864 Sep 03 21:04:54.243602 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2093/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:54 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:54.289955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:54.290590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:54.308094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:54.309876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:54.310367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:54.311113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:54.311628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:54.311999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:54.549128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:54.562851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0de0c4c-cd59-4650-8588-554efd892e85 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.281374 Sep 03 21:04:54.563797 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1895/3988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:54 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:55.025741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:55.026499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:55.042767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.043283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.043740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:55.044465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.044964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.045407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:55.199800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:55.211708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:55.213497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:55.214950 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-700348d2-7934-49cd-9c9e-4800574bf5ec tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1338 microversion: 2.47 time: 0.196519 Sep 03 21:04:55.216013 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2094/3989] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:55 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:55.272274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:55.274253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:55.293693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.294383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.306248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:55.307355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.314660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.316422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:55.510871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:55.520976 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47a2d2f7-258e-4b5a-88f2-1b5e80bdc728 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1326 microversion: 2.1 time: 0.253665 Sep 03 21:04:55.531555 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1896/3990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:55 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1326 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:55.594742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:55.595852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:55.610875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.611721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.612581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:55.615660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:55.617114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:55.617834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:56.046471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:56.065093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5eec751c-ebd6-4f53-963c-575bd50992f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.481941 Sep 03 21:04:56.071038 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2095/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:55 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:56.246240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:56.247110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:56.267724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:56.268266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:56.268720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:56.270680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:56.272037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:56.272490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:56.550061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:56.550899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:56.568316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:56.571566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:56.572047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:56.575142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:56.575643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:56.576095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:56.700129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:56.710482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-32814b4f-b52f-46ab-a21e-af8db9818031 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1326 microversion: 2.1 time: 0.164509 Sep 03 21:04:56.713764 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2096/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:56 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:56.889132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:56.906505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:56.908182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:56.910615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-241bd3ca-c800-470c-9c19-397206b17da5 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1338 microversion: 2.47 time: 0.670633 Sep 03 21:04:56.924964 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1897/3993] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:56 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1338 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:57.097424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:57.099280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:57.112366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.114389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.115768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:57.117763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.120042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.120753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:57.444921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:57.467957 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab082fc1-7b72-4eda-8237-3fd6f8cb4b24 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.378856 Sep 03 21:04:57.469232 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2097/3994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:57 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:57.737201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:57.738091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:57.748074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.753766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.754504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:57.757386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.758336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.759184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:57.944399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:57.944399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:57.951915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.953308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.955815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:57.956699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:57.958162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:57.960462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.119385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.137215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.146797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.151230 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e07a935-1f72-46af-8a02-262b00a15759 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1359 microversion: 2.47 time: 0.216381 Sep 03 21:04:58.151829 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2098/3995] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:57 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:58.181227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-114035132"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:58.184542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:58.192121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.193125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.194513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.196022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.196722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.197462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.228274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:58.428051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.435899 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-92d00ae7-6279-45bc-b5f2-6b271cb0e752 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.703547 Sep 03 21:04:58.436478 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1898/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:57 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:58.496967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:58.497845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:58.505639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.506143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.509897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.517841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.518559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.519186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.526525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42df9fe6-6b2f-47f4-a172-903f462ff20a tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "POST /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e/action" status: 202 len: 52 microversion: 2.47 time: 0.336430 Sep 03 21:04:58.535924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2099/3997] 10.222.0.16 () {62 vars in 1319 bytes} [Sat Sep 3 21:04:58 2022] POST /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e/action => generated 52 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 03 21:04:58.552025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:58.552962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:58.566474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.568090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.568752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.573144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.573871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.575689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.615328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:04:58.749386 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a2d6828-f50c-4b68-89f9-d95d55ce3360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 204 len: 0 microversion: 2.47 time: 0.207986 Sep 03 21:04:58.751084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2100/3998] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:04:58 2022] DELETE /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:04:58.788808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:58.790012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:58.799757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.800707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.801570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.802715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:58.803628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:58.804632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:58.898926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.908839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.910777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:58.912331 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-034d94cb-ce7c-4f42-b76b-62d4d4f46e79 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1365 microversion: 2.47 time: 0.137959 Sep 03 21:04:58.912936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2101/3999] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:58 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:04:59.184026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:59.192080 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de2e56eb-02b7-41e7-bfe6-3dbd002ea306 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.699764 Sep 03 21:04:59.224482 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1899/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:58 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:59.462249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:59.463543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:59.481686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:59.483349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:59.484061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:59.485099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:59.485817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:59.486505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:59.818008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:04:59.835357 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1176a57e-0e90-4cd8-94a6-c23fde1277cb tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.375468 Sep 03 21:04:59.836790 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2102/4001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:04:59 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:04:59.902000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a209c7e-e10d-4cd6-a180-f9673b66208a", "tag": "d43c4e7c-cc26-4073-bd0f-ea24d899d75e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:04:59.917974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:59.918488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:59.933107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:59.946660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:04:59.947697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:04:59.963416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:59.964299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:59.967582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:59.968302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:04:59.968774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:04:59.973948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:04:59.981593 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] Creating event network-changed:d43c4e7c-cc26-4073-bd0f-ea24d899d75e for instance 4a209c7e-e10d-4cd6-a180-f9673b66208a on nch2-master-1 Sep 03 21:05:00.006131 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e4b373cc-cb84-49fe-805c-7c4b6eeeef7d req-df960c91-5a91-49fa-a35e-c9049d2dc71d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379521 Sep 03 21:05:00.011502 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1900/4002] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:00.195948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:00.213714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:00.217781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:00.222087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:00.223252 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5bb37f5c-2d3b-4b5d-8130-ecd45c3b1b43 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1365 microversion: 2.47 time: 0.280386 Sep 03 21:05:00.223570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:00.224411 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2103/4003] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:04:59 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:05:00.240056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:00.242930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:00.244329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:00.247108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:00.250017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:00.250473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:00.873104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:00.873644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:00.893579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:00.893963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:00.896626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:00.900218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:00.903385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:00.903866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:00.916577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:00.937858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cccf8498-0d6f-448f-9ba1-030ba0a5238f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.717407 Sep 03 21:05:00.961997 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1901/4004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:00 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:01.206953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:01.221683 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7464434e-2b13-44d3-9f8d-520555b5c998 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.354204 Sep 03 21:05:01.241416 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2104/4005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:00 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:01.263979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:01.264968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:01.269840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:01.285141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:01.285985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:01.286743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:01.288386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:01.289728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:01.290407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:01.432840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:01.443997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:01.446691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:01.453861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5fc0f678-061c-449b-8efc-4c6402354360 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1365 microversion: 2.47 time: 0.194772 Sep 03 21:05:01.456002 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1902/4006] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:05:01 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:05:01.963208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:01.964424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:01.974319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:01.977472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:01.983055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:01.986614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:01.987115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:01.996620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:01.997200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:01.997928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.251597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:02.261461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:02.282034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:02.310997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:02.314772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:02.318017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.321290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:02.325070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:02.326127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.381669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:02.412328 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5dbd6cb6-60bf-4e8f-aa83-5910cbc2f96d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.452793 Sep 03 21:05:02.413009 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2105/4007] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:01 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:02.488199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:02.488829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:02.508355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:02.508871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:02.509416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.510160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:02.510631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:02.511083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.669828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:02.670629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:02.671140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:02.671629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lazy-loading 'fault' on Instance uuid 1767e0d9-1250-459e-9d11-4a2770eb8e8e {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:05:02.747644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:02.769565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:02.772477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52bf5760e9ef43379e60159d3d2ed744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30db100f9ded4cd48da8e5f7b67fe09c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:02.782199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2beb051c-8520-4a12-93ec-73f6984049bf tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 200 len: 1370 microversion: 2.47 time: 0.290827 Sep 03 21:05:02.817311 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2106/4008] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:05:02 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:05:03.318439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:03.334648 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc992c33-171d-48a0-a73e-ba7a510a6abe tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 1.087684 Sep 03 21:05:03.338462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1903/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:02 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:03.444040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:03.444775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:03.459395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:03.460183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:03.462002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:03.463092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:03.463844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:03.464467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:03.672173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:03.683076 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-feaffc44-7b5c-4e18-aca8-95e8a5eaf5c5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.247453 Sep 03 21:05:03.683744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2107/4010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:03 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:03.815986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:03.817146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] [instance: 1767e0d9-1250-459e-9d11-4a2770eb8e8e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:03.820708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:03.836173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:03.838858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:03.839899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:03.841027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:03.841787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:03.842720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:03.863657 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] HTTP exception thrown: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Request method failure captured: Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e HTTP/1.1 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8FyS_nYbSjK3Ebf0A6LPMsC-OLwMWYum6LowuBtAxW7K-_H-dF8n1ROZGI-m9a25npS0rUVDk-PAoel79CAncSSb5wVwuC_xTmy1I0x-lXb4z5_dzeNurPUAhwcrquf3n_o2UIGhEzsm_jda5h2k0Y0QZxVLhtHXuxxKsMHZ-q3y0E Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.47 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 30db100f9ded4cd48da8e5f7b67fe09c Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAaction247Test-1502111208 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30db100f9ded4cd48da8e5f7b67fe09c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30db100f9ded4cd48da8e5f7b67fe09c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30db100f9ded4cd48da8e5f7b67fe09c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30db100f9ded4cd48da8e5f7b67fe09c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAaction247Test-1502111208 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 30db100f9ded4cd48da8e5f7b67fe09c Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAaction247Test-1502111208 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAaction247Test-1502111208-project Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 52bf5760e9ef43379e60159d3d2ed744 Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAaction247Test-1502111208-project Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '1767e0d9-1250-459e-9d11-4a2770eb8e8e'} Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:03.865771 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] Returning 404 to user: Instance 1767e0d9-1250-459e-9d11-4a2770eb8e8e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:03.876705 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81c9e0c6-92d3-4143-92c8-4ed347289060 tempest-ServersAaction247Test-1502111208 tempest-ServersAaction247Test-1502111208-project] 10.222.0.16 "GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e" status: 404 len: 111 microversion: 2.47 time: 0.057114 Sep 03 21:05:03.889933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1904/4011] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:05:03 2022] GET /compute/v2.1/servers/1767e0d9-1250-459e-9d11-4a2770eb8e8e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:05:04.361182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:04.362096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:04.373542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:04.374128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:04.374597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:04.375354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:04.378368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:04.379137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:04.659257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:04.669110 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d546250-5f80-4081-85d9-fb58f5854c8e tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.311938 Sep 03 21:05:04.673410 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2108/4012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:04 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:04.706086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:04.706759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:04.728624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:04.729368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:04.730972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:04.732212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:04.733015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:04.733840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:05.079652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:05.090795 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91c99108-6f3b-4672-945f-9de30d1783e6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1522 microversion: 2.1 time: 0.388842 Sep 03 21:05:05.104206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1905/4013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:04 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:05.302076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-537381401", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8da7977b-626f-4bcd-a779-6f9290c239c3"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:05.373120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] validate_networks() for [('8da7977b-626f-4bcd-a779-6f9290c239c3', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:05:05.702122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:05.703003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:05.709435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:05.710048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:05.710366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:05.711645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:05.712112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:05.712550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:05.957629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:05:05.958431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:05:05.958966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:05:05.959633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:05:05.960017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:05:05.986005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:05.988395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:05.989862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:05.994429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:05.996074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:05.998548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:06.051964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Getting quotas for project 7c6b7140c9474bf5b0f1e6d1618a7937. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:05:06.067422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:06.072039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Getting quotas for user 9995a4ecc0ec4f97a46ea58fa158ee61 and project 7c6b7140c9474bf5b0f1e6d1618a7937. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:05:06.078254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-36376cf9-9a99-45bb-a573-9618ec0708ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.379917 Sep 03 21:05:06.079527 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1906/4014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:05 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:06.091989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:05:06.095442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:05:06.123877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:06.124776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:06.132124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:06.133436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:06.134077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:06.137653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:06.138308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:06.139055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:06.169050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:06.200856 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c78ce30c-d604-447d-8926-3282b5f249a7 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110805 Sep 03 21:05:06.202250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2109/4015] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:05:06.219435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56eb58fd-f1f9-4b3f-afcf-b2ff1af4c3e2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:06.220301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56eb58fd-f1f9-4b3f-afcf-b2ff1af4c3e2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:06.454115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56eb58fd-f1f9-4b3f-afcf-b2ff1af4c3e2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:06.472289 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56eb58fd-f1f9-4b3f-afcf-b2ff1af4c3e2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1224 microversion: 2.1 time: 0.262328 Sep 03 21:05:06.481939 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2110/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:06 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1224 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:06.546147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:06.561672 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07ab44eb-4673-46d3-a010-cdc6f5caecf5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1504 microversion: 2.1 time: 0.441709 Sep 03 21:05:06.562294 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1907/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:06 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:07.103247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:07.104055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:07.132093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.133807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.134547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.136377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.137942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.139316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.497622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:07.498497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:07.511305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.511835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.512267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.513020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.513492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.513936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.622522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:07.637268 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98403d8d-9514-43f8-9afe-e1174000c3d0 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 0.538004 Sep 03 21:05:07.638734 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2111/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:07 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:07.649771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:07.658869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:07.673243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:07.681226 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a6a4067-caed-486b-9df0-04fab9609665 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1276 microversion: 2.1 time: 0.185861 Sep 03 21:05:07.684252 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1908/4019] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:07 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:07.685523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.686307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.687002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.687969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:07.688609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:07.689279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:07.971826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:07.981525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a68701f8-9fe1-4577-a144-1b59c5bbfadd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1504 microversion: 2.1 time: 0.337999 Sep 03 21:05:07.982475 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2112/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:07 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:08.665445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:08.666077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:08.678763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:08.679851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:08.680298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:08.681058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:08.681537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:08.681974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:08.709344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:08.710710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:08.730077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:08.730999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:08.731892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:08.734218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:08.736330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:08.737052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:08.898978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:08.912341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63ec8b89-a484-4c9e-89d5-bd531c959896 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1282 microversion: 2.1 time: 0.209424 Sep 03 21:05:08.920019 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2113/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:08 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:08.941697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a209c7e-e10d-4cd6-a180-f9673b66208a", "name": "network-vif-plugged", "status": "completed", "tag": "d43c4e7c-cc26-4073-bd0f-ea24d899d75e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:08.967755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:08.969555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:08.971387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:08.994636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] Creating event network-vif-plugged:d43c4e7c-cc26-4073-bd0f-ea24d899d75e for instance 4a209c7e-e10d-4cd6-a180-f9673b66208a on nch2-master-1 Sep 03 21:05:09.013142 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1f766e49-f3c5-435f-a63c-6249a6c003ce req-5d94d41a-989a-470a-9201-cbea4e084fa7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090478 Sep 03 21:05:09.021739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2114/4022] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:09.043612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:09.044329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:09.071423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.071932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.072836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.076703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.082269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.082877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.181832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:09.698892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:09.717839 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0574dda-fff2-4717-8a53-095f4cb1a0d8 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1393 microversion: 2.1 time: 1.056783 Sep 03 21:05:09.719348 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1909/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:08 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1393 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:09.728352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:09.730736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:09.740581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.741320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.742549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.743596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.744302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.745003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.784343 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Cannot 'reboot' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action HTTP/1.1 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 28 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: {"reboot": {"type": "HARD"}} Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'reboot' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e0e93e45-2e21-4334-bd61-549f421cfd38', 'body': {'reboot': {'type': 'HARD'}}} Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:05:09.788563 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:09.793185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:09.796097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 409 to user: Cannot 'reboot' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:09.797556 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa814197-4186-4d66-aa8d-4c19291b60eb tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action" status: 409 len: 145 microversion: 2.1 time: 0.076488 Sep 03 21:05:09.798700 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1910/4024] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:05:09 2022] POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:05:09.805101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:09.806045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:09.813455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.814175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.814949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.815860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:09.816479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:09.817701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:09.944518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:09.958026 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc58caad-4320-49b8-926c-b03ddbb56c56 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 200 len: 1507 microversion: 2.1 time: 0.934838 Sep 03 21:05:09.982265 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2115/4025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:09 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 1507 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:09.993883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:09.999509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:10.010396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.011079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.012385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.013473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.014230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.015125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.064068 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Cannot 'rebuild' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action HTTP/1.1 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 65 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'rebuild' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'e0e93e45-2e21-4334-bd61-549f421cfd38', 'body': {'rebuild': {'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790'}}} Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:05:10.066307 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued Sep 03 21:05:10.071949 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:10.076100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 409 to user: Cannot 'rebuild' instance e0e93e45-2e21-4334-bd61-549f421cfd38 while it is in vm_state rescued {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:10.077043 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24783e53-cb82-450c-aa4e-8fdccb5910a2 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action" status: 409 len: 146 microversion: 2.1 time: 0.093680 Sep 03 21:05:10.077958 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2116/4026] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:05:09 2022] POST /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:05:10.085599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:10.086545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:10.093538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.094571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.095686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.096611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.097267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.098128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.102595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:10.114857 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-260f05c1-473b-4a31-9473-7b618a339a75 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.314200 Sep 03 21:05:10.124435 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1911/4027] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:09 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:10.137472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:10.139162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:10.167950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.168606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.169219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.170050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.172321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.173072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.228480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:10.238721 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Working on deleting snapshot 1545a03e-154a-406b-b7ed-7d3b02511177 from shelved instance... Sep 03 21:05:10.797764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:10.812385 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-326a613b-3605-4513-9afa-d542d8543e16 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.730880 Sep 03 21:05:10.814666 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2117/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:10 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:10.852363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:10.853811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:10.862542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:10.864590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.865421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.867153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.868106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:10.870169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:10.870801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:10.912372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:11.044884 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e51b14a9-ec5f-4393-bbba-330835530f0b tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 204 len: 0 microversion: 2.1 time: 0.204042 Sep 03 21:05:11.047485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2118/4029] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:10 2022] DELETE /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:05:11.056104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:11.056838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:11.067589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:11.068110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:11.068570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:11.069382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:11.070390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:11.070837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:11.240234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Doing local delete in cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140519) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 03 21:05:11.241948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:11.242779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:11.243310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:11.243872 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 03 21:05:11.248143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] deallocate_for_instance() {{(pid=140519) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 03 21:05:11.660440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:11.678319 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5c399059-283d-4e40-9dc7-4731b24957f4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.628389 Sep 03 21:05:11.678933 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2119/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:11 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:11.692839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:11.693505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:11.708489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:11.708836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:11.709309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:11.710225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:11.710935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:11.721636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.206028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Updating instance_info_cache with network_info: [] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 21:05:12.246675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:12.260633 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac204a18-c073-4f09-a3de-b32314f11d8b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1574 microversion: 2.1 time: 0.580321 Sep 03 21:05:12.274187 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2120/4031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:11 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1574 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:12.300865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:12.302391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:12.322487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.339221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.339937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.343050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.344275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.347522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.539028 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b292c552-d6c2-4508-b091-08a316ea4acc tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 204 len: 0 microversion: 2.1 time: 2.409980 Sep 03 21:05:12.539650 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1912/4032] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:10 2022] DELETE /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 0 bytes in 2414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:05:12.557150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c32ba7b-42f6-4302-bdbb-df7d317ebc33", "name": "network-vif-unplugged", "status": "completed", "tag": "b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:12.582069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.582069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.582069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.604938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_external_events [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] Unable to find a host for instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33. Dropping event network-vif-unplugged {{(pid=140519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 21:05:12.610798 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f6adcdc1-6131-466a-b287-8ad78ae34d9c req-c2f957b0-2898-4520-b104-ed3ccee25160 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069575 Sep 03 21:05:12.614684 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1913/4033] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 03 21:05:12.623302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:12.630941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:12.643345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.644013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.645508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.647059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.656066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.656536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.808153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:12.823141 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e451f4c-6b88-44a3-998b-1a6aff2222ac tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1688 microversion: 2.1 time: 0.547702 Sep 03 21:05:12.824221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2121/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:12 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1688 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:12.830406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:12.831466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:12.839758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.841161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.841978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.842942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.843639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.845024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.925982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:12.938144 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5ffa1b02-336f-4a23-85a1-e26ed660df04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.321951 Sep 03 21:05:12.939999 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1914/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:12 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:12.945664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c32ba7b-42f6-4302-bdbb-df7d317ebc33", "name": "network-vif-deleted", "tag": "b3cea307-bbc9-4fc8-8131-3a2b8fb4fffb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:12.955719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:12.956966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:12.957879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:12.978364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_external_events [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] Unable to find a host for instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33. Dropping event network-vif-deleted {{(pid=140519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 21:05:12.979858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-379fd328-897c-4cd1-93b2-4bcb3d179334 req-24d7a114-42e0-4dae-8fac-3ef91485ce99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.038579 Sep 03 21:05:12.980673 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1915/4036] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 03 21:05:12.987044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:12.987946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:13.004541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.005738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.006918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.008781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.009583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.010923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.141230 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b32e4b4-4717-4771-9f4e-38024977cf52 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158643 Sep 03 21:05:13.154034 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1916/4037] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:05:12 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:13.159307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:13.159935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:13.173139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.173651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.174097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.174835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.175278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.175906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.191187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:13.192668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 HTTP/1.1 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '7c32ba7b-42f6-4302-bdbb-df7d317ebc33'} Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:13.195397 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:05:13.216744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:13.217842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-47fb6f12-3c01-4786-91bb-cd183579260c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.373404 Sep 03 21:05:13.217842 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2122/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:12 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:13.218051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:13.218051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5ceb44e-5e5f-4b14-ab56-6184929e1921 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 404 len: 111 microversion: 2.1 time: 0.047608 Sep 03 21:05:13.218051 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1917/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:13 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:13.218335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1179835385"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:13.218335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:13.218537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0688803c-4688-480f-97bf-721ae1d95dc4", "tag": "1e87df45-cca7-4590-87f2-d6498c6861f4"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:13.232640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.233226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.233759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.248527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.249099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.249424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.250152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.250630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.251071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.255387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] Creating event network-changed:1e87df45-cca7-4590-87f2-d6498c6861f4 for instance 0688803c-4688-480f-97bf-721ae1d95dc4 on nch1-master-1 Sep 03 21:05:13.269801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-04628d3e-8228-4475-a999-3c99fee30737 req-d220f887-f319-4aca-bcae-7e64a973b4b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063044 Sep 03 21:05:13.271575 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1918/4040] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:13.414000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-701748317", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:13.509088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:05:13.700169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0d171f06-7bc0-4b5c-9db4-d95310456d23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.499230 Sep 03 21:05:13.714869 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2123/4041] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:05:13 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 03 21:05:13.853649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:13.855336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:13.878098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.880108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.883358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:13.885514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:13.888175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:13.888750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:14.033358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:14.044861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c922d011-1c6c-4146-9001-bbf47b76dc81 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1621 microversion: 2.1 time: 0.198777 Sep 03 21:05:14.047924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2124/4042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:13 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:14.227978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:14.228971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:14.262683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:14.263270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:14.265028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:14.266974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:14.267476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:14.269324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:14.532850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:14.542134 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db9eacae-9507-4960-99ab-e559c1b2deb5 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.318402 Sep 03 21:05:14.558231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2125/4043] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:14 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:15.027698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcade07-def5-44a5-a548-8f7c952914f1", "name": "network-vif-deleted", "tag": "ba1680a6-779b-4252-a9c6-0f65c700406f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:15.050375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.051691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.053149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.081464 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] Creating event network-vif-deleted:ba1680a6-779b-4252-a9c6-0f65c700406f for instance cbcade07-def5-44a5-a548-8f7c952914f1 on nch1-master-1 Sep 03 21:05:15.088699 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7c8c57c1-26af-434c-8fce-0f0dda4a3ade req-6d06d0ea-4f69-4f71-9f90-4c127e03b278 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064660 Sep 03 21:05:15.090470 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2126/4044] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:15.110949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:15.112470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:15.135433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.136073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.136621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.138923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.139707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.140612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.239665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:15.250398 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b489e568-f390-4f95-b2ac-fb3178ef68b9 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1621 microversion: 2.1 time: 0.158581 Sep 03 21:05:15.251632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2127/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:15 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:15.565676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:15.566454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:15.574367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.575218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.575912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.577357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.578079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.578912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.864219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:15.879880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3eeb1603-f3b5-4690-b964-be937f141326 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.318020 Sep 03 21:05:15.881046 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2128/4046] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:15 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:15.910582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:05:15.911037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:05:15.914309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:05:15.917088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:05:15.917614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:05:15.932107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.932672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.933251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.934111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:15.934641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:15.935297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:15.956774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:05:15.970281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:05:15.990414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:05:15.995204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:05:16.088974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:16.089610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:16.094697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4dd8339d-e5ea-4c28-9357-302f1be0336d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.684938 Sep 03 21:05:16.096141 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1919/4047] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:05:16.104466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:16.108250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.110041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f4bb204-0ccf-4a76-8a23-c7d911e12390 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:16.110804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.111235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f4bb204-0ccf-4a76-8a23-c7d911e12390 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:16.112590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.115008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.115689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.117939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.287640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f4bb204-0ccf-4a76-8a23-c7d911e12390 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:16.315855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f4bb204-0ccf-4a76-8a23-c7d911e12390 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1214 microversion: 2.1 time: 0.211677 Sep 03 21:05:16.320768 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1920/4048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:16 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:16.330581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:16.331210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:16.341820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.342543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.343346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.344309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.345066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.345686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.434050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:16.451456 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae2faa42-c8c2-41f9-a421-5f688e3fac3d tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1574 microversion: 2.1 time: 0.366361 Sep 03 21:05:16.453430 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2129/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:16 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1574 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:16.564049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:16.575809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ebca6dbf-f072-4da1-aec8-ef0b9b0f36ff tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1621 microversion: 2.1 time: 0.253748 Sep 03 21:05:16.596952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1921/4050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:16 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1621 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:16.907900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:16.909494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:16.924444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:16.929832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.930643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.932876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.933825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:16.935866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:16.936503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:16.950869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:17.171838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a209c7e-e10d-4cd6-a180-f9673b66208a", "tag": "d43c4e7c-cc26-4073-bd0f-ea24d899d75e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:17.198221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.204084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.204550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.262090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] Creating event network-changed:d43c4e7c-cc26-4073-bd0f-ea24d899d75e for instance 4a209c7e-e10d-4cd6-a180-f9673b66208a on nch2-master-1 Sep 03 21:05:17.286826 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2f6d42da-60b1-45c9-a003-f30e149304ff req-22b9a2a5-b98c-4b62-9b13-a8e6ecbbfc02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119550 Sep 03 21:05:17.295904 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1922/4051] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:17.342420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:17.343328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:17.356798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:17.358782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.360499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.361749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.364607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.365806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.369456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.369938 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-764af74a-e40d-4081-9393-77ac30558ca2 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.469314 Sep 03 21:05:17.371046 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2130/4052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:16 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:17.399937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:17.591709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:17.604576 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c501ca53-458e-4466-a177-bc1b55cd0bf3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1210 microversion: 2.1 time: 0.267564 Sep 03 21:05:17.605686 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1923/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:17 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1210 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:17.624040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:17.629860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:17.646955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.647552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.648642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.649491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.651089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.651981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.729603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:17.730097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:17.730539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:17.730994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lazy-loading 'fault' on Instance uuid cbcade07-def5-44a5-a548-8f7c952914f1 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:05:17.842436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:17.858863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f98a4583-9fba-4b4d-a83d-465f96c83902 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 200 len: 1424 microversion: 2.1 time: 0.238756 Sep 03 21:05:17.860153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2131/4054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:17 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 1424 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:18.401635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:18.402802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:18.412276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.413816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.414825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.415860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.416604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.417481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.628963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:18.630294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:18.639221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.639804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.640428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.641591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.642327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.643623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.736160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:18.744237 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62a4bf12-0bde-44d9-bfc1-2847ff3d1dfa tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1272 microversion: 2.1 time: 0.119608 Sep 03 21:05:18.744822 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2132/4055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:18 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:18.889020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:18.889821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: cbcade07-def5-44a5-a548-8f7c952914f1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:18.898569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.899155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.899835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.900750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:18.901430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:18.902340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:18.917899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 HTTP/1.1 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'cbcade07-def5-44a5-a548-8f7c952914f1'} Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:18.919575 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 404 to user: Instance cbcade07-def5-44a5-a548-8f7c952914f1 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1d76e305-2d32-45f0-a21e-12332f11aae3 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1" status: 404 len: 111 microversion: 2.1 time: 0.037894 Sep 03 21:05:18.922534 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2133/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:18 2022] GET /compute/v2.1/servers/cbcade07-def5-44a5-a548-8f7c952914f1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:18.929421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce70fa83-eb0c-4990-a88f-236e110995e8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '.version_select at 0x7fae6b75aa60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:18.948739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:18.961120 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbf7a27c-8f25-4a11-a90c-26e0cbce2c5b tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.560386 Sep 03 21:05:18.961988 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1924/4057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:18 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:18.973054 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce70fa83-eb0c-4990-a88f-236e110995e8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-624382545" status: 202 len: 0 microversion: 2.1 time: 0.044782 Sep 03 21:05:18.976215 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2134/4058] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-624382545 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:05:19.771687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:19.773486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:19.787299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:19.788575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:19.789748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:19.791087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:19.792028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:19.793056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:19.989715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:19.990389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:19.999094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:19.999603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:20.000055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:20.000782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:20.001284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:20.001727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:20.145856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:20.157949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5d79f39-5cbb-4175-a814-ecc28c59b9ee tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.174034 Sep 03 21:05:20.159105 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2135/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:19 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:20.213140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:20.222179 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62cda2e5-b53c-42c8-9ff2-942e3d57bea9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1272 microversion: 2.1 time: 0.457407 Sep 03 21:05:20.224501 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1925/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:19 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1272 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:20.862998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-511452702", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "2e80bd4e-da06-4c20-ae94-4559380a887c"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:20.956634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] validate_networks() for [('2e80bd4e-da06-4c20-ae94-4559380a887c', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:05:21.183173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:21.184856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:21.192446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.193288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.193984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.195467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.196180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.196767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.469427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:21.482922 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a63b4a68-d444-4082-a1de-0fc627effb69 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.302688 Sep 03 21:05:21.483848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1926/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:21 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:21.510074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:21.511739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:21.536198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.540360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.541512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.543754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.545084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.548261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.567730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:05:21.568378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:05:21.569830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:05:21.571103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:05:21.571697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:05:21.586218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.587060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.588033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.589511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:21.590123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:21.590731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:21.613730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Getting quotas for project 94e570d13568401c8fe5191706d80a75. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:05:21.627325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Getting quotas for user 43d940c1853e4d4aa86f6f4c61d95109 and project 94e570d13568401c8fe5191706d80a75. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:05:21.648394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:05:21.651959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:05:21.726482 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-64b089f4-0b7d-41b3-b430-a0a4ca94373a tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107279 Sep 03 21:05:21.727152 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2136/4062] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:05:21.746676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-33de88e5-3c77-4b01-a017-154ffb32aa7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:21.748624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-33de88e5-3c77-4b01-a017-154ffb32aa7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:21.797532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:21.806236 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-700171ec-89c5-47c1-ae14-f9d4e00b5259 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.321124 Sep 03 21:05:21.809624 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1927/4063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:21 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:21.831738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-33de88e5-3c77-4b01-a017-154ffb32aa7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:21.841659 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-33de88e5-3c77-4b01-a017-154ffb32aa7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1224 microversion: 2.1 time: 0.105416 Sep 03 21:05:21.844271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2137/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:21 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:21.992624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52ce559-847c-4d55-b3d6-7d0e5009c31f", "tag": "b8534ca6-0698-4369-adb7-a49a7610ce54"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:22.016166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.016666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.017138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.070019 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] Creating event network-changed:b8534ca6-0698-4369-adb7-a49a7610ce54 for instance b52ce559-847c-4d55-b3d6-7d0e5009c31f on nch2-master-1 Sep 03 21:05:22.080029 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-14fde400-6675-4727-8401-dc560386a606 req-48b0f16a-81c1-4132-8462-39f436565901 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093421 Sep 03 21:05:22.080929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1928/4065] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:22.516480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:22.517384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:22.526494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.527489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.528155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.529595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.531461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.532623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.723965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:22.731962 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b000b06-ec4e-4e3f-9aa5-1d493640e0ba tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.226353 Sep 03 21:05:22.732912 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2138/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:22 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:22.836230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:22.837819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:22.846246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.847078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.848359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.849490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.850268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.851020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.868756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:22.869603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:22.884201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.886812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.887427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:22.892491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:22.893268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:22.894681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:23.006664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:23.015159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5bdc5b8f-cc06-447e-8ce1-c412942a3e65 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1276 microversion: 2.1 time: 0.151001 Sep 03 21:05:23.016183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2139/4067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:22 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:23.155610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:23.169735 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-563783b0-43af-426c-9938-ebc361f46ac2 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.339550 Sep 03 21:05:23.171669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1929/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:22 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:23.377905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688803c-4688-480f-97bf-721ae1d95dc4", "name": "network-vif-plugged", "status": "completed", "tag": "1e87df45-cca7-4590-87f2-d6498c6861f4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:23.390491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:23.390989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:23.391621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:23.406243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] Creating event network-vif-plugged:1e87df45-cca7-4590-87f2-d6498c6861f4 for instance 0688803c-4688-480f-97bf-721ae1d95dc4 on nch1-master-1 Sep 03 21:05:23.412356 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9c4228e4-f22a-4fc4-aadb-89475a19ec36 req-96a43967-fc70-41d0-95fb-895af0c03072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038733 Sep 03 21:05:23.414295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2140/4069] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:23.756049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:23.756683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:23.770053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:23.772775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:23.773359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:23.774808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:23.775163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:23.775618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:24.042364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:24.043696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:24.058792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:24.059516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:24.060116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:24.061628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:24.062524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:24.063080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:24.186338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:24.196819 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ffb2fa8-23e4-4b38-b322-3e42f6d20e7c tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1282 microversion: 2.1 time: 0.160630 Sep 03 21:05:24.199236 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2141/4070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:24 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:24.205832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:24.206568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:24.214760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:24.215877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:24.216488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:24.217411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:24.218309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:24.219545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:24.412339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:24.432559 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e2a17db-b7ee-433d-b6e2-51301d5a761e tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1324 microversion: 2.1 time: 0.677994 Sep 03 21:05:24.440690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1930/4071] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:23 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:24.755024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:24.765385 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-87437a68-db87-4708-899f-bb2b884b54c7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.564509 Sep 03 21:05:24.766774 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2142/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:24 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:25.225422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:25.226800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:25.240996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.242392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.247338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.248331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.249447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.254272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.466095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:25.466982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:25.487918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.491102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.492152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.496585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.497117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.504052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.667582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:25.681854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da0631fd-5ecc-49f9-b5e8-045fa6d1ac78 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.460176 Sep 03 21:05:25.682460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1931/4073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:25 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:25.701257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-plugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:25.746628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.747682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.748474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.785753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] Creating event network-vif-plugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:05:25.798168 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d9d5d67b-5928-41ae-8b93-cffa03bd1e53 req-e12b5b51-6e64-4994-a0c6-5d1214d4f753 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113976 Sep 03 21:05:25.799900 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1932/4074] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:25.808239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:25.821259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:25.821259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.821259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.821259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.821507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.821941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.822610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.846462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:25.855225 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c277b703-1033-4fed-a8f5-bfd02389cc12 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1520 microversion: 2.1 time: 0.404788 Sep 03 21:05:25.855815 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2143/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:25 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:25.883851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:25.884492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:25.895082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.905368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.906040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.906886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:25.907571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:25.908199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:25.948372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:25.965980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] HTTP exception thrown: Action 999 not found Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Request method failure captured: Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4/os-instance-actions/999 HTTP/1.1 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8GA-NwOOTU6UmMavZGiINNI2Ylei-lLlu8dM-iwe16LUW9ng_yy2Bxg7ze6p-uvtxp_6fds_qSDfIrwyBduBuhctEKCYH8OW872H4nQaApM6MrKG6e9siI-WXUxP3DyicbLenH7E-5bPmIHQWIQdlPUkJmbT8s3UAzl7yDZOt0wOI8 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9995a4ecc0ec4f97a46ea58fa158ee61 Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: exception: Action 999 not found Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': '0688803c-4688-480f-97bf-721ae1d95dc4', 'id': '999'} Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 03 21:05:25.976251 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:25.979473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Returning 404 to user: Action 999 not found {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:25.979473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1bc978d-1b89-4207-a0e9-0fee10696b50 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.099288 Sep 03 21:05:25.979473 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2144/4076] 10.222.0.16 () {58 vars in 1308 bytes} [Sat Sep 3 21:05:25 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4/os-instance-actions/999 => generated 66 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 03 21:05:25.988404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '.version_select at 0x7fae66a27a60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:25.989024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 9e445ff1-b190-43ca-88f6-74d713b3189c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:26.003116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] HTTP exception thrown: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Request method failure captured: Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/9e445ff1-b190-43ca-88f6-74d713b3189c/os-instance-actions HTTP/1.1 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8GA-NwOOTU6UmMavZGiINNI2Ylei-lLlu8dM-iwe16LUW9ng_yy2Bxg7ze6p-uvtxp_6fds_qSDfIrwyBduBuhctEKCYH8OW872H4nQaApM6MrKG6e9siI-WXUxP3DyicbLenH7E-5bPmIHQWIQdlPUkJmbT8s3UAzl7yDZOt0wOI8 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9995a4ecc0ec4f97a46ea58fa158ee61 Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': '9e445ff1-b190-43ca-88f6-74d713b3189c'} Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:26.006852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Returning 404 to user: Instance 9e445ff1-b190-43ca-88f6-74d713b3189c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-417176ec-1a44-4565-a549-64c16024deda tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/9e445ff1-b190-43ca-88f6-74d713b3189c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024721 Sep 03 21:05:26.010398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2145/4077] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Sep 3 21:05:25 2022] GET /compute/v2.1/servers/9e445ff1-b190-43ca-88f6-74d713b3189c/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:26.020666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:26.021461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:26.030804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.031547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.032077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.033425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.035026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.035658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.074040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:26.219664 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7369103c-4970-4698-98f2-387bd9aa945f tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 204 len: 0 microversion: 2.1 time: 0.203064 Sep 03 21:05:26.220481 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2146/4078] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:26 2022] DELETE /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:05:26.234982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:26.235535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:26.247164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.248092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.248923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.250078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.250866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.251891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.304727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:26.439036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:26.448850 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42ef632d-3ff4-4ef1-b7bf-bf25e06c6208 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.644694 Sep 03 21:05:26.453226 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1933/4079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:25 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:26.579496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:26.595054 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d05354cc-d50a-46e3-a67e-90542d12cd30 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1526 microversion: 2.1 time: 0.369174 Sep 03 21:05:26.598147 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2147/4080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:26 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1526 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:26.695073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72aaae0-5984-4c46-977c-e6c266155662", "tag": "bbe34038-60ae-4fe8-9343-c0785feb8542"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:26.714630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:26.715412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:26.746994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.750024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.750358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.750959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.751705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.753311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.756135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:26.757150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:26.757797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:26.777352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] Creating event network-changed:bbe34038-60ae-4fe8-9343-c0785feb8542 for instance f72aaae0-5984-4c46-977c-e6c266155662 on nch1-master-1 Sep 03 21:05:26.806091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c3ca503d-b50c-48d0-b713-f2bb88d6e19d req-cf2b26e5-df5c-4219-9d49-3647aa3a532a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111205 Sep 03 21:05:26.807357 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1934/4081] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:26.962379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:26.973951 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca0c88fc-7baa-4613-bf19-df06827f0b4b tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.268778 Sep 03 21:05:26.990689 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2148/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:26 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:27.477575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:27.478515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:27.494084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:27.495213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:27.497773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:27.500379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:27.500952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:27.502804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:27.627295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:27.628707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:27.647227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:27.648295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:27.648746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:27.656843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:27.657610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:27.658063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:27.772121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:27.788868 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fea22c2a-7849-4eed-883c-e2927de233b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.316597 Sep 03 21:05:27.800056 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1935/4083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:27 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:27.848151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52ce559-847c-4d55-b3d6-7d0e5009c31f", "name": "network-vif-plugged", "status": "completed", "tag": "b8534ca6-0698-4369-adb7-a49a7610ce54"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:27.859357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:27.860208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:27.860792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:27.879029 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] Creating event network-vif-plugged:b8534ca6-0698-4369-adb7-a49a7610ce54 for instance b52ce559-847c-4d55-b3d6-7d0e5009c31f on nch2-master-1 Sep 03 21:05:27.886806 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-06e93efc-6c6b-45fe-9a79-da11af765eb8 req-0aab93bd-8d68-4be9-b734-1d28ea9fe4a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042852 Sep 03 21:05:27.888964 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1936/4084] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:28.004327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:28.005109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:28.018829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:28.020646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:28.021287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:28.022964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:28.024881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:28.025590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:28.049592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:28.057803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:28.066736 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93766023-fb5c-40a6-bb36-4847089d297c tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1526 microversion: 2.1 time: 0.443818 Sep 03 21:05:28.077429 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2149/4085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:27 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:28.383770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:28.396341 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbb332f1-2dff-4e75-af78-0ac0190d02ee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.397588 Sep 03 21:05:28.398625 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1937/4086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:27 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:28.817138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:28.818318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:28.842227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:28.844349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:28.845157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:28.847029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:28.849151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:28.849813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.027089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:29.038493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-075b75d4-6555-411d-8002-f617db213c0b tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1314 microversion: 2.1 time: 0.226057 Sep 03 21:05:29.039591 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2150/4087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:28 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:29.093730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:29.094487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:29.107124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.109107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.112080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.113206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.113799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.114993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.221838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-529976873", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "7961b28e-114e-4e4a-a93a-2a82edc43906"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:29.242857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:29.255018 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ed68fd3-96fb-4833-97ae-af36ff8ea666 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1484 microversion: 2.1 time: 0.165908 Sep 03 21:05:29.268924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2151/4088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:29 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1484 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:29.268924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0688803c-4688-480f-97bf-721ae1d95dc4", "name": "network-vif-deleted", "tag": "1e87df45-cca7-4590-87f2-d6498c6861f4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:29.271419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:29.274472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.275246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.276528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.309877 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] Creating event network-vif-deleted:1e87df45-cca7-4590-87f2-d6498c6861f4 for instance 0688803c-4688-480f-97bf-721ae1d95dc4 on nch1-master-1 Sep 03 21:05:29.317332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-40b3e9d2-cc9d-47c7-a5ec-8b0a008a7748 req-d0531868-455c-47dc-bbec-82608fd41124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059853 Sep 03 21:05:29.318377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2152/4089] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:29.355327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] validate_networks() for [('7961b28e-114e-4e4a-a93a-2a82edc43906', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:05:29.425150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:29.425861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:29.434676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.435815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.436275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.437021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.437486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.438746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.637091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:29.651871 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df93a4cf-3d4d-4449-bca3-d316a835faed tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.230832 Sep 03 21:05:29.652653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2153/4090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:29 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:29.818036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:05:29.818695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:05:29.819187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:05:29.820614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:05:29.821094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:05:29.835894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.836392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.836846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.837643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:29.838111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:29.838834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:29.860138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Getting quotas for project 312be4c9cb134ff08513dc95f5acf30f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:05:29.868571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Getting quotas for user 50a47947e44b4e8f8562231df4ada9ae and project 312be4c9cb134ff08513dc95f5acf30f. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:05:29.871161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:29.886536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:05:29.888981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:05:29.940622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b07aa88-8624-49ba-af89-8a2b9b592d46 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999623 Sep 03 21:05:29.941374 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1938/4091] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:05:29.954242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b68ea96-8236-4e3e-8cf7-568abe44b259 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:29.954939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6b68ea96-8236-4e3e-8cf7-568abe44b259 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:30.040048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6b68ea96-8236-4e3e-8cf7-568abe44b259 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:30.051136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6b68ea96-8236-4e3e-8cf7-568abe44b259 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1213 microversion: 2.1 time: 0.100553 Sep 03 21:05:30.052241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2154/4092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:29 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:30.069237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:30.072226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:30.080930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.081242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.081686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.082400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.082866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.083288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.247422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:30.255879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-679ff7d0-67f8-4966-a745-8bb999fdb5d3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1501 microversion: 2.1 time: 0.192099 Sep 03 21:05:30.256487 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1939/4093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:30 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:30.284004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:30.290557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:30.291249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:30.298373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.298864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.299567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.300476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.307691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.308202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.308650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.312557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.313249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.367812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:05:30.434751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:30.446339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-643827dd-40c5-4e8b-8e33-f00baf9e7703 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f/action" status: 202 len: 0 microversion: 2.1 time: 0.168244 Sep 03 21:05:30.446626 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0cc1e056-c196-49d2-8dec-42eda5266f3d tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1484 microversion: 2.1 time: 0.161466 Sep 03 21:05:30.447318 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1940/4094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:30 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1484 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:30.450360 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2155/4095] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:05:30 2022] POST /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:05:30.457369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:30.458335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:30.465365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.465859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.466623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.467519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.467976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.468408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.659294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:30.672577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-970cc73a-0e09-465e-b5aa-ff67ff7901c0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.221089 Sep 03 21:05:30.674389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1941/4096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:30 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:30.688754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:30.696268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:30.703665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.704466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.705727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.706714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:30.708706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:30.709411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:30.893409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:30.902405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84b7173b-feda-4ada-b5ef-d153bd5741f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.230517 Sep 03 21:05:30.903373 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2156/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:30 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:31.078812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:31.080731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:31.095264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.096201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.096857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.097833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.098751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.099387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.176097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:31.188667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-88baf730-390d-4f68-acd7-5be06c488157 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1265 microversion: 2.1 time: 0.114857 Sep 03 21:05:31.190099 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1942/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:31 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:31.475189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:31.476110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:31.491993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.493445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.494150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.494994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.495573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.496258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.540999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.541664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.542215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.542968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lazy-loading 'fault' on Instance uuid 0688803c-4688-480f-97bf-721ae1d95dc4 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:05:31.604146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:31.613403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9995a4ecc0ec4f97a46ea58fa158ee61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6b7140c9474bf5b0f1e6d1618a7937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:31.643160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c6a73be-5e0d-4216-9018-2aac628502a3 tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 200 len: 1314 microversion: 2.1 time: 0.172295 Sep 03 21:05:31.644716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2157/4099] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:31 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:31.704721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:31.706965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:31.726831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.731351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.733446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.736771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.737522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.739089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.750479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:31.932754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:31.933667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:31.945243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.946062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.946652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:31.947538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:31.948103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:31.949357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:32.026155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:32.036804 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27fcba91-277b-4575-b871-44e1a4482665 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.336863 Sep 03 21:05:32.037639 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1943/4100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:31 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:32.157787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:32.167012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72f94cb7-762c-4fad-9f6f-dbaba4a27047 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.243685 Sep 03 21:05:32.177058 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2158/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:31 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:32.216405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:32.216965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:32.225718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:32.226524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:32.227202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:32.228196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:32.229000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:32.229981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:32.317435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:32.329810 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ca94e81-2f44-4fb8-83c5-c8b0641062ba tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1271 microversion: 2.1 time: 0.116245 Sep 03 21:05:32.331158 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1944/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:32 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:32.667772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:32.668597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] [instance: 0688803c-4688-480f-97bf-721ae1d95dc4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:32.677950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:32.678685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:32.679780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:32.680732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:32.681389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:32.681998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:32.704573 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] HTTP exception thrown: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Request method failure captured: Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 HTTP/1.1 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8GA-NwOOTU6UmMavZGiINNI2Ylei-lLlu8dM-iwe16LUW9ng_yy2Bxg7ze6p-uvtxp_6fds_qSDfIrwyBduBuhctEKCYH8OW872H4nQaApM6MrKG6e9siI-WXUxP3DyicbLenH7E-5bPmIHQWIQdlPUkJmbT8s3UAzl7yDZOt0wOI8 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c6b7140c9474bf5b0f1e6d1618a7937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 7c6b7140c9474bf5b0f1e6d1618a7937 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-703502785 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9995a4ecc0ec4f97a46ea58fa158ee61 Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-703502785-project Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '0688803c-4688-480f-97bf-721ae1d95dc4'} Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:32.707517 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. Sep 03 21:05:32.710544 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:32.716832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] Returning 404 to user: Instance 0688803c-4688-480f-97bf-721ae1d95dc4 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:32.721918 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-76d18d2f-1f28-424a-b63b-b9f4e71ca6ad tempest-InstanceActionsNegativeTestJSON-703502785 tempest-InstanceActionsNegativeTestJSON-703502785-project] 10.222.0.16 "GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4" status: 404 len: 111 microversion: 2.1 time: 0.058552 Sep 03 21:05:32.722602 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2159/4103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:32 2022] GET /compute/v2.1/servers/0688803c-4688-480f-97bf-721ae1d95dc4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:33.063679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:33.064244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:33.072699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.073235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.073694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.074483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.075157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.075603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.190515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:33.191384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:33.200880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.201739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.202386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.203306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.203961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.204616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.400070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:33.413023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b5b7211-acb5-4bd5-b566-bc3c8480b9d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.351130 Sep 03 21:05:33.418375 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1945/4104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:33 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:33.428987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:33.431561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:33.447841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.448597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.449293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.454141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.454920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.455858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.529630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:33.540384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a3027829-b408-41cf-ba4c-aeef2063c950 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.353811 Sep 03 21:05:33.542720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2160/4105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:33 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:33.773403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:33.789699 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea13ed82-f65a-4ce8-a70a-d0884c01f50a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.368507 Sep 03 21:05:33.791423 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1946/4106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:33 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:33.836278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c632eba-1830-4227-8421-e7c4e459e2c1", "tag": "1cd7534f-9c00-4c84-bbb1-345ff2749842"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:33.860928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:33.861941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:33.862605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:33.876441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] Creating event network-changed:1cd7534f-9c00-4c84-bbb1-345ff2749842 for instance 5c632eba-1830-4227-8421-e7c4e459e2c1 on nch2-master-1 Sep 03 21:05:33.884377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-03077db0-4ff7-4e0f-97f6-85d5663360f3 req-f539ac6e-9d7d-4d77-851f-6fd14d783abb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051811 Sep 03 21:05:33.885781 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2161/4107] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:34.446954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:34.448519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:34.473896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.475142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.476523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.478596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.480194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.482167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.565607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:34.567182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:34.591554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.592070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.593286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.594022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.594497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.594945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.660328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:34.669845 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f140bf0-bbe2-48e2-be1f-ef80e358231f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.228521 Sep 03 21:05:34.670859 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1947/4108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:34 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:34.814152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:34.815085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:34.824103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.824932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.825624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.826556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:34.827228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:34.827990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:34.878106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:34.890408 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd4d5f86-4e7b-4ea7-93e3-a6f6a3adebee tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.330525 Sep 03 21:05:34.891350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2162/4109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:34 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:35.108408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:35.118474 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5569a857-0592-4e06-8f60-0c3db0814101 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.308137 Sep 03 21:05:35.119751 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1948/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:34 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:35.635143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72aaae0-5984-4c46-977c-e6c266155662", "name": "network-vif-plugged", "status": "completed", "tag": "bbe34038-60ae-4fe8-9343-c0785feb8542"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:35.647122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:35.654483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:35.655197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:35.688540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] Creating event network-vif-plugged:bbe34038-60ae-4fe8-9343-c0785feb8542 for instance f72aaae0-5984-4c46-977c-e6c266155662 on nch1-master-1 Sep 03 21:05:35.692593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:35.693460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:35.703066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e21a2dbc-43de-4114-9da8-bf99cd6e64df req-c89236d9-e991-451f-b835-a3dedc6e4a94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071304 Sep 03 21:05:35.705332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2163/4111] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:35.711667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:35.712276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:35.712740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:35.716154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:35.716666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:35.717144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:35.919834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:35.920555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:35.927953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:35.928786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:35.929426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:35.930319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:35.930935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:35.931524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:36.155035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:36.167902 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7dcedc6a-0f71-4cf6-99cc-4e73cf96d864 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.251348 Sep 03 21:05:36.169508 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2164/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:35 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:36.175212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:36.176166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:36.183213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:36.183728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:36.184196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:36.184920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:36.185392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:36.185820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:36.336983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:36.341429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:36.350656 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13905fd6-6e21-4ee2-82dd-2c179986e6ab tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.179746 Sep 03 21:05:36.364936 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da2bda02-4466-41fd-b14a-2dfd7122fa9f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.663837 Sep 03 21:05:36.364936 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1949/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:35 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:36.365189 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2165/4114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:36 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:37.191580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:37.192202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:37.203906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.206911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.209266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.210306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.212480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.213755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.377037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:37.384055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:37.403240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.403988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.404633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.407627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.409298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.417305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.443466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:37.454373 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9d7cf1be-f8b5-4797-9e03-3ddd87af4395 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1324 microversion: 2.1 time: 0.265236 Sep 03 21:05:37.454984 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1950/4115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:37 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:37.476583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:37.477570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:37.488178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.489120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.489767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.490758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:37.491626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:37.492261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:37.639971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:37.654918 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e235a39-9900-4ff5-9d8c-a16948a0b3b7 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.282877 Sep 03 21:05:37.655759 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2166/4116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:37 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:37.731957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:37.765986 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e38eeb7a-e12e-47b4-9f3c-ca748c4fe6fd tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.293716 Sep 03 21:05:37.777575 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1951/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:37 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:38.483606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:38.485251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:38.496475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.497281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.505655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.512757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.512757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.513419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.634246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c632eba-1830-4227-8421-e7c4e459e2c1", "name": "network-vif-plugged", "status": "completed", "tag": "1cd7534f-9c00-4c84-bbb1-345ff2749842"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:38.668830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:38.680546 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cc8641a6-199b-429d-8019-d728c2105bc8 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1521 microversion: 2.1 time: 0.204827 Sep 03 21:05:38.685034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.697106 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2167/4118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:38 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:38.697106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:38.697106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:38.705770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.706599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.707455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.709286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.711943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.713597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.714257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.728502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.738673 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] Creating event network-vif-plugged:1cd7534f-9c00-4c84-bbb1-345ff2749842 for instance 5c632eba-1830-4227-8421-e7c4e459e2c1 on nch2-master-1 Sep 03 21:05:38.746792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-028d7e2d-d613-47cb-b403-563af8fed0a3 req-26d5cee5-f457-4ab3-9387-d977260c6869 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117007 Sep 03 21:05:38.747929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1952/4119] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:38.762166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:38.762902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:38.778138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.778828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.779417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.780274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.781169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.781752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.819748 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] HTTP exception thrown: Instance is not a member of specified network Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Request method failure captured: Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662/ips/invalid HTTP/1.1 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8GQcr7jLFjkC-0V8wpFM5ritHlOiIIPF4mVp3eXRmN9lgs9erSckI7qKWLPWrrVnCoE0t7oEiCiF3BQ1NMDKhG11IBwXlwIFU2oo8WfAsJEl1lYj0xiyBkob9ivi7ii_uRl7TRkFuntUT8_6mhqIPy1iFZtWZy1L_qCQzrO-EU7KYo Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94e570d13568401c8fe5191706d80a75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94e570d13568401c8fe5191706d80a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 43d940c1853e4d4aa86f6f4c61d95109 Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance is not a member of specified network Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'server_id': 'f72aaae0-5984-4c46-977c-e6c266155662', 'id': 'invalid'} Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 03 21:05:38.828766 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:38.838975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:38.838975 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f84d43a5-b070-40e8-a986-2c086f9d4fb7 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.081124 Sep 03 21:05:38.838975 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1953/4120] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:05:38 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662/ips/invalid => generated 91 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:05:38.838975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:38.838975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:38.845818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.846475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.846779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.847622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:38.849014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:38.849463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:38.998099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:39.002721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:39.024200 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f6e762b3-29cf-4c80-a29e-44be6f4aa570 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.335902 Sep 03 21:05:39.024841 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2168/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:38 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:39.034796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:39.036427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Failed to fetch instance by id 999 {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 21:05:39.037746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] HTTP exception thrown: Instance 999 could not be found. Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Request method failure captured: Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8GQcr7jLFjkC-0V8wpFM5ritHlOiIIPF4mVp3eXRmN9lgs9erSckI7qKWLPWrrVnCoE0t7oEiCiF3BQ1NMDKhG11IBwXlwIFU2oo8WfAsJEl1lYj0xiyBkob9ivi7ii_uRl7TRkFuntUT8_6mhqIPy1iFZtWZy1L_qCQzrO-EU7KYo Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94e570d13568401c8fe5191706d80a75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94e570d13568401c8fe5191706d80a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 43d940c1853e4d4aa86f6f4c61d95109 Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 999 could not be found. Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'server_id': '999'} Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 03 21:05:39.040637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:39.045761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:39.046781 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-34c8814f-e499-4b3b-bce4-53ef714a9fe5 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019829 Sep 03 21:05:39.047825 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2169/4122] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Sep 3 21:05:39 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:05:39.062427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:39.063185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:39.075594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.079835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.080832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:39.081716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.084032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.085208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:39.101339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:39.113715 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-92c285d4-3718-47c4-8832-810d58ef0962 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.279618 Sep 03 21:05:39.114298 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1954/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:38 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:39.153441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:39.277228 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00c065e6-d288-4ea9-88cb-58435c973285 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 204 len: 0 microversion: 2.1 time: 0.222300 Sep 03 21:05:39.278725 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2170/4124] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:39 2022] DELETE /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:05:39.286843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:39.287461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:39.303199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.304267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.304922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:39.305634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.306281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.306720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:39.485513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:39.494802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2c4c259-5a23-4f9a-b229-307312dda709 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1527 microversion: 2.1 time: 0.211766 Sep 03 21:05:39.495382 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1955/4125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:39 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1527 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:39.860782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:39.861552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:39.868555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.869070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.869513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:39.870215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:39.870674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:39.871106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.047778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:40.053389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:40.054109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:40.057000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:40.057676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:40.064025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.064522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.064991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.065700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.066320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.066755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.079273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:40.096642 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-349b600d-bb74-4646-b776-dd8432836c34 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.240100 Sep 03 21:05:40.109915 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2171/4126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:39 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:40.142061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:40.142873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:40.149746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.150214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.150652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.151368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.151825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.152255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.336021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:40.347642 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a198af7b-c287-4400-b7c2-9d898dcb5a57 tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1313 microversion: 2.1 time: 0.298040 Sep 03 21:05:40.365407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1956/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:40 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:40.519567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:40.521013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:40.531004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.531806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.532488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.533472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:40.533973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:40.534456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:40.643215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:40.654766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c1a5ca1-858b-41bf-b2db-b92423bd9286 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.515481 Sep 03 21:05:40.673848 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2172/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:40 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:40.755896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:40.764322 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b77851e-7e34-4531-baa9-4b71ba2e9f15 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1527 microversion: 2.1 time: 0.249308 Sep 03 21:05:40.765279 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1957/4129] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:40 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1527 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:41.122673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:41.123924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:41.136621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.137700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.138326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.139138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.139935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.140695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.282657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:41.292415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-adbb78f7-c423-481f-8239-9f80e0f3732a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.173797 Sep 03 21:05:41.293020 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2173/4130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:41 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:41.318328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1710164647"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:41.321143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:41.327389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.328073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.328545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.329291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.329782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.330434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.373015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:41.373713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:41.380265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.381025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.382068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.382831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.383367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.383867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.541010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:41.543838 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4839d2d6-30cf-45ec-bbaa-fc4be50b3fa6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.230378 Sep 03 21:05:41.547842 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1958/4131] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:05:41 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 03 21:05:41.564874 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a8c65cc-7525-49fe-96f8-6c8a2e921dde tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1497 microversion: 2.1 time: 0.195736 Sep 03 21:05:41.582103 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2174/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:41 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:41.679337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:41.680475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:41.687600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.688429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.689227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.690344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.691022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.691666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.718664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:41.790451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:41.791174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:41.816221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.817165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.817830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.819779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:41.820267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:41.820845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:41.923895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d940c1853e4d4aa86f6f4c61d95109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e570d13568401c8fe5191706d80a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:41.946582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-709ab722-b466-4850-8e8f-c36ddc68d69d tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 200 len: 1485 microversion: 2.1 time: 0.162770 Sep 03 21:05:41.948992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2175/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:41 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 1485 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:42.027095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72aaae0-5984-4c46-977c-e6c266155662", "name": "network-vif-deleted", "tag": "bbe34038-60ae-4fe8-9343-c0785feb8542"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:42.043510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:42.044002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:42.044445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:42.058005 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] Creating event network-vif-deleted:bbe34038-60ae-4fe8-9343-c0785feb8542 for instance f72aaae0-5984-4c46-977c-e6c266155662 on nch1-master-1 Sep 03 21:05:42.063671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a6ad697f-3059-49b9-9b3d-2e97569fbd77 req-2c43737a-ace1-408c-91ef-5aec27672e77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040575 Sep 03 21:05:42.064803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2176/4134] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:42.104204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:42.112729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa5931d8-55a7-497d-a076-cd1ad5a14c54 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.438243 Sep 03 21:05:42.113355 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1959/4135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:41 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:42.973949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:42.974911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] [instance: f72aaae0-5984-4c46-977c-e6c266155662] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:42.984815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:42.986161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:42.986606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:42.987973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:42.988444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:42.989416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.005682 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] HTTP exception thrown: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Request method failure captured: Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 HTTP/1.1 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8GQcr7jLFjkC-0V8wpFM5ritHlOiIIPF4mVp3eXRmN9lgs9erSckI7qKWLPWrrVnCoE0t7oEiCiF3BQ1NMDKhG11IBwXlwIFU2oo8WfAsJEl1lYj0xiyBkob9ivi7ii_uRl7TRkFuntUT8_6mhqIPy1iFZtWZy1L_qCQzrO-EU7KYo Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94e570d13568401c8fe5191706d80a75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94e570d13568401c8fe5191706d80a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94e570d13568401c8fe5191706d80a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 94e570d13568401c8fe5191706d80a75 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-940917470 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 43d940c1853e4d4aa86f6f4c61d95109 Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-940917470-project Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f72aaae0-5984-4c46-977c-e6c266155662'} Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:43.008129 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] Returning 404 to user: Instance f72aaae0-5984-4c46-977c-e6c266155662 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:43.012048 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc4cfe2a-bb2f-4d25-a32c-99c1944f00f9 tempest-ServerAddressesNegativeTestJSON-940917470 tempest-ServerAddressesNegativeTestJSON-940917470-project] 10.222.0.16 "GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662" status: 404 len: 111 microversion: 2.1 time: 0.041743 Sep 03 21:05:43.021039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2177/4136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:42 2022] GET /compute/v2.1/servers/f72aaae0-5984-4c46-977c-e6c266155662 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:43.072688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:43.073970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:43.082861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.083984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.084653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.086110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.086773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.087407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.115195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:43.148372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:43.149033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:43.161361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.161878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.169532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.170670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.172810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.174320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.286705 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf202b0b-f34e-4a09-b637-cedace49654a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 204 len: 0 microversion: 2.1 time: 0.218278 Sep 03 21:05:43.288946 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1960/4137] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:43 2022] DELETE /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:05:43.300162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:43.301081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:43.307287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.307832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.308239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.308990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:43.309461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:43.309899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:43.526636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:43.535715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b00edc2-6057-45cc-abbb-fcb954580fc8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.395551 Sep 03 21:05:43.536995 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2178/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:43 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:43.624416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:43.635615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-254cc1c4-8f79-4eab-8a56-e11e4525aede tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1503 microversion: 2.1 time: 0.341677 Sep 03 21:05:43.636214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1961/4139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:43 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:44.560059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:44.560683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:44.577747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:44.578485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:44.578933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:44.579678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:44.580142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:44.580573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:44.668250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:44.670675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:44.684757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:44.685516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:44.686183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:44.687207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:44.687845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:44.689445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:44.896233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:44.905719 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5ce06f82-65c2-4dc5-b335-1142ef22686d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.349517 Sep 03 21:05:44.907739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2179/4140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:44 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:45.110066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:45.112613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1262776540", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:45.119335 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-075e2639-8c40-4b83-9f4d-55fc289a794e tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1503 microversion: 2.1 time: 0.459514 Sep 03 21:05:45.120456 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1962/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:44 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:45.197501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] validate_networks() for [('88aba021-fa76-431c-95c8-e82bb6055079', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:05:45.570157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:45.588662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:45.589227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:45.589683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:45.619746 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] Creating event network-vif-unplugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:05:45.640251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-773455e1-77fc-41f5-86fa-58dbfc7b5e87 req-6aeb2b88-e52d-46f6-956b-8a941821a57d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074204 Sep 03 21:05:45.641368 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1963/4142] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:45.734521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:05:45.735039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:05:45.735525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:05:45.735945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:05:45.736385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:05:45.753942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:45.754669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:45.755348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:45.756458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:45.757599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:45.758183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:45.784048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Getting quotas for project 79959bbc9a594e1f81d7e60e5d175e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:05:45.791658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Getting quotas for user fb144426dd4a46caa03a9ebe77e95c4c and project 79959bbc9a594e1f81d7e60e5d175e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:05:45.806655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:05:45.809500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:05:45.877171 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b85539d9-3d74-4864-aad4-2b030ed7c7c4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.900768 Sep 03 21:05:45.877871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2180/4143] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:05:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:05:45.892918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8e354b3-03a8-4acf-b71c-b2d8bb3ac22a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:45.895055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8e354b3-03a8-4acf-b71c-b2d8bb3ac22a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:45.938716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:45.939559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:45.951665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:45.952244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:45.952698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:45.953764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:45.954237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:45.954738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:46.079528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8e354b3-03a8-4acf-b71c-b2d8bb3ac22a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:46.095061 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8e354b3-03a8-4acf-b71c-b2d8bb3ac22a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1214 microversion: 2.1 time: 0.209339 Sep 03 21:05:46.106704 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1964/4144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:45 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:46.133906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c632eba-1830-4227-8421-e7c4e459e2c1", "name": "network-vif-deleted", "tag": "1cd7534f-9c00-4c84-bbb1-345ff2749842"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:46.166018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:46.166655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:46.167346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:46.194948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:46.203649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f64dfb5-fe5e-4b2e-9378-3bcfaa97c931 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.272473 Sep 03 21:05:46.207234 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2181/4145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:45 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:46.215258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] Creating event network-vif-deleted:1cd7534f-9c00-4c84-bbb1-345ff2749842 for instance 5c632eba-1830-4227-8421-e7c4e459e2c1 on nch2-master-1 Sep 03 21:05:46.217132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:46.221377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:46.223972 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b07c90e8-2b9e-436b-a9f1-720b89d39ac1 req-fcc1bab2-bffb-4864-a188-a3333ca2feed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102346 Sep 03 21:05:46.225823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1965/4146] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:46.238355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:46.244056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:46.244583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:46.246660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:46.247146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:46.249679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:46.327345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:46.327853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:46.328315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:46.328785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lazy-loading 'fault' on Instance uuid 5c632eba-1830-4227-8421-e7c4e459e2c1 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:05:46.457576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a47947e44b4e8f8562231df4ada9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312be4c9cb134ff08513dc95f5acf30f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:46.472934 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b6e2a03-771c-4bd5-9fc8-07b1f32d9dfc tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 200 len: 1303 microversion: 2.1 time: 0.262411 Sep 03 21:05:46.472934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2182/4147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:46 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:47.123635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:47.125287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:47.143939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.144648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.144866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.146863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.147740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.151649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.232607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:47.233305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:47.244830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.245397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.245847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.246583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.247053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.247495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.262743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:47.274274 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb8d48aa-ff55-425f-9012-c85e7ef3bc01 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1266 microversion: 2.1 time: 0.157669 Sep 03 21:05:47.277010 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1966/4148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:47 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:47.498901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:47.502700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] [instance: 5c632eba-1830-4227-8421-e7c4e459e2c1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:47.507108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:47.522985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.525916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.526603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.527554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:47.529561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:47.530248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:47.531893 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2165ed37-a9df-43ae-a866-d24a67378570 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.303842 Sep 03 21:05:47.537540 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2183/4149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:47 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:47.547678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] HTTP exception thrown: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Request method failure captured: Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 HTTP/1.1 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8GWleQTTJdCbSPVGgfFJM6JAKadUHD5lQaoS3jq6hzftJQqMRrgAD-Nshqjf7XNTVzETpFzgRy0e7Js7vpoR-nIOWMzTbqTt7go-L-NlLUPjYXmShDIFvZDo_MrdMXlGnnuXNdZI3QG-Y7IGkYiqPyb2-or2E7ygQzOHW9gfY_4I54 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 312be4c9cb134ff08513dc95f5acf30f Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-VolumesActionsTest-1411961036 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/312be4c9cb134ff08513dc95f5acf30f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_312be4c9cb134ff08513dc95f5acf30f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/312be4c9cb134ff08513dc95f5acf30f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/312be4c9cb134ff08513dc95f5acf30f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-VolumesActionsTest-1411961036 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 312be4c9cb134ff08513dc95f5acf30f Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-VolumesActionsTest-1411961036 Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-VolumesActionsTest-1411961036-project Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 50a47947e44b4e8f8562231df4ada9ae Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-VolumesActionsTest-1411961036-project Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '5c632eba-1830-4227-8421-e7c4e459e2c1'} Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:47.549998 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. Sep 03 21:05:47.554057 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:47.556602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] Returning 404 to user: Instance 5c632eba-1830-4227-8421-e7c4e459e2c1 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:47.557767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3440d4e-eaad-411c-a8a7-54347e4abb8a tempest-VolumesActionsTest-1411961036 tempest-VolumesActionsTest-1411961036-project] 10.222.0.16 "GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1" status: 404 len: 111 microversion: 2.1 time: 0.063266 Sep 03 21:05:47.558438 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1967/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:47 2022] GET /compute/v2.1/servers/5c632eba-1830-4227-8421-e7c4e459e2c1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:05:48.300675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:48.302074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:48.325020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:48.325616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:48.326567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:48.333885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:48.337798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:48.338579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:48.433798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:48.455519 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09be0376-4c3c-4d64-9583-ac1da6649f91 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1272 microversion: 2.1 time: 0.158643 Sep 03 21:05:48.458274 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2184/4151] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:48 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:48.563652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:48.567064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:48.577937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:48.578697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:48.579334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:48.580236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:48.580871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:48.582557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:48.825039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:48.844172 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67fd6e9c-5d33-4004-a306-bdadafbeee09 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.283473 Sep 03 21:05:48.861199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1968/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:48 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:49.486210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:49.486836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:49.504080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:49.504586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:49.505056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:49.505785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:49.506245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:49.506731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:49.804287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:49.820488 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-639265b0-793a-42fd-81cb-60f86917ad64 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.340796 Sep 03 21:05:49.821121 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2185/4153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:49 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:49.873315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:49.873932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:49.914365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:49.918918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:49.919568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:49.920347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:49.924656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:49.926963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:50.147522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-plugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:50.174203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:50.174737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:50.175405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:50.220084 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] Creating event network-vif-plugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:05:50.232085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a48f6689-2c5b-4097-b6a2-e6471aca22b5 req-f1e373a8-2bfb-4f30-9275-d043ba25962c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088413 Sep 03 21:05:50.236204 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2186/4154] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:50.619817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:50.632046 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5849d94-809e-459d-b168-2349a8174fa6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.762304 Sep 03 21:05:50.648631 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1969/4155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:49 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:50.693726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49735f5-cea0-4bae-8708-ce4ef7e646a5", "tag": "472e432f-6933-4569-92c7-0f66d8831b58"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:50.719985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:50.720811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:50.723490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:50.753118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:50.757888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] Creating event network-changed:472e432f-6933-4569-92c7-0f66d8831b58 for instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 on nch1-master-1 Sep 03 21:05:50.787446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-529a0d33-109a-4bec-891a-f4ed12029f81 req-a2f7b378-aa39-4ab1-84f2-b56b4c08aec9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098781 Sep 03 21:05:50.789936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2187/4156] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:50.845656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:50.846307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:50.859137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:50.860003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:50.860549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:50.863797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:50.864291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:50.864732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.163499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:51.188455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:51.188455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Searching by: {'deleted': False, 'project_id': 'a6bda3914676415c8c173972749ef368'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:05:51.204046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.204220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:51.205370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.206070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.207020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.214424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.214634 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d81abd9d-0099-41b5-84ed-60009f9d21a5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.373453 Sep 03 21:05:51.215222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.215921 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1970/4157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:50 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:51.291231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:05:51.375861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-31ddb28c-1133-4f19-83f9-651426526227 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.217495 Sep 03 21:05:51.377298 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2188/4158] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 21:05:51 2022] GET /compute/v2.1/servers => generated 333 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:51.397412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:51.406882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:51.407790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Searching by: {'deleted': False, 'project_id': 'a6bda3914676415c8c173972749ef368'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:05:51.425003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.425501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.425942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.426682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.427140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.427568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.473322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:05:51.536794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:51.545624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.546331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.546928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.659627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:51.661925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:51.669994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.670846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.671511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.672535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:51.673422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:51.674315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:51.793722 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5539352-7a4f-487c-8014-6ab48a4bc36b tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.405093 Sep 03 21:05:51.794245 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1971/4159] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:05:51 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:51.825168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aefd8599-e646-4b47-bc83-c105b80b94ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:51.847669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aefd8599-e646-4b47-bc83-c105b80b94ee tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028374 Sep 03 21:05:51.848534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1972/4160] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:05:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:05:52.158857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:52.159364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:52.177101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.183130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.184133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.185139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.185675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.186179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.249174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:05:52.394718 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-166d4148-d0eb-42e4-a35d-2f7ecef303b7 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 204 len: 0 microversion: 2.1 time: 0.239482 Sep 03 21:05:52.410775 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1973/4161] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:05:52 2022] DELETE /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:05:52.427824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:52.429029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:52.460446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.461283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.462146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:52.463563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.464774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.466826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.469036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.474195 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14ee33c5-5d97-49be-91e7-d337c2374fa5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.817371 Sep 03 21:05:52.477254 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2189/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:51 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:52.486353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:52.487210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:52.496233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:52.498783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.505409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.510840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.512019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:52.533031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:52.534018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:52.777430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:52.791535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-727e16ee-c625-4143-9e77-88852e95b9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.379224 Sep 03 21:05:52.792139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1974/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:52 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:53.037774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:53.057992 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b9e7b5e7-a54c-4ec4-8712-f2efc8a83be4 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1699 microversion: 2.1 time: 0.579493 Sep 03 21:05:53.059993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2190/4164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:52 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1699 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:53.499177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:53.501622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:53.511503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:53.512377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:53.513209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:53.514236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:53.515029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:53.515777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:53.744809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:53.753710 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14e99908-96ee-4f99-90d0-69c6fb9fff35 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.258445 Sep 03 21:05:53.760247 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1975/4165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:53 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:53.818254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:53.819606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:53.839857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:53.846599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:53.847313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:53.848734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:53.849737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:53.851185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:54.088869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:54.090085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:54.118084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:54.124341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:54.125837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:54.133434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:54.134296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:54.135608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:54.140810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:54.252123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:54.266382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7e35b1d-3bd8-43f7-b7f6-963e07c833fc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.452072 Sep 03 21:05:54.267208 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2191/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:53 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:54.784939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:54.785672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:54.798029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:54.798705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:54.799256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:54.800321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:54.801772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:54.802429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:55.107269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:55.125209 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-81f6830f-f048-43f0-9c64-e4781ca6867c tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1699 microversion: 2.1 time: 1.041284 Sep 03 21:05:55.151974 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1976/4167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:54 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1699 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:55.297329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:55.298151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:55.300279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:55.326128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:55.327223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:55.328861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:55.329652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:55.330130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:55.332573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:55.406195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:55.423364 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84f50432-4f5c-402c-beaf-5ae21bbcc3f7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.637587 Sep 03 21:05:55.427970 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2192/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:54 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:55.954784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:55.979134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2f24bfb-af78-4edb-838e-0ce3fe8bd086 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.673287 Sep 03 21:05:55.988228 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1977/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:55 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:56.154576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:56.155854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:56.165822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:56.172634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:56.177530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:56.182095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:56.183211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:56.183846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:56.184443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:56.454589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:56.455223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:56.463322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:56.468383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:56.469043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:56.469957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:56.476930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:56.481509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:56.627373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:56.667536 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b1555bb-e0cc-4f62-9d69-ca7536051651 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1632 microversion: 2.1 time: 0.506401 Sep 03 21:05:56.677254 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2193/4170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:56 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1632 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:56.681901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49735f5-cea0-4bae-8708-ce4ef7e646a5", "name": "network-vif-plugged", "status": "completed", "tag": "472e432f-6933-4569-92c7-0f66d8831b58"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:56.759284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:56.763270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:56.765908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:56.802515 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] Creating event network-vif-plugged:472e432f-6933-4569-92c7-0f66d8831b58 for instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 on nch1-master-1 Sep 03 21:05:56.816302 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c8777ae2-486b-4719-ae01-42fe48c4289b req-72165de2-c93b-4a80-ad47-eecb3dcd9e6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139355 Sep 03 21:05:56.817230 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2194/4171] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:57.020316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:57.022339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:57.047647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:57.049066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:57.051897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:57.053039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:57.061876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:57.062448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:57.449651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:57.462369 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8916ec74-6b4d-49f2-ab1d-0f25d88690e0 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 1.011648 Sep 03 21:05:57.470115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1978/4172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:56 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:57.633744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:57.633744 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e278028e-2efe-44ae-a7b5-2c71dbb54794 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.606697 Sep 03 21:05:57.644357 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2195/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:57 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:57.696387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:57.697055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:57.705625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:57.717989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:57.718471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:57.719241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:57.719722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:57.720152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:57.770047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a209c7e-e10d-4cd6-a180-f9673b66208a", "name": "network-vif-deleted", "tag": "d43c4e7c-cc26-4073-bd0f-ea24d899d75e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:05:57.808006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:57.809161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:57.810834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:57.901818 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] Creating event network-vif-deleted:d43c4e7c-cc26-4073-bd0f-ea24d899d75e for instance 4a209c7e-e10d-4cd6-a180-f9673b66208a on nch2-master-1 Sep 03 21:05:57.915905 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4f1ec690-0f13-4bb5-8087-39a4320ff5a0 req-acb6ddb9-a676-4948-9c03-c00227545198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152176 Sep 03 21:05:57.921227 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2196/4174] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:05:57.987906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6eac3e9b65428ba9430970e9cbccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bda3914676415c8c173972749ef368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:58.025638 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e069c3fc-fdf7-4922-b9d6-4cdd032c3cef tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 200 len: 1632 microversion: 2.1 time: 0.333776 Sep 03 21:05:58.030915 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1979/4175] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:57 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 1632 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:58.503173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:58.505415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:58.517555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:58.518331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:58.518945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:58.519872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:58.520527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:58.521760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:58.648650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:58.649976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:58.660184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:58.664637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:58.667230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:58.671168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:58.674550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:58.679173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:59.200420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:59.212148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3fd76ff8-0170-4d53-b99d-83b1146b7f0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.721388 Sep 03 21:05:59.212911 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2197/4176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:58 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:05:59.231611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:59.232444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:59.240363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:05:59.247932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:59.250737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:59.251581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:59.253957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:59.254582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:59.255836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:59.273306 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf85ae47-b3df-454b-8ae9-0b0c75a5fbb2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1314 microversion: 2.1 time: 0.627178 Sep 03 21:05:59.275038 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1980/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:58 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:05:59.283950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:59.284508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] [instance: 4a209c7e-e10d-4cd6-a180-f9673b66208a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:05:59.293980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:59.294640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:59.295309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:59.296257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:05:59.297462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:05:59.298104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:05:59.326639 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] HTTP exception thrown: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Request method failure captured: Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a HTTP/1.1 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8Fslc6fuSboEqP47vk4_h-I9oFEsuvF77qkr-Gy9wCk5kVpRwykNZLDA9w5FX4g9FOdOZ4mdxXBNTNUetdXV57r6bWojQWyFIbNDtvQQb8GuFk2UUnKBtpUCZmEVe0rLFfRkxybixOpjAbg1U7tH0mcvp4JFLeeyjTCW4BWnPVfvUY Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a6bda3914676415c8c173972749ef368 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-960790184 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6bda3914676415c8c173972749ef368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6bda3914676415c8c173972749ef368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6bda3914676415c8c173972749ef368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6bda3914676415c8c173972749ef368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-960790184 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a6bda3914676415c8c173972749ef368 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-960790184 Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-960790184-project Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ac6eac3e9b65428ba9430970e9cbccaf Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-960790184-project Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4a209c7e-e10d-4cd6-a180-f9673b66208a'} Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:59.330288 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. Sep 03 21:05:59.334307 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:05:59.338124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d6236267-3dd7-45aa-8ba9-6d681e64bc00 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94/ips" status: 200 len: 145 microversion: 2.1 time: 0.123919 Sep 03 21:05:59.339072 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2198/4178] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:05:59 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94/ips => generated 145 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:05:59.342208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Returning 404 to user: Instance 4a209c7e-e10d-4cd6-a180-f9673b66208a could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:05:59.343330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c66e7965-0da7-4add-8213-13be0bd5ef72 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a" status: 404 len: 111 microversion: 2.1 time: 0.066021 Sep 03 21:05:59.345367 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1981/4179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:05:59 2022] GET /compute/v2.1/servers/4a209c7e-e10d-4cd6-a180-f9673b66208a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:05:59.367322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5833343a-c869-4983-84c9-9b0413d14535 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] Calling method '.version_select at 0x7fae65f7b430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:05:59.436049 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5833343a-c869-4983-84c9-9b0413d14535 tempest-ServersTestJSON-960790184 tempest-ServersTestJSON-960790184-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115742647" status: 202 len: 0 microversion: 2.1 time: 0.085643 Sep 03 21:05:59.437067 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2199/4180] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115742647 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:06:00.238693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:00.240325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:00.248272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.249139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.249785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.251382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.254388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.255610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.296646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:00.297320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:00.311690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.312252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.312685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.314698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.316650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.317301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.654942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:00.667726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff7564f6-d9fa-4069-8d24-a42a651d89a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1500 microversion: 2.1 time: 0.375120 Sep 03 21:06:00.668335 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2200/4181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:00 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1500 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:00.788130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:00.800517 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ddbf7f4a-b5b5-40a6-a092-43f4d609331d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1511 microversion: 2.1 time: 0.562835 Sep 03 21:06:00.801743 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1982/4182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:00 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1511 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:00.811269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:00.817366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:00.833668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.835789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.836487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.843350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:00.844009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:00.844679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:00.895247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lazy-loading 'flavor' on Instance uuid c49735f5-cea0-4bae-8708-ce4ef7e646a5 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:01.068858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-56181907", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:01.083881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2da06c84-014b-4337-bb60-df22d1459bb6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "POST /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5/action" status: 200 len: 32 microversion: 2.1 time: 0.280038 Sep 03 21:06:01.086749 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1983/4183] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:00 2022] POST /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:06:01.109730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:01.110444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:01.159696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.173259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.173952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:01.177028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.177522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.178601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:01.248118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:01.300310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:01.455547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:01.478170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:01.498063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-096c0651-d1e3-48b2-85d6-7f2d5b383f6a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.404825 Sep 03 21:06:01.518441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1984/4184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:01 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:01.534372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:01.538333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:01.540643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:01.549550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.550413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.551016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:01.551893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.552560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.553547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:01.597169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:01.814752 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9844a3b-95f1-436b-bee4-b6327ac23939 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 204 len: 0 microversion: 2.1 time: 0.294556 Sep 03 21:06:01.820120 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1985/4185] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:01 2022] DELETE /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:01.829193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:01.830658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:01.844161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.844745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.845339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:01.846382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:01.847149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:01.847598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.074328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:02.091192 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9461153e-d594-45ab-bede-d9d32cf6053c tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1670 microversion: 2.1 time: 0.269116 Sep 03 21:06:02.111528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1986/4186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:01 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:02.128385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:02.138051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:02.150004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.150524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.151347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.152031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.152506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.152970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.412156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:02.423359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d1b8388-420b-4e45-9990-6627ea22f16a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1488 microversion: 2.1 time: 0.310355 Sep 03 21:06:02.424664 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1987/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:02 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1488 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:02.448240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:02.448878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:02.459962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.464081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.467104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.467868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.468344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.468775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.478227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:02.479018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:02.479654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:02.480230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:02.480791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:02.497377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.499198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.499948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.501019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.502320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.503648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.523291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:02.528999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:02.554825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:02.578803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:02.583158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:02.647884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:02.751341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-adac448a-7f00-4d20-b5ee-cd3061a52a1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081825 Sep 03 21:06:02.760839 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2201/4188] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:02.769752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:02.769752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:02.788606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.789480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.790039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.790904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:02.791526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:02.792069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:02.792411 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-deadb5a9-28b3-4c89-bef3-a17d52727679 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 204 len: 0 microversion: 2.1 time: 0.349156 Sep 03 21:06:02.797655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1988/4189] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:02 2022] DELETE /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:06:02.806837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cc3985ed-6f85-4db4-8f53-9ad984b91fc1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:02.811556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cc3985ed-6f85-4db4-8f53-9ad984b91fc1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:03.097175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cc3985ed-6f85-4db4-8f53-9ad984b91fc1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:03.113252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cc3985ed-6f85-4db4-8f53-9ad984b91fc1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1191 microversion: 2.1 time: 0.313244 Sep 03 21:06:03.116692 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1989/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:02 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1191 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:03.132789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:03.140714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:03.180048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:03.184122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:03.187957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:03.192079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:03.194127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:03.194586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:03.411698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:03.421507 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68f75c6c-5d55-4e5b-8697-132528782d6f tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.665315 Sep 03 21:06:03.422415 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2202/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:02 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:03.436514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:03.437524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:03.458552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:03.459650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:03.462576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:03.463606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:03.464553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:03.465329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:03.780179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:03.790314 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a78a6c44-ba86-4014-b6b4-5e9966877059 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1494 microversion: 2.1 time: 0.672390 Sep 03 21:06:03.790907 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1990/4192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:03 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1494 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:04.061877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:04.091765 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56d1a648-c854-455f-926a-c032c4824f04 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1670 microversion: 2.1 time: 0.668262 Sep 03 21:06:04.100736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2203/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:03 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:04.140686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:04.141619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:04.151692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.160265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.161103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.162185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.163632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.168255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.447705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:04.449755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:04.469363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.470345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.471972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.474566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.475933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.476595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.653971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:04.683684 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-10730635-4b32-4222-a319-a887b23ddb58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1187 microversion: 2.1 time: 0.546275 Sep 03 21:06:04.686488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1991/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:04 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1187 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:04.820401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:04.821046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:04.835640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.836509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.839193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.840115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:04.842760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:04.843370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:04.927946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:04.952061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-426a4b1f-c52b-406e-942d-35d89980e153 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.507902 Sep 03 21:06:04.952668 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2204/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:04 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:05.137132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:05.137802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:05.147210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.148010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.148604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:05.149527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.150148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.150738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:05.418618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:05.431738 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19bfd558-038e-47a8-be7f-e02239be5c7b tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1670 microversion: 2.1 time: 0.306562 Sep 03 21:06:05.432549 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2205/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:05 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:05.501085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:05.513323 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f789c8db-3c5a-42b8-9af6-cf1ded8fe0f1 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1494 microversion: 2.1 time: 0.698040 Sep 03 21:06:05.524996 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1992/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:04 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1494 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:05.708110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:05.708737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:05.718607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.719124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.719579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:05.720318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.720791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.721292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:05.822568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:05.835071 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3029d91a-1693-4fc8-9af1-f8b94b2f610c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1249 microversion: 2.1 time: 0.129230 Sep 03 21:06:05.849196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2206/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:05 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:05.981091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:05.997049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.393974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99b545d-35ed-4719-85ed-8f0476fb7c94", "name": "network-vif-unplugged", "status": "completed", "tag": "0a8504b2-d5ec-4da6-bdc5-349e04195d77"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:06.417470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.420576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.421214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.482511 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] Creating event network-vif-unplugged:0a8504b2-d5ec-4da6-bdc5-349e04195d77 for instance c99b545d-35ed-4719-85ed-8f0476fb7c94 on nch1-master-1 Sep 03 21:06:06.508313 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e9e8f932-963a-4d8b-9079-b66118746a07 req-affa918e-a8c6-49f2-b443-c53636b29fb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110323 Sep 03 21:06:06.509353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2207/4199] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:06.515526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:06.522023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:06.539672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.540470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.541141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.542015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.543416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.546440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.559567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:06.669131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:06.680466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18783b91-8763-42fe-9bb4-06d91db15a9c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.703341 Sep 03 21:06:06.691306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1993/4200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:05 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:06.697757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:06.698635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:06.714663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.715364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.717145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.718184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.718843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.719435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.846296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:06.867940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6e9e025c-5399-4d67-984f-005da85a5184 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1670 microversion: 2.1 time: 0.357110 Sep 03 21:06:06.883707 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2208/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:06 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1670 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:06.893820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:06.895268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:06.904567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.905514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.906223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:06.907224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:06.908102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:06.908757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:07.032090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:07.044218 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0d67fbb1-895c-4a46-aa57-2437b438268a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1249 microversion: 2.1 time: 0.159077 Sep 03 21:06:07.046831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2209/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:06 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1249 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:07.106753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:07.117207 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76f50cdf-5e38-4993-b926-4b5b67a20e6c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 200 len: 1452 microversion: 2.1 time: 0.424441 Sep 03 21:06:07.120816 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1994/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:06 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 1452 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:07.144308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52ce559-847c-4d55-b3d6-7d0e5009c31f", "name": "network-vif-deleted", "tag": "b8534ca6-0698-4369-adb7-a49a7610ce54"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:07.189736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:07.198407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:07.199043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:07.253012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] Creating event network-vif-deleted:b8534ca6-0698-4369-adb7-a49a7610ce54 for instance b52ce559-847c-4d55-b3d6-7d0e5009c31f on nch2-master-1 Sep 03 21:06:07.263998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4fae6bda-b478-4e61-b83e-6337cd56cec6 req-e68a4af6-1c2e-48ce-9ba0-bc23a4610438 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125483 Sep 03 21:06:07.264963 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2210/4204] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:07.711247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:07.712057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:07.731082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:07.732608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:07.734193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:07.737569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:07.743995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:07.744666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:07.902743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:07.915025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:07.927722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:07.928536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:07.929251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:07.930880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:07.931568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:07.932703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:08.132823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:08.144025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a4ea12ef-36fc-422c-94cc-586245075161 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1604 microversion: 2.1 time: 0.251158 Sep 03 21:06:08.147762 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2211/4205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:07 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:08.156221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:08.166591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:08.172954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:08.173626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:08.177534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:08.179070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:08.179701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:08.180278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:08.272984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:08.278789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:08.284293 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7122e159-d126-4863-be23-25f3c3e2d11e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1249 microversion: 2.1 time: 0.131939 Sep 03 21:06:08.284883 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2212/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:08 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:08.286887 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c228fe0e-9d80-483a-a865-76474286e9ec tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.581003 Sep 03 21:06:08.291441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:08.292223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:08.292851 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1995/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:07 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:08.306061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:08.309517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:08.312254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:08.313202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:08.314452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:08.315230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:08.343965 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f HTTP/1.1 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b52ce559-847c-4d55-b3d6-7d0e5009c31f'} Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:08.356357 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:08.359770 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:08.364089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:08.366516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eec62300-82ae-4d24-8076-6ea41b88c032 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 404 len: 111 microversion: 2.1 time: 0.080505 Sep 03 21:06:08.369003 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2213/4208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:08 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:08.616520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1745055031", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b618b166-fa4d-46fb-b62d-84fb93da2369"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:08.696817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] validate_networks() for [('b618b166-fa4d-46fb-b62d-84fb93da2369', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:09.178068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:09.178779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:09.190787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.191295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.191758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.192481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.193338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.197214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.266981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.267726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.268319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.269057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lazy-loading 'fault' on Instance uuid c99b545d-35ed-4719-85ed-8f0476fb7c94 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:09.352056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b2dd96d938b41d4ba40007aa072288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a5c2699a4b42f5a60fd808e824296b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:09.377126 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd95b3be-56c6-4e54-b103-d67139a07c16 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 200 len: 1326 microversion: 2.1 time: 0.206120 Sep 03 21:06:09.377736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2214/4209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:09 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 1326 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:09.397990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:09.402344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:09.423293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.425408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.430858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.431849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.432496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.433131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.823952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:09.834659 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-196e45af-5617-4e72-a262-6cb7acc4152f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.455840 Sep 03 21:06:09.839072 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2215/4210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:09 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:09.850179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:09.851183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:09.869092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.869880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.871244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:09.872416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:09.873968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:09.877515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.188428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:10.205552 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb01c613-d679-4374-8437-adc9c0677fbc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.363932 Sep 03 21:06:10.206427 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2216/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:09 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:10.224072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99b545d-35ed-4719-85ed-8f0476fb7c94", "name": "network-vif-deleted", "tag": "0a8504b2-d5ec-4da6-bdc5-349e04195d77"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:10.243314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.243819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.244266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.266170 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] Creating event network-vif-deleted:0a8504b2-d5ec-4da6-bdc5-349e04195d77 for instance c99b545d-35ed-4719-85ed-8f0476fb7c94 on nch1-master-1 Sep 03 21:06:10.275615 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-72221385-5097-4f4d-9396-f04aae0338dd req-2697e1e5-d383-4084-b18e-4c9573b050c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067837 Sep 03 21:06:10.278075 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2217/4212] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:10.406366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:10.407573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:10.443162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.444090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.444773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.446001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.447879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.448458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.487086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 HTTP/1.1 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c99b545d-35ed-4719-85ed-8f0476fb7c94'} Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:10.490963 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:10.494764 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:10.499174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:10.500223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a59c0c9-d180-4700-b2dc-1cf577a04423 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 404 len: 111 microversion: 2.1 time: 0.098599 Sep 03 21:06:10.507295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2218/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:10 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:10.517939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-47cc70ce-2daa-4f62-8a74-ea9025d3ff4a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '.version_select at 0x7fae6689eb80>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:10.554478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-47cc70ce-2daa-4f62-8a74-ea9025d3ff4a tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681708298" status: 202 len: 0 microversion: 2.1 time: 0.045654 Sep 03 21:06:10.555625 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2219/4214] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681708298 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:06:10.780793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:10.781962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:10.782746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:10.783504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:10.785037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:10.817631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.819433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.820858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.823394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.824718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.827619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.867934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:10.868565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:10.892830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.897515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.899174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.902137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:10.904274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:10.904853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:10.942130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:10.962099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Getting quotas for user c3187514ca644ff68c992526f38783c7 and project fde6874e10ae4e12ad874c65942f9d59. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:11.000524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:11.004241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:11.081976 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0008777-d0d9-4cd9-9e8c-71d8c9ff1ece tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477463 Sep 03 21:06:11.088452 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1996/4215] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:11.097263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a509ed2-0652-496b-b615-c3e9e2ed434e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:11.100197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a509ed2-0652-496b-b615-c3e9e2ed434e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:11.279825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a509ed2-0652-496b-b615-c3e9e2ed434e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:11.292032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a509ed2-0652-496b-b615-c3e9e2ed434e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1215 microversion: 2.1 time: 0.199263 Sep 03 21:06:11.293010 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1997/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:11 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:11.300350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:11.314758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:11.328969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:11.329481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:11.333136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:11.334182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:11.337267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:11.337981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:11.434089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:11.446198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f808d45-5558-4d40-a5be-87cc4bdbcb3c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.582314 Sep 03 21:06:11.451920 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2220/4217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:10 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:11.792765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:11.802305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5118d7bc-be59-4d7f-8e60-53748d2e823b tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.508197 Sep 03 21:06:11.808690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1998/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:11 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:12.315741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:12.316370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:12.330442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.331095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.331551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.332278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.334368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.334838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.444141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:12.454964 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3458aef7-53e9-4717-8319-b5024601037e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1219 microversion: 2.1 time: 0.143100 Sep 03 21:06:12.456491 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2221/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:12 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:12.477050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938b2db4-a6e9-49d8-9d37-29eb8c1445e3", "tag": "9bb71d2f-09a6-4c00-9e71-2a010eae96a7"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:12.480964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:12.482718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:12.493325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.494195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.494885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.496028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.497077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.507003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.507498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.507947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.520197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.522391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:12.536091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] Creating event network-changed:9bb71d2f-09a6-4c00-9e71-2a010eae96a7 for instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 on nch2-master-1 Sep 03 21:06:12.554156 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d909f6d4-f7ee-41e2-aceb-a2f3d340818a req-a3398d88-9e9c-4116-89ef-ec97405e032e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080474 Sep 03 21:06:12.567442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 1999/4220] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:12.611948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:12.827353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:12.828058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:12.838943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.839443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.839913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:12.850871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:12.853166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:12.855012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.239502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:13.261356 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fca12302-030a-4a7c-ae19-24409439cf5e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.435486 Sep 03 21:06:13.263182 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2000/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:12 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:13.279237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:13.280067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:13.288242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.289255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.290249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.291869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.292578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.293438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.309205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:13.320330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 HTTP/1.1 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c99b545d-35ed-4719-85ed-8f0476fb7c94'} Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:13.322255 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.325541 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.327186 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38d5b87b-6bbb-4415-b971-b1e6798fdc23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.851209 Sep 03 21:06:13.327800 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2222/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:12 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:13.344505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:13.346442 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1fcbcde7-a805-469e-bad8-58e0cfba4f6d tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 404 len: 111 microversion: 2.1 time: 0.081490 Sep 03 21:06:13.354139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2001/4223] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:13 2022] DELETE /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:13.362036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:13.362683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: c99b545d-35ed-4719-85ed-8f0476fb7c94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:13.374466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.374798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.382607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.383397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.383925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.384367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.422848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 HTTP/1.1 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c99b545d-35ed-4719-85ed-8f0476fb7c94'} Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.424817 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. Sep 03 21:06:13.429502 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.431324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance c99b545d-35ed-4719-85ed-8f0476fb7c94 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:13.433248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-10bd998f-df74-4e1d-8474-6ba2d75b4809 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94" status: 404 len: 111 microversion: 2.1 time: 0.075067 Sep 03 21:06:13.439241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2223/4224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:13 2022] GET /compute/v2.1/servers/c99b545d-35ed-4719-85ed-8f0476fb7c94 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:06:13.491258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:13.492484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:13.501540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.502473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.503215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.506683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.507429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.508038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.687777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:13.696728 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de539702-ebfd-4093-96fb-390d6abf882f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1275 microversion: 2.1 time: 0.212331 Sep 03 21:06:13.702230 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2002/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:13 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1275 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:13.820042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:13.821142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:13.832002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.835751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.836613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.837809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.838497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.843300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.890934 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e HTTP/1.1 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '68d12188-0969-4024-9079-caf96bf2740e'} Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:13.895068 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:13.899294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-416edc3d-a26d-41e1-b852-c342409f4b55 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "DELETE /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 404 len: 111 microversion: 2.1 time: 0.087657 Sep 03 21:06:13.917418 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2224/4226] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:13 2022] DELETE /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:13.925653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:13.926280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] [instance: 68d12188-0969-4024-9079-caf96bf2740e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:13.940656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.941198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.941798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:13.942741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:13.943347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:13.943975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.004935 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] HTTP exception thrown: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Request method failure captured: Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e HTTP/1.1 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DSyPLa-nObuFD3eWizkMpOXIH3LkXb4ZXce8QIsjjn61_aFa1stQ23NCml1qBoVLhPKf-3i8BVtqbOkCkx_m99wr843u5XkSgrhmHhI44oZbDh9tNL3OHxmCfa3R0v5iLQtXS_5Xi-B92jkFBWxzeS2011VXrS02bhos7-pRCAtXc Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a5a5c2699a4b42f5a60fd808e824296b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a5a5c2699a4b42f5a60fd808e824296b Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-653920500 Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 1b2dd96d938b41d4ba40007aa072288b Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeTestJSON-653920500-project Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '68d12188-0969-4024-9079-caf96bf2740e'} Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:14.026285 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] Returning 404 to user: Instance 68d12188-0969-4024-9079-caf96bf2740e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:14.031185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a446d7c4-c5ae-4e58-bbd2-8e5623287a07 tempest-AttachVolumeTestJSON-653920500 tempest-AttachVolumeTestJSON-653920500-project] 10.222.0.16 "GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e" status: 404 len: 111 microversion: 2.1 time: 0.109054 Sep 03 21:06:14.040576 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2003/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:13 2022] GET /compute/v2.1/servers/68d12188-0969-4024-9079-caf96bf2740e => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:14.288493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:14.289534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:14.300731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.310596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.311971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.316548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.320060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.320794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.360873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:14.367520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:14.395099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.395677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.396145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.398275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.400975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.408815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.598783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:14.615504 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2afc18fc-963b-4e73-8991-e6272cad518a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.331376 Sep 03 21:06:14.618677 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2225/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:14 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:14.732945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:14.733851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:14.751645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.756885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.757559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.758979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:14.761889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:14.765161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:14.924550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:14.929194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:14.946814 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-26e376c0-b77c-46cf-af90-34e821890fce tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1273 microversion: 2.1 time: 0.217793 Sep 03 21:06:14.948254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-293c0350-6c1a-4d3a-866e-4a1696633e91 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.590230 Sep 03 21:06:14.950478 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2226/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:14 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:14.952229 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2004/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:14 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:15.645338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:15.646145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:15.654278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:15.655066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:15.655671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:15.656562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:15.657246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:15.657839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:15.981291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:15.986159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:15.986738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:15.999189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.001409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.004248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb16e285-d00d-4239-b9fd-719169db0620 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.359848 Sep 03 21:06:16.005024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.006414 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2227/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:15 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:16.014468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:16.018757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:16.020094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.020771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.025726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.034120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.034939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.035641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.036552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.039280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.039968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.399923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:16.403630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:16.413091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68ef1230-ee6e-439b-bad2-0d0b401c9fcf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.442842 Sep 03 21:06:16.429130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-584beea7-6148-404e-bf53-02e4a28e48df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.412132 Sep 03 21:06:16.429130 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2228/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:16 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:16.430776 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2005/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:15 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:16.431052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:16.434038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:16.462461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.463206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.465324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.466788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.471939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.472679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.539678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:16.775915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:16.785863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab0b6c81-38fd-4c60-8974-31c6fe322888 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.361928 Sep 03 21:06:16.786465 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2229/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:16 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:16.810927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-333197627"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:16.815484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:16.835840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.836616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.837329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.838269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.839105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.839769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.911909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938b2db4-a6e9-49d8-9d37-29eb8c1445e3", "name": "network-vif-plugged", "status": "completed", "tag": "9bb71d2f-09a6-4c00-9e71-2a010eae96a7"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:16.932093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:16.938912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:16.941347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:16.942089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:16.978846 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] Creating event network-vif-plugged:9bb71d2f-09a6-4c00-9e71-2a010eae96a7 for instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 on nch2-master-1 Sep 03 21:06:16.986755 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-80fcdbfb-0611-47f7-b9cd-91c39f0bc6e6 req-5210df5a-31bc-43b0-ab9e-db4211d6dbea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084641 Sep 03 21:06:16.989361 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2230/4235] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:17.038373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:17.041329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:17.070414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.071558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.072255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.074506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.075634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.076382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.395378 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a4d096c0-b746-454a-ab76-24fdde2ff882 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.589131 Sep 03 21:06:17.396086 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2006/4236] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:16 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 03 21:06:17.410778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:17.411672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:17.426936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.429132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.429678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.430467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.431007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.432128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.511067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:17.527231 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46cc0acc-3860-432d-b666-e489e0a1a1fb tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.496606 Sep 03 21:06:17.528389 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2231/4237] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:17 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:17.533188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:17.536116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:17.552111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.553718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.554101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.554821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.555289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.555726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.695153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:17.705644 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a24eebb-33da-422e-beed-5c08141a7668 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.303424 Sep 03 21:06:17.706761 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2007/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:17 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:17.712206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:17.713122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:17.722833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.723752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.724262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.725819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:17.726470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:17.727643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:17.738843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:17.946800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:17.958529 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe74bbc1-5802-4a2e-9ba3-678158e1729c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.250190 Sep 03 21:06:17.959863 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2008/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:17 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:17.973236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:17.986987 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-639c81a6-47a6-4683-9858-554f7bc89f37 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1291 microversion: 2.1 time: 0.456586 Sep 03 21:06:17.987966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2232/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:17 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1291 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:18.012271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c2fc01-5f8d-4349-a92c-6cfe02aeb95b", "tag": "a0936da5-cbbe-44fc-9dd1-a27b1011d74e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:18.039181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:18.039765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:18.040687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:18.060410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] Creating event network-changed:a0936da5-cbbe-44fc-9dd1-a27b1011d74e for instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b on nch1-master-1 Sep 03 21:06:18.078739 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-cb86e1ad-3460-4479-9ee2-1e8f3461f3a5 req-29e8361f-4023-4e31-8c7e-00c8682b821e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070805 Sep 03 21:06:18.082270 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2009/4241] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:18.551300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:18.552640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:18.563823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:18.565417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:18.568520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:18.569722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:18.572856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:18.573883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:18.732172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:18.734104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:18.752029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:18.754356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:18.757534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:18.759513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:18.765850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:18.767312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:19.150143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:19.159355 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6b34800-d832-49c2-af1f-d465eaeb5e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.431991 Sep 03 21:06:19.160687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2010/4242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:18 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:19.169841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:19.171181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:19.178276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:19.179113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:19.179559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:19.180279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:19.180736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:19.181349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:19.393429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:19.413132 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27ab6e24-67c1-47ff-b9a7-f5f18af5a5d5 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.250495 Sep 03 21:06:19.413740 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2011/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:19 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:19.420664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:19.421542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:19.433904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:19.439919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:19.440545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:19.441239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:19.442144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:19.442801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:19.443450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:19.623418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:19.634587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-719a97aa-4a86-44a0-a20d-0b484f2dc3b6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 1.087282 Sep 03 21:06:19.650130 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2233/4244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:18 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:19.892659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:19.914447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-499c4d63-2d97-4920-b2e0-2e67a4f7a92a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1472 microversion: 2.1 time: 0.497356 Sep 03 21:06:19.915462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2012/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:19 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:20.080704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-868111873", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:20.149980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:20.184126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:20.184738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:20.192126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.192809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.194145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.194861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.195644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.196219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.725606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:20.741350 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-176d30d1-87b0-44ba-a5f3-a19746084ef5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.559744 Sep 03 21:06:20.746489 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2013/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:20 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:20.763132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:20.766278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:20.786223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.790357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.793861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.796185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.797121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.798576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.843422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:20.843991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:20.844318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:20.844809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:20.845170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:20.868660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.872883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.873608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.874614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:20.875231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:20.878181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:20.889972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:20.905462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:20.914544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:20.939741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:20.942604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:21.029536 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ef1d804-7d34-418d-8ab8-2a88bef3d2ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952839 Sep 03 21:06:21.036463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2234/4247] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:21.036463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:21.037355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:21.045015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:21.045440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:21.046208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:21.047145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:21.047864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:21.048678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:21.257649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:21.267022 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb46b4b0-1e02-4979-bced-fc717680828c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.235105 Sep 03 21:06:21.268857 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2235/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:21 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:21.274330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b460c4d-e5de-4cc4-8cf8-25fdb9daabc9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:21.275742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b460c4d-e5de-4cc4-8cf8-25fdb9daabc9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:21.285720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:21.302530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b460c4d-e5de-4cc4-8cf8-25fdb9daabc9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:21.612702 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.compute.api [None req-3b460c4d-e5de-4cc4-8cf8-25fdb9daabc9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Instance Mapping does not exist while attempting local delete cleanup. Sep 03 21:06:21.613925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b460c4d-e5de-4cc4-8cf8-25fdb9daabc9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab" status: 204 len: 0 microversion: 2.1 time: 0.343842 Sep 03 21:06:21.614718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2236/4249] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:21 2022] DELETE /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:21.621700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:21.635092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:21.635904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:21.636582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:21.652401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] Creating event network-vif-unplugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:06:21.658368 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8dabdb26-21b1-4154-a54f-166207ff82f1 req-8ce1c8e8-6a4e-4a71-80b3-b5e020f44182 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041364 Sep 03 21:06:21.659332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2237/4250] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:21.665204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:21.665918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:21.672503 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab HTTP/1.1 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '8bd772af-c3b3-43e9-a01e-140c548b82ab'} Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:21.674814 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:21.679088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:21.679088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:21.679088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:21.679088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:06:21.679088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:21.681290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:21.682616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11d53cf0-aed3-4a06-8276-4b93d364d2e6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab" status: 404 len: 111 microversion: 2.1 time: 0.021523 Sep 03 21:06:21.685417 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2238/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:21 2022] GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:21.685631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:21.715054 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2c91056-433f-4220-b318-b6af36492395 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.963943 Sep 03 21:06:21.718638 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2014/4252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:20 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:21.754855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2054171121", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:21.774491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:21.775435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:21.783970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:21.784470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:21.784936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:21.786028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:21.786653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:21.787840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:21.843537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:22.229660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:22.241104 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3cc3030e-c691-478e-9a60-14d13bffb088 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.470751 Sep 03 21:06:22.242650 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2015/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:21 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:22.296885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:22.300358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:22.317485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.317995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.324814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.325928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.326642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.327275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.552107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:22.558979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:22.559994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:22.561331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:22.561953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:22.585986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.589590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.591260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.599465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.601114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.602382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.640870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:22.649613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:22.672003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:22.676090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:22.751537 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2dc8ddf0-2515-49a3-96c4-99e7252ae944 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002404 Sep 03 21:06:22.752042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:22.753169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2239/4254] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:22.761309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16c199b4-6c5a-4486-8723-34203a95048a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.469616 Sep 03 21:06:22.762125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:22.763121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:22.764316 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2016/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:22 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:22.773580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.774554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.775233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.776183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:22.776874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:22.777698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:22.779071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea3b50ce-690a-4e14-829d-3bad653736a5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:22.779689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea3b50ce-690a-4e14-829d-3bad653736a5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:22.947142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea3b50ce-690a-4e14-829d-3bad653736a5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:22.961578 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea3b50ce-690a-4e14-829d-3bad653736a5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1221 microversion: 2.1 time: 0.195997 Sep 03 21:06:22.963013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2017/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:22 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:23.110110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:23.123988 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1459e674-21b6-46f0-903e-cd870ebbbc93 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.368398 Sep 03 21:06:23.136919 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2240/4257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:22 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:23.270991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:23.275279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:23.300511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:23.302179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:23.303038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:23.303671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:23.304137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:23.308000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:23.649898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:23.663207 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-affb3a3b-4390-48ce-83e9-10c54ad832a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1688 microversion: 2.1 time: 0.398535 Sep 03 21:06:23.664482 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2018/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:23 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1688 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:23.790310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:23.797143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:23.806290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:23.806995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:23.807662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:23.809092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:23.809987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:23.810674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:23.988358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:23.989092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:24.004783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.005314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.005843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:24.008111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.008594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.009067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:24.032198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:24.043584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0f046ed-3d81-461b-9547-648f874c0c39 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.257724 Sep 03 21:06:24.044915 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2241/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:23 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:24.088868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:24.097316 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8797c495-2b4b-4d57-bb5c-a12826de5a6e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1273 microversion: 2.1 time: 0.114826 Sep 03 21:06:24.114541 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2019/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:23 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:24.150388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:24.151209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:24.164848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.166457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.167123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:24.169332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.169841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.170297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:24.467791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:24.483717 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e3c5644-4506-4e3f-af31-47deb84fe5f3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.336987 Sep 03 21:06:24.489197 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2242/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:24 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:24.694295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:24.695742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:24.706048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.706949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.707640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:24.709867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:24.710957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:24.711559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.039281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:25.049419 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37b73068-6a7b-4759-bf34-85163a80ca6a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1688 microversion: 2.1 time: 0.360761 Sep 03 21:06:25.060926 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2020/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:24 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1688 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:25.071422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:25.072387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:25.079157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.079828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.080432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.081370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.081988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.082578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.140004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:25.140632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:25.154091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.154849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.155483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.156460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.157571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.163521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.283880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:25.297617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd1520d7-013c-4be2-949c-f5851f054a31 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.230697 Sep 03 21:06:25.308970 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2243/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:25 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:25.397121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:25.416686 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74e39c4b-8ee8-4609-9805-0088371f52b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1279 microversion: 2.1 time: 0.290445 Sep 03 21:06:25.423278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2021/4264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:25 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:25.520349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:25.522584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:25.546159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.547677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.550215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.551218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:25.554334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:25.559609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:25.730169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:25.739285 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-049b1903-ae3c-40f1-b3db-5c8c8ef6ebee tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.225546 Sep 03 21:06:25.741283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2244/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:25 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:26.073344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:26.073971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:26.081050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.081841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.082379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.083373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.084611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.085294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.326703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:26.328161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:26.337333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.338100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.338667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.339583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.340243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.340873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.447541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:26.461015 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29b6ca83-82e4-4a6c-a8cd-18236be694c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1688 microversion: 2.1 time: 0.389488 Sep 03 21:06:26.462350 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2022/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:26 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1688 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:26.483387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:26.485618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:26.503992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.506753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.507386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.512262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.514518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.515981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.637411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:26.652431 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d5e41491-884a-46d9-a9c8-c259a13c3699 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.329741 Sep 03 21:06:26.680372 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2245/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:26 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:26.742820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-plugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:26.778039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.781005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.781788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.813647 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] Creating event network-vif-plugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:06:26.833989 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ef819ce0-1500-4ba0-8592-179fd1720089 req-ae69c81d-5947-4543-beba-ed4433952dce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096337 Sep 03 21:06:26.836966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2246/4268] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:26.846227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:26.849825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:26.864509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.868684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.871759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:26.874586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:26.879406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:26.882537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:27.010157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:27.019279 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d62e6d4-cf1c-46c3-adef-ac7520e8d8bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.555603 Sep 03 21:06:27.028750 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2023/4269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:26 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:27.157315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:27.169290 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7bed01f1-273f-42a5-9e53-ef97f16c431f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.329565 Sep 03 21:06:27.172184 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2247/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:26 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:27.486710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:27.488224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:27.500671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:27.502114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:27.502580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:27.503326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:27.503801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:27.504250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:27.680182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:27.681020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:27.695208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:27.699827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:27.700574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:27.703579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:27.706059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:27.706808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:27.817131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:27.828461 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fa6e7935-9e1b-46de-8a92-5da6b21055b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1688 microversion: 2.1 time: 0.345725 Sep 03 21:06:27.829791 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2024/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:27 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:27.993654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:28.003344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-769478315", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "e1ee9b62-47af-41c9-ba87-ee5db8eeb0bb"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:28.015709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-438522f3-33d6-4671-a0ea-748822e2f65e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.339874 Sep 03 21:06:28.030137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2248/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:27 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:28.056641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:28.057303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:28.075018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.075804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.077091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.078312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.079058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.079771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.127371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] validate_networks() for [('e1ee9b62-47af-41c9-ba87-ee5db8eeb0bb', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:28.337011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:28.348654 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99c3f395-3a5b-4c40-9fb8-9c0f2d7866ba tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.297132 Sep 03 21:06:28.350916 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2249/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:28 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:28.357497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b943d964-ad09-4976-8c76-39f8965201f2", "tag": "8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:28.368472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.369339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.369786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.386804 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] Creating event network-changed:8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4 for instance b943d964-ad09-4976-8c76-39f8965201f2 on nch2-master-1 Sep 03 21:06:28.393437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8c651257-f1f5-4dc3-9c34-ed457998235a req-57958131-acb7-465a-8e57-28e00dc5522c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041084 Sep 03 21:06:28.394525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2250/4274] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:28.401450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:28.402313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:28.409073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.409956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.410548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.411627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.412806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.413431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.643132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:28.655846 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfa1486c-1183-4706-82fd-110520d0309c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.259937 Sep 03 21:06:28.670758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2251/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:28 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:28.856729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:28.858581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:28.876379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.877844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.878555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.880284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:28.882631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:28.883870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:28.893740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:29.202835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:29.203460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:29.203736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:29.204151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:29.204732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:29.224155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.225263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.225705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.232544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.236999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.237961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.239269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:29.247219 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c57dfa55-681e-40c8-a045-663095768552 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.395916 Sep 03 21:06:29.261003 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2252/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:28 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:29.261003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c2fc01-5f8d-4349-a92c-6cfe02aeb95b", "name": "network-vif-plugged", "status": "completed", "tag": "a0936da5-cbbe-44fc-9dd1-a27b1011d74e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:29.265084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.265838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.266460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.287528 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] Creating event network-vif-plugged:a0936da5-cbbe-44fc-9dd1-a27b1011d74e for instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b on nch1-master-1 Sep 03 21:06:29.296996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Getting quotas for project 8db106e653804866a09e333bddc1cf3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:29.299810 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2513b449-4e06-45db-bf56-a978a65736c3 req-d320375a-da10-4c3a-a707-9331936233d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Sep 03 21:06:29.300556 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2253/4277] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:29.306022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:29.306719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:29.313884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Getting quotas for user 27989e2a2d014e52913ca77e0448fc63 and project 8db106e653804866a09e333bddc1cf3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:29.327540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.328039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.328488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.329230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.329688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.330116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.337766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:29.340138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:29.456063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-55533f3a-fe46-4bc9-83ac-ec5fb1561526 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625040 Sep 03 21:06:29.456974 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2025/4278] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:29.463676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:29.464545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:29.473150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.474068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.475190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.476046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.476649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.477258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.791474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:29.808022 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2158bf57-f16a-49ce-97d9-3dfe43676c99 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.348605 Sep 03 21:06:29.809828 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2026/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:29 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:29.833292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f97db195-b817-4947-ad1b-e08e7189a3ef tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:29.840427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f97db195-b817-4947-ad1b-e08e7189a3ef tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:29.854297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:29.868481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae7c4695-31dd-48bc-801a-b60931bd83ac tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.566823 Sep 03 21:06:29.878070 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2254/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:29 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:29.892471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:29.912529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:29.923952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.924443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.924886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.925621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:29.926075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:29.926502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:29.984396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f97db195-b817-4947-ad1b-e08e7189a3ef tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:29.991920 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f97db195-b817-4947-ad1b-e08e7189a3ef tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1215 microversion: 2.1 time: 0.166063 Sep 03 21:06:29.997456 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2027/4281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:29 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:30.168758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:30.177311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d28d7802-dd57-4ea1-a46e-ec4ae5754978 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1315 microversion: 2.1 time: 0.298060 Sep 03 21:06:30.179145 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2255/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:29 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:30.275527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:30.276725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:30.284384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:30.285182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:30.285838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:30.286831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:30.287601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:30.288720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:30.295504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:30.832310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:30.833194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:30.854541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:30.858185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:30.858593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:30.859374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:30.859855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:30.860298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.225934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:31.235644 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b6530d18-1e9e-4a04-84a1-f24053b8ebe0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.407865 Sep 03 21:06:31.237355 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2256/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:30 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:31.247604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:31.248438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:31.261824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.263528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.264219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.265721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.266408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.267574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.345118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:31.370250 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b52053b7-420f-4201-98e7-5c90a90b2296 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 1.099204 Sep 03 21:06:31.388440 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2028/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:30 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:31.414207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:31.416368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:31.438581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.441075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.443778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.445937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.449745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.450493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.636283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:31.654761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5316f6fb-a43f-4c39-b3ab-f6d6d43a21d3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.408258 Sep 03 21:06:31.676274 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2257/4285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:31 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:31.682154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:31.683006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:31.691954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.692658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.693847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.699426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:31.700129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:31.700725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:31.966043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:31.991073 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ad6b8d57-5d3f-40a8-aee5-89d663be9403 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1267 microversion: 2.1 time: 0.583698 Sep 03 21:06:31.997070 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2029/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:31 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1267 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:32.046140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:32.062830 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9830bf78-91ec-408f-811e-e08323f29689 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1503 microversion: 2.1 time: 0.385058 Sep 03 21:06:32.081524 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2258/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:31 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:32.093721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:32.094716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:32.118924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.124333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.126067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.131792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.132257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.137311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.167756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'flavor' on Instance uuid 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:32.268780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:32.270075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:32.282911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.284589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.285215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.287552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.288178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.288783 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1e3e1176-9acb-44e2-bf67-4940f7ef668d tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "POST /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b/action" status: 202 len: 0 microversion: 2.1 time: 0.201966 Sep 03 21:06:32.289714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.291924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2030/4288] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:32 2022] POST /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:06:32.303755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:32.308414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:32.324945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.328181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.328791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.329702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.330984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.333072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.626123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:32.641144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:32.650764 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23e668c5-a584-42c3-8335-360d8f5873dc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.386494 Sep 03 21:06:32.653309 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2259/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:32 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:32.664275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:32.665609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:32.674167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=14 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:32.687057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.689264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.690140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.692452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.692849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:32.694250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.696358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.710877 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c93aee81-97a5-4e9a-b7fd-23f491ecf8d4 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1511 microversion: 2.1 time: 0.410830 Sep 03 21:06:32.737955 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2031/4290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:32 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:32.753301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:32.753924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:32.777379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.777885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.778330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:32.787882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:32.793280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:32.793791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.166387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:33.182072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7505f40b-0e2f-43d5-8b5c-2f8d5f5d1ce7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.527655 Sep 03 21:06:33.183065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2260/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:32 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:33.188109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b943d964-ad09-4976-8c76-39f8965201f2", "name": "network-vif-plugged", "status": "completed", "tag": "8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:33.202743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:33.205542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:33.216125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.218459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.220959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.252031 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] Creating event network-vif-plugged:8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4 for instance b943d964-ad09-4976-8c76-39f8965201f2 on nch2-master-1 Sep 03 21:06:33.254848 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56b0c89c-b98e-49c8-a726-878ad0fea1d6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.513271 Sep 03 21:06:33.257095 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2032/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:32 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:33.261998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5eebd15f-586e-42e8-82a7-091ba271da39 req-ff494010-6961-482e-918c-495990a5345a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077457 Sep 03 21:06:33.263196 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2261/4293] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:33.279720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:33.280738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:33.312404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.312914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.313360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.321339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.322136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.322736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.665506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:33.679223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:33.680557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:33.680825 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d8bde05-2e90-42db-926d-c7401da47efe tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.416843 Sep 03 21:06:33.690662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.691858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.692581 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2033/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:33 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:33.694561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.695437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.696133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.696782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.753797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:33.755042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:33.766534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.767113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.767707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:33.768683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:33.769245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:33.772229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.061746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:34.073113 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a8f8d7f-1124-4259-a81a-cb4dea3d2b9a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1494 microversion: 2.1 time: 0.332296 Sep 03 21:06:34.074403 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2034/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:33 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1494 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:34.097431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:34.099772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:34.105289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:34.109750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.110604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.111124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.111973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.112568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.113111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.113348 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e281799-73a8-456a-b148-1ea7e1f3dced tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1321 microversion: 2.1 time: 0.438731 Sep 03 21:06:34.113942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2262/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:33 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:34.170699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:34.207067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:34.208066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:34.216335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.217570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.218254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.219183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.220001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.220653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.335319 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83987b28-b003-4b89-9606-1bdb6449f0df tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 204 len: 0 microversion: 2.1 time: 0.242400 Sep 03 21:06:34.343720 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2035/4297] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:34 2022] DELETE /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:34.358448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:34.359500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:34.368289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.369034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.369696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.370596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.371661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.372402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.562151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:34.575013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b34e4280-d160-406f-b110-c9945d4865f8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.228245 Sep 03 21:06:34.579610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:34.589466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8687ce7-99ff-476f-ac4f-b7d490e68bec tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.386528 Sep 03 21:06:34.592440 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2263/4298] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:34 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:34.593221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2036/4299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:34 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:34.601647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:34.605123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:34.619953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.621261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.622394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.625946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.626640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.627337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.718568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:34.719970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:34.749208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.749803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.756027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.760432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.768557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.769326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.841290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:34.867430 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59369219-1d20-4ec3-a8b6-da793d674302 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1500 microversion: 2.1 time: 0.270705 Sep 03 21:06:34.869446 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2037/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:34 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:34.884406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac5043b-3056-45cb-986a-8f86c4598a9b", "tag": "86881271-c5e4-4c26-8088-2f4742a96518"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:34.898966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:34.900034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:34.900714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:34.914793 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] Creating event network-changed:86881271-c5e4-4c26-8088-2f4742a96518 for instance cac5043b-3056-45cb-986a-8f86c4598a9b on nch1-master-1 Sep 03 21:06:34.920845 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-7b0d40be-eaae-4133-9e33-9bed3bd7c725 req-7f3f9646-4f45-405c-8c08-11ec70581b4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046296 Sep 03 21:06:34.922092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2038/4301] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:35.049863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:35.058998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a1999652-7ac3-4431-8f3d-851be2cc5204 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.344694 Sep 03 21:06:35.077074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2264/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:34 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:35.139701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.140760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.149123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.149816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.150363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.151151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.151623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.152056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.297203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:35.306185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c13d6cd-76c6-45b2-bfb7-c3f5ab713df2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1502 microversion: 2.1 time: 0.170888 Sep 03 21:06:35.306979 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2039/4303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:35.330580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.331203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.339726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.340220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.340845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.341617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.342097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.342704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.493161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:35.506119 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46a65731-9fe9-400c-81df-ed2fdf959edb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1502 microversion: 2.1 time: 0.178316 Sep 03 21:06:35.506734 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2265/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:35.531792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.532313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.540180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.540683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.541163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.542095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.542566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.543000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.569559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:35.605595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.606626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.615181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.616403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.617041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.617998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.618594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.619158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.620560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:35.672715 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee9f212d-9035-4d95-bb01-32167630bbd9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 204 len: 0 microversion: 2.1 time: 0.143620 Sep 03 21:06:35.681766 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2040/4305] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:35 2022] DELETE /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:35.686283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.687002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.693605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.694110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.694558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.695276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.695748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.696180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.833189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:35.847044 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1c5a3bb8-226b-4b8d-83b9-0efb4ac9e5f2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.247268 Sep 03 21:06:35.848240 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2266/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:35.858745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.859791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.868809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.869656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.870306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.871380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.872113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.873292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.883778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:35.892361 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2744b32-a2a6-4ec3-8d6d-5e02c130a2a9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.211281 Sep 03 21:06:35.892973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2041/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:35.900088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:35.900925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:35.911045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.912352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.923403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:35.925834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:35.926485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:35.927893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.177032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:36.187548 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7f1d88b1-5719-4365-bc17-3860fb07ca17 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1500 microversion: 2.1 time: 0.291610 Sep 03 21:06:36.188332 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2042/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1500 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:36.193854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:36.194470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:36.201332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.201825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.202264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.202974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.203430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.203855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.434008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:36.445683 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-86b105b7-7f5b-4c5c-ad6b-a5bd5f6d4588 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.256471 Sep 03 21:06:36.447819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:36.447956 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2043/4309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:36 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:36.468223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07afcfd5-e505-4036-a5c5-ec965fa1b380 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1508 microversion: 2.1 time: 0.617513 Sep 03 21:06:36.468918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2267/4310] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:35 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:36.875358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:36.875982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:36.884083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.884672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.885100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.886529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.887354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.887908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.930814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:36.931454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:36.946370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.947435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.948043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:36.949029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:36.949852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:36.950493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.090620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:37.102007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89df046b-0ce7-4e40-bf0a-2d9e1da1b6a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.230722 Sep 03 21:06:37.128226 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2044/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:36 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:37.179276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:37.187185 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f76ace8-4843-4d74-9f09-9a1ff6b95a7a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.262259 Sep 03 21:06:37.187761 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2268/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:36 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:37.212186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:37.212931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:37.220771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.221626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.222522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.223792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.226800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.227360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.464076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:37.469084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:37.469799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:37.475369 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f84babc-92d3-4b06-af75-053352e69c86 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1500 microversion: 2.1 time: 0.267789 Sep 03 21:06:37.488985 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2045/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:37 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1500 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:37.495178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:37.495178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:37.497492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.498874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.499372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.499814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.500525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.501022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.501458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.502048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.504343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.505383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:37.506061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:37.507649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:37.782820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:37.805632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:37.824157 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da97dc8b-2bf7-4333-9af2-310f63745dd9 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.358924 Sep 03 21:06:37.824761 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2269/4314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:37 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:37.825832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-102abd24-146a-403d-a4ca-9db122e4b742 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1466 microversion: 2.1 time: 0.338106 Sep 03 21:06:37.832971 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2046/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:37 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:37.996500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b943d964-ad09-4976-8c76-39f8965201f2", "name": "network-vif-deleted", "tag": "8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:38.021818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.024262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.024989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.030190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:38.041968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] Creating event network-vif-deleted:8bd14dfc-694b-4c5f-90a6-1b0bfe135cf4 for instance b943d964-ad09-4976-8c76-39f8965201f2 on nch2-master-1 Sep 03 21:06:38.050810 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-05acf609-2f7d-4250-80dc-e8c6593b0fe7 req-125eecfd-3c5e-43b7-88fc-5ae5678fe534 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058635 Sep 03 21:06:38.052053 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2270/4316] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:38.132244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:38.133658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:38.136750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:38.155493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.159905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.160863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.161805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.162783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.163322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.215538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:38.216730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:38.241130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.241739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.242193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.244458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.245816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.246622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.498412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:38.507568 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d020052-e061-4d90-85fe-3c5a8d5c32bd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.297104 Sep 03 21:06:38.509940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2271/4317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:38 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:38.515615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:38.516414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:38.524123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.524954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.525563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.526441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.527062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.527709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.597866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:38.610971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:38.613122 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c65adec0-4318-47eb-afe5-756c9e8c9b3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1506 microversion: 2.1 time: 0.486624 Sep 03 21:06:38.613717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2047/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:38 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:38.620693 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-77ad1b39-bf9d-4bcd-b60b-9b5a07cc6586 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1458 microversion: 2.1 time: 0.109349 Sep 03 21:06:38.622974 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2272/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:38 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1458 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:38.850852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:38.851880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:38.852577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:38.853299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:38.865182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.865182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.865182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.866781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.868279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.869037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.872446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.873482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.874241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.874741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.876556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.877059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.920508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:38.921401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:38.921996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:38.922602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lazy-loading 'fault' on Instance uuid b943d964-ad09-4976-8c76-39f8965201f2 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:38.983739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:38.992043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-581e8aff-653b-48c2-abcb-8fd4bad1e4e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 200 len: 1311 microversion: 2.1 time: 0.146298 Sep 03 21:06:38.993097 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2048/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:38 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:39.209951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:39.221918 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7305365c-4c05-4b62-8b95-4112d3a69776 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.374980 Sep 03 21:06:39.222535 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2273/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:38 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:39.536039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:39.537299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:39.540420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:39.546645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.547147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.547599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.548323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.548788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.549351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.643776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:39.644412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:39.659614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.660137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.660575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.661349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.662400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.662853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.699317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:39.707995 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13e1393d-156f-4727-b03d-0464962a2659 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.176102 Sep 03 21:06:39.709419 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2049/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:39 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:39.720722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:39.721372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:39.748081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.748597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.749053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.749769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.750225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.750653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.799510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:39.800011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:39.800464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:39.801093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'fault' on Instance uuid 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:39.841226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:39.844576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:39.852262 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e24e05c-d913-422d-99cb-8f703210d6c7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1486 microversion: 2.1 time: 0.216923 Sep 03 21:06:39.853503 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2274/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:39 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1486 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:39.857735 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66d6f937-4718-49e0-9533-1a80209e78c3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1305 microversion: 2.1 time: 0.147237 Sep 03 21:06:39.858391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2050/4324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:39 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:40.016635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:40.017539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:40.018366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-33172292", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:40.028469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.029710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:40.030133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.030702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.031651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.032367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.033402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.053984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 HTTP/1.1 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b943d964-ad09-4976-8c76-39f8965201f2'} Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:40.061267 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:40.064750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-636a95fe-4a2d-41b8-890e-ce9616a16de8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 404 len: 111 microversion: 2.1 time: 0.051360 Sep 03 21:06:40.073277 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2275/4325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:40 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:40.080877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c2fc01-5f8d-4349-a92c-6cfe02aeb95b", "name": "network-vif-deleted", "tag": "a0936da5-cbbe-44fc-9dd1-a27b1011d74e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:40.096279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.097346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.097847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.109233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] validate_networks() for [('88aba021-fa76-431c-95c8-e82bb6055079', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:40.111939 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] Creating event network-vif-deleted:a0936da5-cbbe-44fc-9dd1-a27b1011d74e for instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b on nch1-master-1 Sep 03 21:06:40.134957 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e22ce0f1-bb54-46b7-b02d-52e3bc1fb473 req-708190aa-47de-4777-81b2-8f25a7e57902 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060092 Sep 03 21:06:40.138219 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2276/4326] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:40.148325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-695083b1-1b67-4509-bf0a-a838d69b6ce2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: .version_select at 0x7fae6b997550>, body: {"keypair": {"name": "tempest-key-1894581463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+xgCz+b4qJxIsHgpjj7T93I+/qqVzVoXCy9IB1MNEL/1KYtbdmVhgOXIV0V4pb+iSIW68LzB0duejCF11wShb/CNHLo4m9GAFlEEm0Tv+J/alYc9lNmvktpQq7IiGG0w=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:40.179916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-695083b1-1b67-4509-bf0a-a838d69b6ce2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:40.185483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-695083b1-1b67-4509-bf0a-a838d69b6ce2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:40.219863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-695083b1-1b67-4509-bf0a-a838d69b6ce2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.080238 Sep 03 21:06:40.220922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2277/4327] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:06:40 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:40.231384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bff018a-ea96-43ca-a6ca-9257bfe4bb6b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '.version_select at 0x7fae65cb50d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:40.235292 ncdv-master-1 devstack@n-api.service[140520]: WARNING oslo_db.sqlalchemy.utils [None req-9bff018a-ea96-43ca-a6ca-9257bfe4bb6b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 03 21:06:40.242198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9bff018a-ea96-43ca-a6ca-9257bfe4bb6b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.014513 Sep 03 21:06:40.249254 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2278/4328] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:06:40 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:40.272878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:40.274713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:40.285600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.286512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.287865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.288757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.289461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.290047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.502175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:40.510704 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a56a7a1-403c-4fe5-9606-796125b9b095 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.259203 Sep 03 21:06:40.511479 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2279/4329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:40 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:40.526034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1174313048", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-key-1894581463", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:40.611233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:40.731658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:40.732256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:40.732536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:40.732984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:40.733575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:40.746726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.747467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.748122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.748843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.749484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.750106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.777233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Getting quotas for project 79959bbc9a594e1f81d7e60e5d175e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:40.783676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Getting quotas for user fb144426dd4a46caa03a9ebe77e95c4c and project 79959bbc9a594e1f81d7e60e5d175e2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:40.799902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:40.802909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:40.857541 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57f79202-2eb2-4bd6-aaeb-49f5cbcc095d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.843341 Sep 03 21:06:40.858319 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2051/4330] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:40.867238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:40.867877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:40.881707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.882571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.885212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:40.886388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:40.886904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:40.887380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.174050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:41.176206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:41.177249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:41.177955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:41.178601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:41.179218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:41.191170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.191930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.192562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.193460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.193987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.194478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.197190 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67523aa8-dc37-46ee-ac89-dcf9c353fa22 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.335507 Sep 03 21:06:41.199630 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2052/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:41.218289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:41.219329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fef8f257-5afe-414b-a0a3-6bda3cba9cb7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:41.220340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fef8f257-5afe-414b-a0a3-6bda3cba9cb7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:41.227252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:41.243941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:41.248584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:41.301402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fef8f257-5afe-414b-a0a3-6bda3cba9cb7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:41.307931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e75157d-fe04-4e76-b089-7e20f2b86070 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787262 Sep 03 21:06:41.308676 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2280/4332] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:41.312184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fef8f257-5afe-414b-a0a3-6bda3cba9cb7 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1212 microversion: 2.1 time: 0.111456 Sep 03 21:06:41.313117 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2053/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:41 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:41.321764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:41.323316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:41.324521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dcde2860-3355-451a-aa39-6da1ee5a1787 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:41.327055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dcde2860-3355-451a-aa39-6da1ee5a1787 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:41.337609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.338354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.338970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.339898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.340548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.341197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.393456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.394451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.395083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.395734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'fault' on Instance uuid 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:41.427537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dcde2860-3355-451a-aa39-6da1ee5a1787 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:41.440978 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dcde2860-3355-451a-aa39-6da1ee5a1787 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1229 microversion: 2.1 time: 0.125261 Sep 03 21:06:41.444636 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2054/4334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:41 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:41.464862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:41.475153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5bc283e5-6086-4e10-891c-3bf7f8de7df7 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 200 len: 1305 microversion: 2.1 time: 0.165256 Sep 03 21:06:41.489669 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2281/4335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:41 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:41.536173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:41.536430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:41.559722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.560544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.561165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.561926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:41.562457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:41.562923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:41.783732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:41.810794 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e002ff48-2b72-4b1f-83b8-94d4cace209b tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.278869 Sep 03 21:06:41.829262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2055/4336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:41 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:42.224803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.225826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.233423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.234641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.235112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.235809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.236333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.236797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.337428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.338120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.347912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.353701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.356453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.357325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.357871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.358384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.419771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:42.430407 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-95575c25-fe33-417f-ab5e-ad6c2b47e195 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.210147 Sep 03 21:06:42.430992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2282/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:42.467433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.469249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.480041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.481032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.481686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.483915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.484620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.485355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.510610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:42.523078 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5227ef71-e9e0-419e-b5c8-62bdba5373bc tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1264 microversion: 2.1 time: 0.191006 Sep 03 21:06:42.537295 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2056/4338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:42.537295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.537295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.577156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.577660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.578103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.578849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.579285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.579752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.631906 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.634155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b HTTP/1.1 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '70c2fc01-5f8d-4349-a92c-6cfe02aeb95b'} Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.638540 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.642049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:42.642490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f91ef2f6-4000-4003-aa07-cd558b8c4a7e tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 404 len: 111 microversion: 2.1 time: 0.117653 Sep 03 21:06:42.652339 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2057/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:42.654858 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-514a875a-0b72-4aa8-b668-e8ff42f5c357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1225 microversion: 2.1 time: 0.192321 Sep 03 21:06:42.657577 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2283/4340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:42.674994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.675512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.708081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.709143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.737656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.740846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.741537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.741825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.792039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b HTTP/1.1 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '70c2fc01-5f8d-4349-a92c-6cfe02aeb95b'} Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:42.794283 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.797685 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.822728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:42.824278 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7da09af-014f-4d79-a2cc-51390459870f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 404 len: 111 microversion: 2.1 time: 0.170852 Sep 03 21:06:42.825132 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2058/4341] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:42 2022] DELETE /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:42.835105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.836324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.846959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.850681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.851302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.853075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.853504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.854002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.855036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.856826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.887020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.887621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.890218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.891504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.892106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.893432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b HTTP/1.1 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '70c2fc01-5f8d-4349-a92c-6cfe02aeb95b'} Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.893808 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 70c2fc01-5f8d-4349-a92c-6cfe02aeb95b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-462fb836-7f4b-403b-861b-cff0df2f9f28 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b" status: 404 len: 111 microversion: 2.1 time: 0.066033 Sep 03 21:06:42.898243 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2284/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/70c2fc01-5f8d-4349-a92c-6cfe02aeb95b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:42.900020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.930414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.930940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.940318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.943622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.944283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.945272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.945914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.946528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.964216 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f HTTP/1.1 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b52ce559-847c-4d55-b3d6-7d0e5009c31f'} Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:42.966336 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:42.969779 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:42.971778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:42.972923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0049572-0699-457e-b86b-af6fb808bda8 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 404 len: 111 microversion: 2.1 time: 0.067427 Sep 03 21:06:42.974594 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2285/4343] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:42 2022] DELETE /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:42.983337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:42.984398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: b52ce559-847c-4d55-b3d6-7d0e5009c31f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:42.991758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.992459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.993231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:42.994254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:42.994782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:42.995269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.009783 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f HTTP/1.1 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b52ce559-847c-4d55-b3d6-7d0e5009c31f'} Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.011452 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance b52ce559-847c-4d55-b3d6-7d0e5009c31f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.015088 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f43773eb-fc03-4927-9681-8217b3cfae0f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f" status: 404 len: 111 microversion: 2.1 time: 0.033773 Sep 03 21:06:43.017344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2286/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/b52ce559-847c-4d55-b3d6-7d0e5009c31f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.022303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.022998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.029635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.030379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.031023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.031886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.032495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.033117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.049134 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 HTTP/1.1 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7c32ba7b-42f6-4302-bdbb-df7d317ebc33'} Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.051130 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.055432 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.057326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.058388 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f194a768-91cc-427a-b505-688da6f93bf6 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 404 len: 111 microversion: 2.1 time: 0.039873 Sep 03 21:06:43.062042 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2287/4345] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:43 2022] DELETE /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.069597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.070713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 7c32ba7b-42f6-4302-bdbb-df7d317ebc33] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.077607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.078638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.079347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.080393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.081105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.081761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.096726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 HTTP/1.1 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7c32ba7b-42f6-4302-bdbb-df7d317ebc33'} Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.098396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 7c32ba7b-42f6-4302-bdbb-df7d317ebc33 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.103414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99a7cfaa-0fe2-41e3-99a3-46e6b2d70441 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33" status: 404 len: 111 microversion: 2.1 time: 0.036463 Sep 03 21:06:43.104991 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2288/4346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/7c32ba7b-42f6-4302-bdbb-df7d317ebc33 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.109597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.110412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.127952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.138924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.139482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.140203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.140669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.141132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.157394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d HTTP/1.1 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '50684007-380d-46af-b423-a911129fcf8d'} Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.159077 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b6713d7-2da6-456f-a04c-d27a0d8d2c39 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 404 len: 111 microversion: 2.1 time: 0.054489 Sep 03 21:06:43.171506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2289/4347] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:43 2022] DELETE /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.174111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:43.180819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.181196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8471df38-1809-4109-ac3b-03d21ba10180 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.349879 Sep 03 21:06:43.181482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 50684007-380d-46af-b423-a911129fcf8d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.181637 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2059/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:42 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:43.190778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.191635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.191780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.193466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.193952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.195267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.209883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d HTTP/1.1 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '50684007-380d-46af-b423-a911129fcf8d'} Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.211440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 50684007-380d-46af-b423-a911129fcf8d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.215481 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-811ff861-d6f5-474c-b2c3-f13ca906b41c tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d" status: 404 len: 111 microversion: 2.1 time: 0.037844 Sep 03 21:06:43.216673 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2290/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/50684007-380d-46af-b423-a911129fcf8d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.221898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.222657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.230254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d HTTP/1.1 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '93b40596-2c6a-486e-867a-0d43e82b3d0d'} Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.234066 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.238930 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.240960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.245650 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22426e6d-1740-4ba5-8772-3bb2268a2a07 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d" status: 404 len: 111 microversion: 2.1 time: 0.027628 Sep 03 21:06:43.250077 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2060/4350] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:43 2022] DELETE /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:06:43.259337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.260128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: 93b40596-2c6a-486e-867a-0d43e82b3d0d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.268585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d HTTP/1.1 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '93b40596-2c6a-486e-867a-0d43e82b3d0d'} Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:43.271004 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance 93b40596-2c6a-486e-867a-0d43e82b3d0d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:43.274614 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6af59fc1-e176-429f-8df7-ec6bdda5ec41 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d" status: 404 len: 111 microversion: 2.1 time: 0.018440 Sep 03 21:06:43.276942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2291/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/93b40596-2c6a-486e-867a-0d43e82b3d0d => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:43.454712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.455784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.469853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.470644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.471592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.472475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.473175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.474177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.538969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:43.551105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.551940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.571766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.574564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.579553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.581178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.582174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.582983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.659130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:43.670854 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bfe21193-1798-49ce-8f86-53c134c0d257 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1270 microversion: 2.1 time: 0.127062 Sep 03 21:06:43.672084 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2292/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:43.692390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.693486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.699935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.700446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.700916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.701659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.702123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.702558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.732030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:43.833150 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-57cf0634-8393-4619-a1c2-e477ad1c730f tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 204 len: 0 microversion: 2.1 time: 0.143181 Sep 03 21:06:43.835137 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2293/4353] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:43 2022] DELETE /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:43.843777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.844839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.848478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:43.854581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.855856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.856493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.857429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.858071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.858657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.897123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:43.906539 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e838b6d-6e64-4a9b-96ef-6a89aeeba1b7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.456744 Sep 03 21:06:43.920275 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2061/4354] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:43.926107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:43.926891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:43.937881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.938651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.939246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.940112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:43.940722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:43.941335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:43.956217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:43.965193 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f79cd1ae-36a8-4677-9898-a4e32a924f44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1287 microversion: 2.1 time: 0.127449 Sep 03 21:06:43.966641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2294/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:44.214983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:44.216142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:44.226641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.227146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.227646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.228353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.228842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.229375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.234216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:44.275980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:44.293142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a72c2b9-e4be-4378-9b52-ffc992509676 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1508 microversion: 2.1 time: 0.371276 Sep 03 21:06:44.298382 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2062/4356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:43 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:44.453446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:44.464039 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b91d7a00-717c-462d-81a8-bb7cb455f6f5 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.253939 Sep 03 21:06:44.464517 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2295/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:44 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:44.645772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac5043b-3056-45cb-986a-8f86c4598a9b", "name": "network-vif-plugged", "status": "completed", "tag": "86881271-c5e4-4c26-8088-2f4742a96518"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:44.669089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.670041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.670690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.698390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:44.700384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:44.708178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.708440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] Creating event network-vif-plugged:86881271-c5e4-4c26-8088-2f4742a96518 for instance cac5043b-3056-45cb-986a-8f86c4598a9b on nch1-master-1 Sep 03 21:06:44.709485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.710148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.711103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.711780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.712401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.714264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-51f025eb-c572-44b7-ba2b-9d15729ab96c req-dc987063-6e22-4827-b22d-5782a84dd45a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074018 Sep 03 21:06:44.723527 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2063/4358] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:44.944848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:44.949936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:44.950649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:44.953809 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-288fee06-22d5-4b71-98d0-3ca95b832c3e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.261325 Sep 03 21:06:44.957922 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2296/4359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:44 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:44.961268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.961779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.962234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:44.962958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:44.963422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:44.963855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.004722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:45.006280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:45.013628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.014433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.015236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.016389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.017085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.017734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.103956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:45.120235 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70a19309-a85e-4dd3-a740-26fcf82d60df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1287 microversion: 2.1 time: 0.117826 Sep 03 21:06:45.121211 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2297/4360] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:44 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:45.340470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:45.341433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:45.382733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.383808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.384437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.385403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.388605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.389650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.419853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:45.435871 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bf7e7eb3-f8b4-4a88-aea4-4847c6b5743b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.490211 Sep 03 21:06:45.452783 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2064/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:44 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:45.498456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:45.499454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:45.510717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.511219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.511661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.512383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.512840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.513296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.696488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:45.725531 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82287e5f-eaf3-49a0-bbe5-cd4ef0047b67 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1508 microversion: 2.1 time: 0.387336 Sep 03 21:06:45.727973 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2298/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:45 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:45.954817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:45.967201 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-19878ac8-da6c-4ca4-8be4-36a566ceaa1f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1315 microversion: 2.1 time: 0.477864 Sep 03 21:06:45.981318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8de6ac6-a72f-415c-b514-05c2d6cc84be", "name": "network-vif-deleted", "tag": "516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:45.982162 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2065/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:45 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:45.992823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:45.993378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:45.993818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:45.997081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:45.998746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:46.005939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.006639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.007149 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] Creating event network-vif-deleted:516b43a3-43e6-4d90-b1f5-1c7f6d1cb7cb for instance e8de6ac6-a72f-415c-b514-05c2d6cc84be on nch2-master-1 Sep 03 21:06:46.007882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.009123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.009753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.010430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.012459 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-05bfba5b-483f-416f-8270-aafa53898f08 req-95e8ae1e-0a49-46d6-84e5-347a5da52578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044842 Sep 03 21:06:46.016374 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2299/4364] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:46.146634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:46.147695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:46.154203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.154952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.155574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.156490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.157178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.157818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.318992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:46.329277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87896bcc-8f5a-40a7-b0d9-6fc32cd1e7b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.338928 Sep 03 21:06:46.330481 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2066/4365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:45 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:46.342366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:46.354127 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0abe63c2-508f-4744-89c6-cbe6f35559e2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.210951 Sep 03 21:06:46.357441 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2300/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:46 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:46.465923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:46.466896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:46.478539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.479784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.480259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.481036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.481832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.482279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.505146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30001215-9654-4e7e-850c-2a38e10f4f98", "tag": "4c8c0a6a-9409-4de7-9ffb-761acf93c281"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:46.515891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.516459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.516935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.528768 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] Creating event network-changed:4c8c0a6a-9409-4de7-9ffb-761acf93c281 for instance 30001215-9654-4e7e-850c-2a38e10f4f98 on nch2-master-1 Sep 03 21:06:46.533879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f1755fb0-362e-4f91-9e88-211e8a6a44bb req-f1130d0f-d636-4d25-bf1b-ad63f2918bb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Sep 03 21:06:46.537108 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2301/4367] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:46.760585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:46.762293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:46.778363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.779316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.780016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.782116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.783444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.784466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.790706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:46.807104 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a3fcb33-2152-4d4a-a911-e336240ff50c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1683 microversion: 2.1 time: 0.345209 Sep 03 21:06:46.816367 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2067/4368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1683 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:46.846762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:46.847263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:46.847711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:46.848177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lazy-loading 'fault' on Instance uuid e8de6ac6-a72f-415c-b514-05c2d6cc84be {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:46.895904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3187514ca644ff68c992526f38783c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6874e10ae4e12ad874c65942f9d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:46.906381 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91d66823-4499-4f52-acef-e814f0e7a9b9 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 200 len: 1304 microversion: 2.1 time: 0.155484 Sep 03 21:06:46.907512 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2302/4369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:46 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:46.997918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:46.999115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.006779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.007595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.008245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.009316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.010003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.010581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.354353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.354967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.362538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.363035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.363974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.364883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.365646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.366228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.386375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:47.394501 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-173edea3-ed07-481f-8991-10a2952d02c0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1504 microversion: 2.1 time: 0.401131 Sep 03 21:06:47.397629 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2068/4370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:46 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:47.404865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.406228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.413866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.414559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.415138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.415983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.416587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.417442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.541838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:47.549741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e334ef8f-9d54-44ae-b886-080d8289d616 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.200398 Sep 03 21:06:47.550528 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2303/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:47 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:47.567368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.568632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.575528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.576119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.576618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.577580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.578083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.578664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.653495 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea786513-e20e-48c6-9ba4-fe8ba8141e9a tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.101846 Sep 03 21:06:47.654148 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2304/4372] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Sep 3 21:06:47 2022] DELETE /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b/os-server-password => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:47.664218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.664721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.671916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.672096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.672541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.673274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.673742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.674173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.698619 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa5e0e9f-c9ae-4707-b4bf-fca4baf4e2f0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.038756 Sep 03 21:06:47.699194 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2305/4373] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Sep 3 21:06:47 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b/os-server-password => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:06:47.709723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.710222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.716147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.716635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.717111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.717810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.718261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.718690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.745946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:47.770164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:47.781360 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51659b4c-5cd9-4b30-acb2-b11fba455e97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.382658 Sep 03 21:06:47.782263 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2069/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:47 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:47.832347 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff2da03f-b090-46c7-b7b1-86287d9c020f tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 204 len: 0 microversion: 2.1 time: 0.125200 Sep 03 21:06:47.833138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2306/4375] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:47 2022] DELETE /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:06:47.838765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.839632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.843933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:47.844715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:47.846004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.846499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.846939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.847639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.848090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.849588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.852366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.852993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.853555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:47.855850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:47.856306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:47.856744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.002862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:48.011245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4cf32eca-2f51-4624-aca8-2e2f3dc68657 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1510 microversion: 2.1 time: 0.173173 Sep 03 21:06:48.011834 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2307/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:47 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:48.016764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.017421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: e8de6ac6-a72f-415c-b514-05c2d6cc84be] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.024321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.025081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.025520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.026232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.026687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.027111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.042110 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be HTTP/1.1 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'e8de6ac6-a72f-415c-b514-05c2d6cc84be'} Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.043780 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance e8de6ac6-a72f-415c-b514-05c2d6cc84be could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eded012a-6560-45ec-8ad0-49481f66d0e3 tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be" status: 404 len: 111 microversion: 2.1 time: 0.032263 Sep 03 21:06:48.048446 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2308/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:48 2022] GET /compute/v2.1/servers/e8de6ac6-a72f-415c-b514-05c2d6cc84be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:48.054022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.054526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.060756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.061290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.061728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.062435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.062892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.063314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.077597 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 HTTP/1.1 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a4a1eb3e-1dc6-41d4-b083-f66c74ac8485'} Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:48.079158 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-477821b2-4597-4d5b-a89f-cee43b53ca0a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 404 len: 111 microversion: 2.1 time: 0.030414 Sep 03 21:06:48.084175 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2309/4378] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:48 2022] DELETE /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:48.091872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.092485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] [instance: a4a1eb3e-1dc6-41d4-b083-f66c74ac8485] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.099654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.100143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.100576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.101325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.101778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.102201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.116591 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] HTTP exception thrown: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Request method failure captured: Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 HTTP/1.1 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8DubjIWqhcaIfn3O0ci4wEszdZEtLTXHY_X1kdeVjVXdUyoxlS1Kfo6KXsgZVkQwdGplIlD6MfG6p3lsdk2gvG0h7DiZxUS6PzYzKgyraHvxVVw__MdUUrTVtkCDOaGmpFyaToxcNCpZGUxGrvHT214Hs8Gdo4hZy3Ej-EJwHGUpJg Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fde6874e10ae4e12ad874c65942f9d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fde6874e10ae4e12ad874c65942f9d59 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106439313 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c3187514ca644ff68c992526f38783c7 Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-1106439313-project Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a4a1eb3e-1dc6-41d4-b083-f66c74ac8485'} Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:48.123155 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] Returning 404 to user: Instance a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c65af59-84a6-4044-aed9-c8db23bca65a tempest-DeleteServersTestJSON-1106439313 tempest-DeleteServersTestJSON-1106439313-project] 10.222.0.16 "GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485" status: 404 len: 111 microversion: 2.1 time: 0.031513 Sep 03 21:06:48.127583 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2310/4379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:48 2022] GET /compute/v2.1/servers/a4a1eb3e-1dc6-41d4-b083-f66c74ac8485 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:06:48.361264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:48.369762 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6be32d06-a7e1-4a8b-b905-026e9ce1596b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.535330 Sep 03 21:06:48.370369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2070/4380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:47 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:48.482382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.483031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.490534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.491023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.491463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.492159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.492667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.493295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.551465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95205acf-bca5-45b7-9bfc-ac86b65402ae", "tag": "c026dcdf-0d2c-4da2-8283-17e385ba07a4"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:48.561543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.562104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.562619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.576161 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] Creating event network-changed:c026dcdf-0d2c-4da2-8283-17e385ba07a4 for instance 95205acf-bca5-45b7-9bfc-ac86b65402ae on nch2-master-1 Sep 03 21:06:48.581441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2c269c5b-4d6c-43cf-9193-bab78a264f56 req-140f92ad-40ed-4d77-8bd5-f2beee9dc832 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Sep 03 21:06:48.582218 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2071/4381] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:48.589369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.590074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.597406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.597901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.598336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.599297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.599748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.600176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.707915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:48.716465 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fcd775f6-77ec-4ef0-81dd-19e302d16802 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.237833 Sep 03 21:06:48.717507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2311/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:48.744127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:48.753137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3a18d79-b413-46c5-abdc-9149f61af92c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.169468 Sep 03 21:06:48.753717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2072/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:48 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:48.806260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:48.806879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:48.813700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.814191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.814632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.815330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:48.815805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:48.816236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:48.822275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:49.020265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:49.032557 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6b5f19f2-14e8-445f-942d-e4a0420806d3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.230569 Sep 03 21:06:49.033508 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2312/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:48 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:49.034988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:49.035603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:49.042493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.043090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.043442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.044149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.044603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.045283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.201891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:49.211685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-287d1edf-1732-46bb-95fb-123c266ccbce tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1510 microversion: 2.1 time: 0.180421 Sep 03 21:06:49.212576 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2073/4385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:49 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:49.740579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:49.741239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:49.748867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.749411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.749859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.750641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.751109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.751545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.777745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:49.778382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:49.786375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.786919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.787494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.788223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:49.788689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:49.789192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:49.924883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:49.934470 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24ec44b2-64ab-4752-9fb2-8d031746d545 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.161787 Sep 03 21:06:49.935072 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2074/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:49 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:50.058665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:50.059303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:50.065352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.065841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.066281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.066977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.067433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.068519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.233923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:50.242829 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a31715f-ee51-4fc9-b36a-56288f0552ea tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.188029 Sep 03 21:06:50.243407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2075/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:50 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:50.262399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:50.275673 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a82dd7ed-947a-4e00-94a6-cdeddb1a560d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.539592 Sep 03 21:06:50.276480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:50.277517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:50.279250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2313/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:49 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:50.283941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.284439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.284886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.285622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.286088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.286525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.300656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:50.301563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:50.308411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.309163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.309919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.310924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.311530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.312096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.575995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:50.624033 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c32334c-0192-4a6e-ad86-f0d630568bd0 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1510 microversion: 2.1 time: 0.379031 Sep 03 21:06:50.626471 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2076/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:50 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:50.644184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:50.675290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.676929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.678046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.682058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:50.696066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-733fe175-f996-4d4a-aee2-5911ae18dd44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.399114 Sep 03 21:06:50.696586 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2314/4390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:50.715729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] Creating event network-vif-unplugged:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:06:50.722365 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-97646a22-70ca-43dd-b707-e3a4925534f7 req-e04c3d3c-9db7-4be3-aa82-9d47dc7a4782 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092537 Sep 03 21:06:50.723183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2077/4391] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:50.724033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac5043b-3056-45cb-986a-8f86c4598a9b", "name": "network-vif-deleted", "tag": "86881271-c5e4-4c26-8088-2f4742a96518"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:50.737341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.737832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.738276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.739277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:50.740627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:50.759971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.762341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] Creating event network-vif-deleted:86881271-c5e4-4c26-8088-2f4742a96518 for instance cac5043b-3056-45cb-986a-8f86c4598a9b on nch1-master-1 Sep 03 21:06:50.763370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.763899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.764667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.767540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.768369 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e44436cb-eb50-48b0-9fd5-69272c3b4dbe req-20364373-9160-4d39-b44d-70bffb96d581 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052640 Sep 03 21:06:50.768784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.769436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:50.772268 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2315/4392] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:50.960445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:50.961247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:50.975877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.976685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.977304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:50.980614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:50.981297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:50.981877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.209386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:51.215994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:51.220339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9408da0d-680b-4c3d-9fb8-0c8f7148b9e5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.264620 Sep 03 21:06:51.221296 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2316/4393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:50 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:51.241176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:51.265268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f78379c-5812-4377-a69a-427376d8c148 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.537253 Sep 03 21:06:51.266253 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2078/4394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:51.272285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:51.273178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:51.275488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:51.283717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.284522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.285087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.286033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.286609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.287257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.290229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:51.292686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:51.305444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.306559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.307039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.309534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.310212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.312786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.371388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:51.422428 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b948602c-e0a9-4ff4-93f2-45a840096d24 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.133305 Sep 03 21:06:51.426380 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2079/4395] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:51 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:06:51.436594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:51.441477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:51.444599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:51.462827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.465426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.466149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.474218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.474878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.475429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.524667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:51.542980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f77e67d1-2c65-4464-8b7b-6a95db1ee96c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.277910 Sep 03 21:06:51.543603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2317/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:51 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:51.664648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:51.667096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:51.679717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.681516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.682471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.683719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.684648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.685621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.736604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:51.737140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:51.737789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:51.738409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lazy-loading 'fault' on Instance uuid cac5043b-3056-45cb-986a-8f86c4598a9b {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:51.761828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:51.770723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4b9998e1-d735-41d6-bc21-04e594032a88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1672 microversion: 2.1 time: 0.343037 Sep 03 21:06:51.771989 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2080/4397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:51 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:51.841509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27989e2a2d014e52913ca77e0448fc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db106e653804866a09e333bddc1cf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:51.851319 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d97ac87-6dcb-4ba4-9250-9e3d0a34380e tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 200 len: 1305 microversion: 2.1 time: 0.199329 Sep 03 21:06:51.852351 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2318/4398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:51 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 1305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:52.250650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:52.252124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:52.262473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.263358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.264515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.278900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.279847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.281937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.487482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:52.497713 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6f419622-5e6f-44bb-b507-e778834f2d9e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.253862 Sep 03 21:06:52.509550 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2081/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:52 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:52.573845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:52.574597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:52.586397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.587579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.588218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.589500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.591208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.592757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.776797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:52.785115 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca90cd5a-9d6b-4ab9-9d2e-5fd7b0bceeb5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.219387 Sep 03 21:06:52.794048 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2319/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:52 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:52.801762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:52.803015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:52.810600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.811125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.811556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.812260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.812719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.813179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.874728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:52.875634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] [instance: cac5043b-3056-45cb-986a-8f86c4598a9b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:52.882641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.883586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.884192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.885146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:52.885768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:52.888985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:52.905395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] HTTP exception thrown: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Request method failure captured: Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b HTTP/1.1 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8HTlCWlM5cJ8avOE--ZhwCDS4KA7-UIZBKu6M5LaajRUICPJtO7rFky8nhmPAHjKrXfPZ-qpezYVFX9OZ_OI6ca71eFV86-P06LDJrWCeMrgXdNoouxbS5HlQAZ0jEVsoySMbkSTqf-jH8n12C8XPSc_twgkeHBzV2XAPVPQ9z4lRE Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8db106e653804866a09e333bddc1cf3d Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerPasswordTestJSON-1787607625 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8db106e653804866a09e333bddc1cf3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8db106e653804866a09e333bddc1cf3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8db106e653804866a09e333bddc1cf3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8db106e653804866a09e333bddc1cf3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerPasswordTestJSON-1787607625 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8db106e653804866a09e333bddc1cf3d Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1787607625 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerPasswordTestJSON-1787607625-project Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 27989e2a2d014e52913ca77e0448fc63 Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerPasswordTestJSON-1787607625-project Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'cac5043b-3056-45cb-986a-8f86c4598a9b'} Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:06:52.907372 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. Sep 03 21:06:52.914455 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:06:52.918756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] Returning 404 to user: Instance cac5043b-3056-45cb-986a-8f86c4598a9b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:06:52.921283 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8394dd04-8c78-4fde-a3eb-cf6fcdb26a16 tempest-ServerPasswordTestJSON-1787607625 tempest-ServerPasswordTestJSON-1787607625-project] 10.222.0.16 "GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b" status: 404 len: 111 microversion: 2.1 time: 0.050281 Sep 03 21:06:52.923134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2320/4401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:52 2022] GET /compute/v2.1/servers/cac5043b-3056-45cb-986a-8f86c4598a9b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:06:53.131116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:53.169844 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1616fcc-a400-4632-8161-2712fa5f7019 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1677 microversion: 2.1 time: 0.374374 Sep 03 21:06:53.179077 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2082/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:52 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1677 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:53.385386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95205acf-bca5-45b7-9bfc-ac86b65402ae", "name": "network-vif-plugged", "status": "completed", "tag": "c026dcdf-0d2c-4da2-8283-17e385ba07a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:53.408608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:53.409836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:53.412754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:53.428867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] Creating event network-vif-plugged:c026dcdf-0d2c-4da2-8283-17e385ba07a4 for instance 95205acf-bca5-45b7-9bfc-ac86b65402ae on nch2-master-1 Sep 03 21:06:53.436617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d62c784a-959d-4e30-954d-b752afcf6eb6 req-2b4ce67f-2bdd-4a32-8967-c76a295ead66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054812 Sep 03 21:06:53.437265 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2321/4403] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:53.522428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:53.523619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:53.537588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:53.539588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:53.541723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:53.545733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:53.546583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:53.547079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:53.744633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:53.754010 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6753b8ec-6e86-4cca-826c-ead4140eebbf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.236615 Sep 03 21:06:53.756622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2083/4404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:53 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:53.810156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:53.811537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:53.821573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:53.822470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:53.824083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:53.825221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:53.825893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:53.826626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.101568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:54.109567 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-686d4096-d824-47d8-a53e-2673d14a3b4f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1329 microversion: 2.1 time: 0.304760 Sep 03 21:06:54.110471 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2322/4405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:53 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1329 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:54.205048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:54.205699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:54.212756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.213302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.214053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.214919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.215837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.216753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.377576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:54.406815 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-182c1d09-d28b-4374-b059-e5a68c15ea5f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.206637 Sep 03 21:06:54.426787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2084/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:54 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:54.432606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:54.436104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:54.448742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.449274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.453110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.454185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.456323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.456992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.553763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-003e1594-0ca0-4d5e-b00c-3eae06bf0488 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 200 len: 324 microversion: 2.1 time: 0.124918 Sep 03 21:06:54.554509 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2323/4407] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:54 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:54.564563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:54.565368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:54.572486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.573082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.573772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.574625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.575246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.575855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.744696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:54.755229 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c50758ee-15bf-4611-a583-6d4f5d28263d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.194718 Sep 03 21:06:54.757479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2085/4408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:54 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:54.782431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:54.782566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:54.783020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:54.783566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:54.789502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:54.791210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.792063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.792458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.793039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.793153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.793496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.794207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.794532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:54.794662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.795270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:54.795381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.796020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:54.994983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:55.002905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0fd82d97-4463-4750-9e07-f0a2c26a018c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.224478 Sep 03 21:06:55.004337 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2086/4409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:54 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:55.028792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:55.034141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:55.044093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.044961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.046383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.050038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.050737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.051397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.082787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:55.091936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82186954-0ff7-4309-8eae-043c52340141 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.316657 Sep 03 21:06:55.096603 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2324/4410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:54 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:55.133442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:55.134567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:55.146971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.147823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.155132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.155915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.156403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.156861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.365958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:55.379831 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-23ff4aa0-3f28-4830-9a4e-a747a2d5ec5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.355109 Sep 03 21:06:55.387624 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2087/4411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:55.409589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:55.410831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:55.417584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.418296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.418987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.419881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.420625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.421251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.425196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:55.449575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5caf3eed-69d0-4454-8ed1-7d7615708fda tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1510 microversion: 2.1 time: 0.316065 Sep 03 21:06:55.450225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2325/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:55 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:55.474285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:55.475164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:55.482540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.483383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.483980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.484867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.485609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.486188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.704618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:55.725854 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f16348c-c660-4d08-9b22-a23fc83d0de4 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1510 microversion: 2.1 time: 0.252944 Sep 03 21:06:55.727697 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2326/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:55 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:55.747436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30001215-9654-4e7e-850c-2a38e10f4f98", "name": "network-vif-plugged", "status": "completed", "tag": "4c8c0a6a-9409-4de7-9ffb-761acf93c281"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:55.762173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.762671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.763925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.800243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] Creating event network-vif-plugged:4c8c0a6a-9409-4de7-9ffb-761acf93c281 for instance 30001215-9654-4e7e-850c-2a38e10f4f98 on nch2-master-1 Sep 03 21:06:55.812144 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-21e789f5-a3ca-4623-9d12-74e61b7898fc req-607bda9a-0d31-46d9-89f8-1440717f9e41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082859 Sep 03 21:06:55.814201 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2327/4414] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:06:55.834531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:55.835310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:55.857030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.857868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.862852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.863623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:55.872016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:55.872822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:55.921687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:06:56.054278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf1a3739-90c2-4e89-8479-327531b0e3d8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 204 len: 0 microversion: 2.1 time: 0.236179 Sep 03 21:06:56.055236 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2328/4415] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:06:55 2022] DELETE /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:06:56.064660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:56.065443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:56.076694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:56.077246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:56.077866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:56.078776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:56.079577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:56.080376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:56.162156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:56.172096 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbd3d7cd-3fa7-4b0a-9b20-8d8dbfb5fff2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.766472 Sep 03 21:06:56.172736 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2088/4416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:56.179534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:56.180508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:56.193241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:56.193963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:56.195155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:56.196618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:56.197240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:56.201034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:56.313826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:56.318228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:56.326276 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e32a8e21-da2b-4b8e-b65d-9300a4354fca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1516 microversion: 2.1 time: 0.266536 Sep 03 21:06:56.340934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2329/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:56 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:56.340934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1998002334", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b1cd1193-a10d-479f-9da3-5114ed491f2f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:56.435043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] validate_networks() for [('b1cd1193-a10d-479f-9da3-5114ed491f2f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:06:56.556113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:56.567243 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffee0d77-86c4-47bf-bda2-188aaeeef9f0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.393008 Sep 03 21:06:56.570167 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2089/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:56 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:57.355033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:57.356416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:57.367111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.371066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.372612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.374584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.375057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.375507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.689420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:06:57.689979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:06:57.694171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:57.696060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:06:57.696622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:06:57.699715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:06:57.715697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-45fe0c27-77e3-4179-b24e-7091304b23ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1516 microversion: 2.1 time: 0.361768 Sep 03 21:06:57.740276 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2090/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:57 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1516 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:57.745817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.752498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.757237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:57.757862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.758897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.761367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.762143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:57.764045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.782703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.785279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.786843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.791013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:57.791758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:57.792318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:57.827621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:06:57.841704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:06:57.883764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:06:57.889830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:06:57.920362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:57.976488 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4726b0d-c2ba-4e51-b3e4-443df198a816 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647827 Sep 03 21:06:57.977473 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2330/4420] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:06:57.991574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f76741e3-96fd-407e-a430-660ac451b918 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:57.993193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f76741e3-96fd-407e-a430-660ac451b918 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:58.122673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f76741e3-96fd-407e-a430-660ac451b918 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:58.140335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f76741e3-96fd-407e-a430-660ac451b918 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1215 microversion: 2.1 time: 0.154852 Sep 03 21:06:58.154456 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2331/4421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:57 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:58.306253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:58.324677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8223530e-aeb4-4db5-a359-3a79069ff661 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1312 microversion: 2.1 time: 0.582791 Sep 03 21:06:58.326380 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2091/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:57 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1312 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:58.748855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:58.749505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:58.759728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:58.761702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:58.762161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:58.768387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:58.768966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:58.769569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.016357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:59.030935 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05c5eab0-11df-4f34-a146-e7c743e38b23 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 200 len: 1474 microversion: 2.1 time: 0.286992 Sep 03 21:06:59.034586 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2332/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:58 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 1474 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:06:59.103868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95205acf-bca5-45b7-9bfc-ac86b65402ae", "name": "network-vif-deleted", "tag": "c026dcdf-0d2c-4da2-8283-17e385ba07a4"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:59.168322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:59.168985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:59.178664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.179206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.184291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.185247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.203562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.205844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.207163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.209029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.209712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.260233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] Creating event network-vif-deleted:c026dcdf-0d2c-4da2-8283-17e385ba07a4 for instance 95205acf-bca5-45b7-9bfc-ac86b65402ae on nch2-master-1 Sep 03 21:06:59.271525 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d1878d4b-7fbf-4ead-9307-82aaa191c6aa req-5b967203-3bb8-4cad-a78a-f452b5626471 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172414 Sep 03 21:06:59.276758 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2092/4424] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:06:59.350275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:59.351285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:59.367051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.367653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.368121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.371925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.374487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.374968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.464387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:59.485942 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c9f5936-208e-41b3-aead-95afc776fbba tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1267 microversion: 2.1 time: 0.321551 Sep 03 21:06:59.505476 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2333/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:59 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:59.597868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:06:59.611762 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbf14bb9-f8b1-4172-892f-3d66247cea1e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1499 microversion: 2.1 time: 0.267529 Sep 03 21:06:59.613987 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2093/4426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:59 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1499 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:06:59.638921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:06:59.643230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:59.651232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.651734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.652567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.654370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.654987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.655564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.687393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lazy-loading 'flavor' on Instance uuid 30001215-9654-4e7e-850c-2a38e10f4f98 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:06:59.811995 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f1168a22-3e89-42c2-b6f7-f4069050ec53 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "POST /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98/action" status: 200 len: 32 microversion: 2.1 time: 0.177781 Sep 03 21:06:59.813010 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2334/4427] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:06:59 2022] POST /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:06:59.825752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:06:59.826554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:06:59.837863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.838512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.839378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:06:59.840375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:06:59.841232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:06:59.842459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:00.061801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:00.062615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:00.074451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:00.075008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:00.082600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:00.084643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:00.088281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:00.089602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:00.132604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae HTTP/1.1 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '95205acf-bca5-45b7-9bfc-ac86b65402ae'} Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:00.146967 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:00.151437 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82e6a7e5-f16a-4785-b7f1-48dcd9050f58 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 404 len: 111 microversion: 2.1 time: 0.092354 Sep 03 21:07:00.154328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2335/4428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:00 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:00.157035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d6d9873-5bed-4b71-9a15-7222a3290e3f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '.version_select at 0x7fae65f5c160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:00.198370 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d6d9873-5bed-4b71-9a15-7222a3290e3f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1894581463" status: 202 len: 0 microversion: 2.1 time: 0.044907 Sep 03 21:07:00.204634 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2336/4429] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Sep 3 21:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1894581463 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:07:00.435342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1255412774", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:00.448371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:00.457813 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06be42d4-8382-4d5f-bbcf-db003f8b5911 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.639072 Sep 03 21:07:00.459046 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2094/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:06:59 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:00.519234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:00.519926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:00.532386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:00.535550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:00.538909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:00.541203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:00.541965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:00.542540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:00.581402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:00.668256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:00.678688 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-14835942-c8c3-4d99-8dde-084d36e34916 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1273 microversion: 2.1 time: 0.163896 Sep 03 21:07:00.685151 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2095/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:00 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:01.485702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:01.487242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:01.507306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:01.509037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:01.511618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:01.513546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:01.515198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:01.517101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:01.574565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:02.134011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:02.148925 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74672751-f541-453b-9afc-f68290c043f9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.668294 Sep 03 21:07:02.150398 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2096/4432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:01 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:02.165107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:02.166055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:02.177542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:02.178537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:02.179008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:02.179774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:02.180756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:02.181402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:02.302624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:02.310872 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc2f97ca-0a39-4b6a-aaa8-5b8d0f71cb80 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1273 microversion: 2.1 time: 0.158921 Sep 03 21:07:02.312674 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2097/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:02 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:02.393493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:02.395376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:02.398949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:02.400229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:02.400873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:02.437776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:02.440450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:02.440964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:02.443254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:02.445270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:02.445811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:02.518594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:02.530594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:02.554908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:02.557726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:02.637143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f183d036-913b-4225-9735-01fb399f3fa5 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206381 Sep 03 21:07:02.638692 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2337/4434] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:07:02.650669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea6a1705-8a3e-46bd-ac39-2a782be25963 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:02.651293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea6a1705-8a3e-46bd-ac39-2a782be25963 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:02.788516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea6a1705-8a3e-46bd-ac39-2a782be25963 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:02.800631 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea6a1705-8a3e-46bd-ac39-2a782be25963 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1209 microversion: 2.1 time: 0.154738 Sep 03 21:07:02.809306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2098/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:02 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:03.178089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:03.178866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:03.190752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.191613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.192276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.193795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.194475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.195138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.345193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:03.345815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:03.356710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.357266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.357719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.358456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.358924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.359365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.562296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:03.572259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-df8fea39-65f3-42df-ae4a-fe7604b68eea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.230964 Sep 03 21:07:03.572999 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2099/4436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:03 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:03.753066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:03.764874 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-256e62a8-38a2-49cd-bc26-526691eba37a tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.592435 Sep 03 21:07:03.789278 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2338/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:03 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:03.825068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:03.825858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:03.846906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.850132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.850698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.851524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:03.866742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:03.867436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:03.994337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:04.010410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2494da8a-42a9-408e-9030-93785e40f4b7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1261 microversion: 2.1 time: 0.190414 Sep 03 21:07:04.027245 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2100/4438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:03 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:04.598175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:04.599653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:04.626860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:04.631792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:04.634031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:04.637727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:04.639771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:04.644035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:04.792669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:04.793558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:04.804004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:04.808982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:04.809460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:04.810244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:04.810665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:04.815531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:05.211592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:05.219999 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bd4f1161-a977-4efb-8ee0-65aa05d6478d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.625708 Sep 03 21:07:05.228761 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2339/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:04 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:05.233981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:05.234801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:05.270208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:05.271439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:05.273746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:05.274662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:05.275934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:05.276314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:05.480441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:05.494223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3931a71d-d4ec-423b-8052-7a9e6730b624 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1267 microversion: 2.1 time: 0.263867 Sep 03 21:07:05.495325 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2340/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:05 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:05.509850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28ff0e1-77c3-49e5-ac31-a18852bb74d4", "tag": "5ac4259c-37eb-45f0-ba45-443db52c6f1f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:05.534591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:05.535173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:05.535807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:05.579557 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] Creating event network-changed:5ac4259c-37eb-45f0-ba45-443db52c6f1f for instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 on nch1-master-1 Sep 03 21:07:05.616128 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b875c6fb-0d2b-4fa7-b454-164814aea0f8 req-5882678d-c49e-410c-bdbc-d300bc5d27ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110884 Sep 03 21:07:05.617133 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2341/4441] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:05.715977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:05.729339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08a7bcbd-6772-4647-9ac3-8eb896acee20 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.940560 Sep 03 21:07:05.735400 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2101/4442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:04 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:06.257591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:06.259630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:06.292951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.293634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.294763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:06.296714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.298530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.300145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:06.522082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:06.522904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:06.542620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.543766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.545987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:06.548719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.549542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.554355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:06.768126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:06.789298 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d95102d5-4670-4794-bef9-539607b938f0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1267 microversion: 2.1 time: 0.271447 Sep 03 21:07:06.790759 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2102/4443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:06 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:06.811665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:06.831291 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6f9ba486-8454-4e5e-ae1f-5d2cedc3af0e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.576140 Sep 03 21:07:06.832234 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2342/4444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:06 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:06.841890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:06.847373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:06.876364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.877313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.878419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:06.880985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:06.883729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:06.888018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:07.158439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-334337584", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "143561dd-488d-4a88-9b3a-d72012bba8ee"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:07.181819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:07.194466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e16645c0-b873-486d-a3ca-d7c49254d4a4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.359802 Sep 03 21:07:07.196071 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2343/4445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:06 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:07.250696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] validate_networks() for [('143561dd-488d-4a88-9b3a-d72012bba8ee', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:07.819620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:07.820972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:07.831309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:07.832160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:07.832787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:07.834887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:07.835506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:07.836314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.219143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:08.238974 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb202fe1-5003-4996-838d-214575f4adce tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.429274 Sep 03 21:07:08.253153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2344/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:07 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:08.265550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:08.266333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:08.275882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.276554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.277233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.278076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.278797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.279347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.503289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:08.513273 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ee22632-4494-471f-a657-ff27e9596a7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.258452 Sep 03 21:07:08.526917 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2345/4447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:08 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:08.536085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:08.536085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.545576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.648395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:08.648881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:08.649562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:08.649830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:08.650258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:08.670297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.673022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.673497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.676135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:08.677648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:08.678118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:08.728761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Getting quotas for project ae91188b2c8b43d4bc6114581be12847. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:08.744976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Getting quotas for user 5eff5aacf85a4fda97f6eb375da7cf26 and project ae91188b2c8b43d4bc6114581be12847. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:08.776011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:08.780343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:08.808996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:08.821732 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-72808ed4-4d03-4d22-820b-86d971a3f2f4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.299685 Sep 03 21:07:08.825936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2346/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:08 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:08.878663 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-921fecad-2de5-47ee-b231-405bb1d282ed tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.086134 Sep 03 21:07:08.881185 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2103/4449] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:07:08.892785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:08.893613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:09.026859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:09.036724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:09.038551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:09.039973 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-744c91c3-00d1-4fff-b234-2cd3d0bbed4c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1261 microversion: 2.26 time: 0.151151 Sep 03 21:07:09.041281 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2347/4450] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:08 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:09.268330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:09.269039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:09.278700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:09.284623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:09.286966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:09.289221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:09.289729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:09.290186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:09.543310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:09.543984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:09.583361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:09.583889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:09.584321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:09.592384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:09.597429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:09.598188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:09.949099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:09.967973 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba28b0e6-5822-4fee-92a9-f28b384fb85c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.703683 Sep 03 21:07:09.981065 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2104/4451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:09 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:09.991765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:09.996631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:10.011516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:10.012037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:10.012482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:10.015497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:10.027642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:10.028627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:10.411967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:10.438087 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b48bc88-c4c0-42e6-baf1-8a593bb81c7b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.899608 Sep 03 21:07:10.441395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2348/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:09 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:10.463884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:10.464555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:10.480243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:10.482057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:10.484072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:10.485874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:10.487786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:10.488428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:10.633750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:10.648085 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ca120b8f-3a07-428b-bd0a-8760d3fd42ab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.663268 Sep 03 21:07:10.650670 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2105/4453] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:09 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:10.672659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:10.681214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:10.689879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:10.692791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-847e0298-548c-43f6-b26b-dc23bddcb7d1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1313 microversion: 2.26 time: 0.238413 Sep 03 21:07:10.703266 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2349/4454] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:10 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:10.996241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:10.997901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:11.021820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.023989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.026584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.030262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.032120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.033388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.191924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b26b46-d45d-4134-8c34-2e398dda06cb", "tag": "71f9b9b4-1172-404f-83cc-d000ab628f24"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:11.219464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.233484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.234413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.241576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:11.260090 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] Creating event network-changed:71f9b9b4-1172-404f-83cc-d000ab628f24 for instance 42b26b46-d45d-4134-8c34-2e398dda06cb on nch2-master-1 Sep 03 21:07:11.268588 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ed7105b3-cb9c-4aee-9cd5-7ed4398dc236 req-30dde364-45a0-4b75-975b-c448728b6bac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081399 Sep 03 21:07:11.276600 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2350/4455] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:11.466180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:11.466945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:11.479098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.481808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.486261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.488113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.490227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.490889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.811981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:11.826298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3646563c-ec6b-4e70-b75c-c53066dd9f44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.365490 Sep 03 21:07:11.826894 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2351/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:11 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:11.834052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:11.834673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:11.846375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.847093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.847727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:11.849584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:11.850203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:11.851865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:12.096743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:12.116059 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c08fdcec-8c86-4168-a0c5-483a000495d2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.285994 Sep 03 21:07:12.117218 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2352/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:11 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:12.123362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:12.124164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:12.138008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:12.138991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:12.140521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:12.141671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:12.142487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:12.143767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:12.176465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:12.184497 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53dcb694-f0e2-480c-91f3-e8b5daf464ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 1.193728 Sep 03 21:07:12.185111 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2106/4458] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:10 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:12.271070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:12.281989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:12.283490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:12.285505 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b209e20f-14a0-40ca-8a8c-bd2bf6ba4b54 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1319 microversion: 2.26 time: 0.166380 Sep 03 21:07:12.286133 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2353/4459] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:12 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:12.852078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:12.853078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:12.864648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:12.873962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:12.874622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:12.875597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:12.876250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:12.876868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.142605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:13.143232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:13.152296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:13.153997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.154502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.154948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.155674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.156143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.165456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.502812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.514020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78a0033f-6761-4b1c-b5ed-fe30e806e6a2 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.375482 Sep 03 21:07:13.515146 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2354/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:13 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:13.520682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:13.521542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:13.528073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.529829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.530461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.531429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.532054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.532494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.542049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.555736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8163ec7-0b1d-4b29-ab56-5474a233dd7c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.705289 Sep 03 21:07:13.557602 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2107/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:12 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:13.578385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28ff0e1-77c3-49e5-ac31-a18852bb74d4", "name": "network-vif-plugged", "status": "completed", "tag": "5ac4259c-37eb-45f0-ba45-443db52c6f1f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:13.594981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.595461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.596139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.611766 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] Creating event network-vif-plugged:5ac4259c-37eb-45f0-ba45-443db52c6f1f for instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 on nch1-master-1 Sep 03 21:07:13.618456 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6a03efb5-0b44-4f8a-ac68-b14381593c18 req-75b464ef-7421-4764-a0ef-9eb2401e769b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044835 Sep 03 21:07:13.625551 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2108/4462] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:13.632438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:13.633213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:13.642768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.643276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.643729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.644441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:13.644951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:13.645960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:13.831683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.842317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.845892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.847264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fea23fa3-b10b-481e-a700-2142d35a7842 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1319 microversion: 2.26 time: 0.220343 Sep 03 21:07:13.849285 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2109/4463] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:13 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:13.960100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:13.997886 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-799e1227-ce68-46e4-8184-90d99dc4ac4d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.459196 Sep 03 21:07:13.998856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2355/4464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:13 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:14.538053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:14.538760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:14.558956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.560439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.561140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:14.562063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.562747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.563402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:14.585760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:14.586375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:14.598064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.599352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.599800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:14.605615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.606210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.606667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:14.815595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:14.826837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-806015af-5fc4-4a7d-8a5a-ee316b9f5021 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1315 microversion: 2.1 time: 0.244982 Sep 03 21:07:14.827653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2356/4465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:14 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:14.878036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:14.878522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:14.885032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.885529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.885980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:14.886683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:14.887308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:14.887744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:15.051213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:15.063224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:15.065136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:15.066576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-765ccc9e-45d8-4dee-b7e3-70d6c8462f9d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.192546 Sep 03 21:07:15.087998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2357/4466] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:14 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:15.113253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:15.114709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:15.146623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:15.147139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:15.147592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:15.153141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:15.153636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:15.158837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:15.193682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:15.208553 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-770b3746-c46b-4907-8b0f-4481406066ae tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.674119 Sep 03 21:07:15.213984 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2110/4467] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:14 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:15.407941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:15.421582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2a1a6570-9975-4180-a458-b1e5909854ca tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.330523 Sep 03 21:07:15.422401 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2358/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:15 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:15.858426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:15.859151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:15.875989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:15.876537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:15.877086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:15.877768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:15.881651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:15.882152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:15.956259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d7891e-5d7b-449f-92bf-86a4476caf41", "tag": "9f2f7ad9-2eaf-4012-b61e-7e43b24c428e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:15.975464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:15.976208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:15.976847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.004097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] Creating event network-changed:9f2f7ad9-2eaf-4012-b61e-7e43b24c428e for instance a2d7891e-5d7b-449f-92bf-86a4476caf41 on nch1-master-1 Sep 03 21:07:16.011780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fa9a1da7-0009-46ae-a2a0-e983804e014e req-6d708480-6a34-4984-aac2-43d783323535 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060553 Sep 03 21:07:16.012923 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2359/4469] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:16.113473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:16.122127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:16.141333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.141850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.142295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.144938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.145498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.146124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.264884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.275780 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06aacaad-412f-4af1-b057-8d04705258ab tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1502 microversion: 2.1 time: 0.422128 Sep 03 21:07:16.276784 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2111/4470] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:15 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:16.283430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:16.284391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:16.292191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.292975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.293643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.294625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.295439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.296083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.425468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.436429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.447109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.448302 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce2d9cb9-6ae8-4554-a6bb-fc6ace2527b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.357297 Sep 03 21:07:16.448975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2360/4471] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:16 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:16.464711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:16.471410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.471929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.472369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.517892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:07:16.600179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a89d1ecc-20fc-4859-8f6f-3da2b276e17c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4/action" status: 202 len: 0 microversion: 2.1 time: 0.148178 Sep 03 21:07:16.605124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2361/4472] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:07:16 2022] POST /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:07:16.612256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:16.613297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:16.622937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.623755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.624387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.625428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.626248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.626780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.660040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.672673 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1ada7dd-575c-4af7-ac57-369783eec5b4 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.392735 Sep 03 21:07:16.673442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2112/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:16 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:16.695319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:16.708547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:16.725930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.727551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.728813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.729798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:16.731348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:16.733025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:16.834781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:16.844414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-821b49e6-db7c-46dc-8659-768c74e8f4db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.237481 Sep 03 21:07:16.846038 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2362/4474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:16 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:17.461704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:17.478127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:17.478751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:17.480466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b2a1008-1815-4b66-b2e8-860bb122e71b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.803229 Sep 03 21:07:17.481781 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2113/4475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:16 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:17.513183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.513940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.514531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.515553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.518066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.519124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.705581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:17.707062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:17.727315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.727922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.728440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.729292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.729959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.730573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.741270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:17.757406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:17.758873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:17.779472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e593486-9e6d-416b-bce2-dbf52a518148 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.305549 Sep 03 21:07:17.782448 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2363/4476] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:17 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:07:17.872180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:17.872859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:17.886025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.886521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.889322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.893102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:17.893934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:17.894707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:17.968154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:17.977124 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d098e9e-a87d-4b65-b675-6403c789a9d9 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.275728 Sep 03 21:07:17.980979 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2114/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:17 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:18.174281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:18.185398 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f271268d-af81-41f0-b736-f4451a331eaa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.317106 Sep 03 21:07:18.198516 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2364/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:17 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:18.505441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:18.507335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:18.520223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:18.522247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:18.524926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:18.527410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:18.530921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:18.532118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:18.582043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:18.713978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:18.760321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:18.778089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:18.806748 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-512250d3-98b6-4ce1-8ae3-ebf6c2535dd3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.294913 Sep 03 21:07:18.807092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:18.807730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:18.809243 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2115/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:18 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:18.827575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:18.830333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:18.830953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:18.833945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:18.834605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:18.836865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.005824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:19.006462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:19.025331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.026102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.028091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.030664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.031443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.031895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.032864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:19.037642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:19.051307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:19.054951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:19.057122 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f53372f7-c69b-4169-81c3-dcd533cc6864 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.254301 Sep 03 21:07:19.076632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2365/4480] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:18 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:07:19.214026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:19.214983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:19.228399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.230485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.231238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.232991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.235055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.235967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.370233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:19.378670 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a84daed9-a7bb-4bc5-89fc-3c2c921f9533 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.378732 Sep 03 21:07:19.383102 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2116/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:18 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:19.474911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:19.494612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b26b46-d45d-4134-8c34-2e398dda06cb", "name": "network-vif-plugged", "status": "completed", "tag": "71f9b9b4-1172-404f-83cc-d000ab628f24"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:19.502076 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12c40f8b-3ca1-4ff3-bf68-ca9d56c4150f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 0.291823 Sep 03 21:07:19.505563 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2366/4482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:19 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:19.514282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.514829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.515196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.542379 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] Creating event network-vif-plugged:71f9b9b4-1172-404f-83cc-d000ab628f24 for instance 42b26b46-d45d-4134-8c34-2e398dda06cb on nch2-master-1 Sep 03 21:07:19.550048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-84471034-225d-4646-9789-6b84a88a1488 req-93bb6aa3-f8f7-43d1-805e-58f674c88b16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060487 Sep 03 21:07:19.551250 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2117/4483] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:19.836414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:19.837981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:19.845387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.845991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.846603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.847688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:19.848784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:19.849587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:19.853713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:20.008365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:20.019617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d3a15aa-43a7-403c-83c6-9bd138478ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.187079 Sep 03 21:07:20.021567 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2367/4484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:19 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:20.083549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:20.084250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:20.092328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.093238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.093896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.094698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.095248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.095842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.411780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:20.412587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:20.419793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.420541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.421232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.422175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.427575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.428309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.445584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:20.475771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:20.479227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:20.484328 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eefe6a0b-d947-4e46-82e3-9ef60a63232a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.401722 Sep 03 21:07:20.484982 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2118/4485] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:20 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:20.540617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:20.542008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:20.551106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.552182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.553870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.555064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:20.558190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:20.561403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:20.647898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:20.656552 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dd29e50e-d620-462e-8259-ffb691e6360d tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.251445 Sep 03 21:07:20.662531 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2368/4486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:20 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:21.046719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:21.048209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:21.068498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:21.070768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.071452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.071972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.072731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.073367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.073857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.524101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:21.539465 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb44be45-ee29-4508-90ab-69ed036b896b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1309 microversion: 2.1 time: 1.003458 Sep 03 21:07:21.542854 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2119/4487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:20 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1309 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:21.557406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:21.558325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:21.566711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:21.577675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.578306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.580336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.581330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.581806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.584543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.589643 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd25304b-73c3-43dc-b0ba-3996e8166562 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.539400 Sep 03 21:07:21.621079 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2369/4488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:21 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:21.689143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:21.690116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:21.703137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.703989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.706567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.708200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:21.712473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:21.713194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:21.963054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:21.972822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:21.975775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:21.977924 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89bfefb1-d77a-4540-a038-f88768663737 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.434067 Sep 03 21:07:21.994655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2120/4489] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:21 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:22.063201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:22.074781 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-589e3833-fcbc-4be5-820b-a7e655788fe8 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.390819 Sep 03 21:07:22.076205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2370/4490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:21 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:22.582431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:22.588353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:22.611029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:22.614439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:22.615927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:22.617941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:22.621102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:22.623330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:22.623998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:22.624432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:22.636723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:22.638946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:22.639617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:22.640460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:22.648971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:22.650808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:22.916442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:22.926746 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-891dfd6d-4de7-407d-b258-403c13aa2804 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1490 microversion: 2.1 time: 0.362100 Sep 03 21:07:22.937036 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2121/4491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:22 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1490 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:22.975526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:22.987084 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b56ae698-6db3-4e5d-bb3a-c31b5aee5970 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.367726 Sep 03 21:07:22.987690 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2371/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:22 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:23.014081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:23.015280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:23.028200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:23.028707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:23.030845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:23.031771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:23.032938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:23.033547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:23.101797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:23.102433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:23.110841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:23.111568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:23.112856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:23.114598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:23.126250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:23.127277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:23.251338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:23.261281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:23.262785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:23.263939 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1fe1dbaa-994b-4e1f-8ee9-2e8c53c5eec2 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.255955 Sep 03 21:07:23.264687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2122/4493] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:23 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:23.269539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1255412774", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:23.339042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:23.483168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:23.493835 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d91a7fbb-e331-49f4-94b9-4657e924e904 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.396533 Sep 03 21:07:23.511811 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2372/4494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:23 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:23.778613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d7891e-5d7b-449f-92bf-86a4476caf41", "name": "network-vif-plugged", "status": "completed", "tag": "9f2f7ad9-2eaf-4012-b61e-7e43b24c428e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:23.803856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:23.808549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:23.809351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:23.829311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] Creating event network-vif-plugged:9f2f7ad9-2eaf-4012-b61e-7e43b24c428e for instance a2d7891e-5d7b-449f-92bf-86a4476caf41 on nch1-master-1 Sep 03 21:07:23.841152 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b9910600-89ab-4483-8de7-003b912f1492 req-4ee8fb79-878e-4415-8d21-4303e4e6ba46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066208 Sep 03 21:07:23.846094 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2373/4495] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:24.017473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:24.018985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:24.019729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:24.020829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:24.021432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:24.021574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:24.022185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:24.033281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.033785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.034228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.034947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.035423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.035953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.054540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.055266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.056068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.057131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.057758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.058377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.083835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:24.093173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:24.115969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:24.126439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:24.130266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:24.212108 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-821ea386-ae0e-4d4b-b982-25e7dd533d16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946125 Sep 03 21:07:24.216932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2123/4496] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:07:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:07:24.226801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a187dfa-74c4-4216-aee0-54d822a0e169 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:24.227452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a187dfa-74c4-4216-aee0-54d822a0e169 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:24.308417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a187dfa-74c4-4216-aee0-54d822a0e169 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.316641 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a187dfa-74c4-4216-aee0-54d822a0e169 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1209 microversion: 2.1 time: 0.095087 Sep 03 21:07:24.317798 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2124/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:24 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:24.330056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:24.331209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:24.345748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.346260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.346759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.347613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.348169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.348710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.595518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.601383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.604948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.607671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.608823 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b7d1b2df-a5ba-4b15-8258-e93df56cc561 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1361 microversion: 2.26 time: 0.289905 Sep 03 21:07:24.617286 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2125/4498] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:24 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:24.620688 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-657b6aa7-d2ae-4263-99ab-de0b14694e76 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.610087 Sep 03 21:07:24.623222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:24.624048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:24.628259 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2374/4499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:24 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:24.655694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.656493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.658949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.660331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:24.661021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:24.661659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:24.867303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:24.877366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a13cca78-7a32-46bc-91ee-7822b5526617 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.266537 Sep 03 21:07:24.889407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2126/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:24 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:25.297361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1022669385", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "26f7e790-bcc4-4591-8ad3-0da31395c3e4"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:25.341548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:25.346447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:25.354199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.355387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.355991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.356885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.357541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.358127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.387461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] validate_networks() for [('26f7e790-bcc4-4591-8ad3-0da31395c3e4', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:25.444925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:25.459350 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-66b67f77-22f7-40b7-9b6b-11efe82ffd9c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1205 microversion: 2.1 time: 0.121921 Sep 03 21:07:25.461274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2127/4501] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:25 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1205 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:25.656959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:25.657589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:25.673288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.680209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.682307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.683405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.686375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.687072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.939648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:25.949846 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8915511-f57b-4cac-b004-4c2f6d1b930d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.296764 Sep 03 21:07:25.950723 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2128/4502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:25 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:25.971404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:25.972198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:25.972915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:25.973466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:25.973817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:25.974572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:25.975061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:25.981764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.982558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.983222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.984255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.984955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.985188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.985647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.985789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.986096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:25.986846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:25.987570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:25.987727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.016995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Getting quotas for project 1646ccd0c1d442bdbab54ad9f44e3aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:26.023442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Getting quotas for user 1cf3a90cb1034ae39f67fb0fa74366f7 and project 1646ccd0c1d442bdbab54ad9f44e3aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:26.043398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:26.046074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:26.137065 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50c0cf80-a290-49a2-a33b-9381b4eb8632 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.196556 Sep 03 21:07:26.138681 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2375/4503] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:07:26.148727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.149548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.157427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.157934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.158384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.159107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.159571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.160009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.169285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.178361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.179807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.187033 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5069e0c-29ab-43e1-b701-2ef8af5450e1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1545 microversion: 2.26 time: 0.218235 Sep 03 21:07:26.187611 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2129/4504] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:25 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1545 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:26.197554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64845413-9352-4132-a77e-11cfd9e51c43 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.198328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64845413-9352-4132-a77e-11cfd9e51c43 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.294457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64845413-9352-4132-a77e-11cfd9e51c43 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.303522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64845413-9352-4132-a77e-11cfd9e51c43 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1228 microversion: 2.1 time: 0.114895 Sep 03 21:07:26.304668 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2130/4505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1228 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:26.311430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65dfda60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.326486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.327409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.328066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.328754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.358423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.360482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.361113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.362110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.362721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.363301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.404700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.406157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.406762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.430242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.440063 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e0479a4-0693-4304-b649-7a536f8087ad tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.300002 Sep 03 21:07:26.446942 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2376/4506] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:26.470239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.471111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.478589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.489112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.489746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.505328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.505866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.506320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.507059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.507531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.507971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.550060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:26.584175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec339500-5705-4d42-84c5-2df530badf4f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-2034337656" status: 201 len: 0 microversion: 2.26 time: 0.278240 Sep 03 21:07:26.589578 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2131/4507] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Sep 3 21:07:26 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-2034337656 => generated 0 bytes in 284 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 03 21:07:26.595278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67b71b04-ca5b-440b-8549-abf83a32297c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d7d8b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.606365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67b71b04-ca5b-440b-8549-abf83a32297c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.606757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67b71b04-ca5b-440b-8549-abf83a32297c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.607179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67b71b04-ca5b-440b-8549-abf83a32297c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.631404 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67b71b04-ca5b-440b-8549-abf83a32297c tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-2034337656" status: 204 len: 0 microversion: 2.26 time: 0.040363 Sep 03 21:07:26.632126 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2132/4508] 10.222.0.16 () {60 vars in 1361 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-2034337656 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:07:26.642056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae66405670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.650342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.650841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.652071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.652071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.667050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.667672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.668420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.669190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.670019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.670395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.682050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:26.690784 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3fac1fcc-92b0-4443-8571-c73ed1f39466 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1279 microversion: 2.1 time: 0.205643 Sep 03 21:07:26.692314 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2377/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:26.711605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.712117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.712731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.731743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:26.736141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:26.754347 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20394811-98aa-4159-aced-a1beee8bd0a4 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 204 len: 0 microversion: 2.26 time: 0.116368 Sep 03 21:07:26.760604 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2133/4510] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Sep 3 21:07:26 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:07:26.766061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a04c4b5-a085-43a4-a3f3-fb797e3c780a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65cd7160>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.779752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a04c4b5-a085-43a4-a3f3-fb797e3c780a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.781974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a04c4b5-a085-43a4-a3f3-fb797e3c780a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.782614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a04c4b5-a085-43a4-a3f3-fb797e3c780a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.812276 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a04c4b5-a085-43a4-a3f3-fb797e3c780a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 12 microversion: 2.26 time: 0.050645 Sep 03 21:07:26.813530 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2378/4511] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:26.824107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae66405e50>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.836769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.840394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.841839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.843390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.860924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.861830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.864406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.866451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.868025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.870611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.917035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.917690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.918386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.929689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.930383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.931024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.976270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:26.977361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:26.983460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:26.993628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.994594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.995543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:26.997531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:26.998578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:26.999348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.010720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5fdb1ae8-8224-437e-ae26-6ee0f07af1b1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-463520806" status: 201 len: 0 microversion: 2.26 time: 0.191192 Sep 03 21:07:27.013793 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2134/4512] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Sep 3 21:07:26 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-463520806 => generated 0 bytes in 194 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 03 21:07:27.024646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3457e4da-bc1d-4071-a197-669afdb5db61 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d7daf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.041413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3457e4da-bc1d-4071-a197-669afdb5db61 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.042405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3457e4da-bc1d-4071-a197-669afdb5db61 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.042909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3457e4da-bc1d-4071-a197-669afdb5db61 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.053895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3457e4da-bc1d-4071-a197-669afdb5db61 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 35 microversion: 2.26 time: 0.032711 Sep 03 21:07:27.055420 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2135/4513] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 21:07:27 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 35 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.068358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d9f0d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.085050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.085539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.085969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.086454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.092256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.092744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.093290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.105067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.106205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.106907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.144758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.145699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.146158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.201374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:27.250720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a6b8a78b-88ba-4287-b2b1-762fba73dc2f tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-463520806" status: 204 len: 0 microversion: 2.26 time: 0.188623 Sep 03 21:07:27.251329 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2136/4514] 10.222.0.16 () {60 vars in 1361 bytes} [Sat Sep 3 21:07:27 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-463520806 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:07:27.260430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-69eabb34-3c37-4aed-8b74-f52668c36285 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65da49d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.273491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69eabb34-3c37-4aed-8b74-f52668c36285 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.283589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69eabb34-3c37-4aed-8b74-f52668c36285 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.284291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69eabb34-3c37-4aed-8b74-f52668c36285 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.306323 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-69eabb34-3c37-4aed-8b74-f52668c36285 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 12 microversion: 2.26 time: 0.050682 Sep 03 21:07:27.306938 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2137/4515] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 21:07:27 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.328277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d2e9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.341054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:27.349925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.350429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.351014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.351510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.363341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5018f62b-cb20-4806-88fa-1c7e7e851974 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.387972 Sep 03 21:07:27.367595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2379/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:26 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.374056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.375145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.385635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.386723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.387332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.388249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.388994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.389723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.395554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.396299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.405059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.406267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.406580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.407072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.444082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.444583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.445466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.462719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:27.486277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5fe3c8cc-60d9-4802-88f5-0b3d51120ba0 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 204 len: 0 microversion: 2.26 time: 0.167677 Sep 03 21:07:27.486972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2138/4517] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Sep 3 21:07:27 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:07:27.505875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.507524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.524029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.524535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.525159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.525891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.529094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.530360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.537696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:27.553630 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3c90e517-a583-4aaa-8a30-fded6db22bfc tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1224 microversion: 2.1 time: 0.180296 Sep 03 21:07:27.572998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2380/4518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:27 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.579028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65bc6790>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.594638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.595389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.605479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.607758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.624143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.624788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.625364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.626320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.626964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.627657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.680248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.681072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.681666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.703089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.703089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.709912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.755405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:27.790395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aec11ccd-f294-4392-bd69-dcfc663549a5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-1313431272" status: 201 len: 0 microversion: 2.26 time: 0.205335 Sep 03 21:07:27.793311 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2381/4519] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Sep 3 21:07:27 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-1313431272 => generated 0 bytes in 220 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 03 21:07:27.805648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.806638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.814390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.816098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.816780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.818415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.819685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.820360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.839615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:27.851170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37548238-6163-4a29-9b30-b08d96804fda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.359540 Sep 03 21:07:27.852120 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2139/4520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:27 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.859365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d9fd30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:27.880082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.880583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.881051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.881811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:27.888575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.889293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.889918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.891344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.892270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.892846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.931242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:27.940317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.940939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.941497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:27.955137 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0a6ddde-897b-410e-8d18-6fdd5d3608df tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1267 microversion: 2.1 time: 0.158838 Sep 03 21:07:27.957692 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2382/4521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:27 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:27.968807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:27.969917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:27.970599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.024456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:28.043769 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5ed0a78-f707-4a5e-a55c-7319abad06b3 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-513775506" status: 201 len: 0 microversion: 2.26 time: 0.190245 Sep 03 21:07:28.050168 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2140/4522] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Sep 3 21:07:27 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-513775506 => generated 0 bytes in 197 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 03 21:07:28.055790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65bc6e50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.068957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.069429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.069889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.070349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.086638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.087350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.087960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.088855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.089775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.090358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.143286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.143579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.144199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.154387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:28.190366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:28.262897 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84f0ecf7-aa84-444d-8a2f-5a70a43aaef1 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 204 len: 0 microversion: 2.26 time: 0.212191 Sep 03 21:07:28.271866 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2383/4523] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Sep 3 21:07:28 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:07:28.285280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43df2272-8e05-4845-a9be-b30f4f1dfc73 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d2ec10>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.302613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43df2272-8e05-4845-a9be-b30f4f1dfc73 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.303296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43df2272-8e05-4845-a9be-b30f4f1dfc73 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.303934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43df2272-8e05-4845-a9be-b30f4f1dfc73 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.324138 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-43df2272-8e05-4845-a9be-b30f4f1dfc73 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 12 microversion: 2.26 time: 0.044471 Sep 03 21:07:28.327225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2141/4524] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 21:07:28 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:28.339004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65c608b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.349868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.350884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.351693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.352388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.359388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.360202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.360845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.361821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.362897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.363813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.395919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.397307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.413679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.415144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.416077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.417370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.417859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.418305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.419076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.420224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.422526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.446576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:28.485279 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c781eca0-32fb-4e00-866f-cadf7d0b018a tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 204 len: 0 microversion: 2.26 time: 0.151010 Sep 03 21:07:28.504494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2384/4525] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Sep 3 21:07:28 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:07:28.512216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65c1dc10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.539699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.540474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.555673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.556430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.562887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.563397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.563845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.564568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.565069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.565507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.636835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.637469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.637795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.667406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.667912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.668362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.701525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:28.725638 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-417e2f51-144a-4652-8d94-bc4583648836 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-197829496" status: 201 len: 0 microversion: 2.26 time: 0.218485 Sep 03 21:07:28.730964 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2385/4526] 10.222.0.16 () {62 vars in 1377 bytes} [Sat Sep 3 21:07:28 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-197829496 => generated 0 bytes in 221 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 03 21:07:28.733314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.734610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.742489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.743523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.744380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.745807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.746562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.747166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.873887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:28.884569 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8839bd18-d887-4951-b450-987f2e8b237b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1286 microversion: 2.1 time: 0.157216 Sep 03 21:07:28.897886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2386/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:28 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:28.908520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65bc68b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.926266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:28.929319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.929990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.931040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.931728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.938843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.939346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.939973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.940699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.941186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.942355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.948086 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b59d1b50-f0c0-435a-8271-45f86a2295a3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.552214 Sep 03 21:07:28.949120 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2142/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:28 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:28.957200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:28.962305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:28.982515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.985206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.985683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:28.988562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:28.989661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:28.991806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.006039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.009719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.010599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.025702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.026070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.026530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.071120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:29.124820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d031c93b-46bf-4279-9a4a-aa3a797b11e5 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-1742404529" status: 201 len: 0 microversion: 2.26 time: 0.225663 Sep 03 21:07:29.127710 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2387/4529] 10.222.0.16 () {62 vars in 1380 bytes} [Sat Sep 3 21:07:28 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags/tempest-tag-1742404529 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 03 21:07:29.151673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:29.153742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.177884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.181143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.182936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.184184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.186267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.186917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.454553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:29.478129 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-806e20c4-35b8-4a97-b425-2dc9f7b23672 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1485 microversion: 2.1 time: 0.519905 Sep 03 21:07:29.479204 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2143/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:28 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1485 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:29.484965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Action: 'update_all', calling method: .version_select at 0x7fae65d67790>, body: {"tags": ["tempest-tag-1025652991", "tempest-tag-1109831245"]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:29.501649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.506810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.507432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.507939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.516515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.517186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.517790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.518712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.519381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.519913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.548223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.557192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.558178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.586805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:29.600689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:29.609097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d85d4ade-2ee3-4165-a849-c51750af8231 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.480288 Sep 03 21:07:29.609870 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2388/4531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:29 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:29.615347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:29.616070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.622845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.623603 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c804774b-03bb-498c-b844-e56e7b2b1e78 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 62 microversion: 2.26 time: 0.129968 Sep 03 21:07:29.623780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.624344 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2144/4532] 10.222.0.16 () {62 vars in 1312 bytes} [Sat Sep 3 21:07:29 2022] PUT /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 62 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:29.624514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.625421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.626038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.626647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.636439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9da3016b-065f-44de-98e1-8802f394a5fb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65da4700>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:29.646676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9da3016b-065f-44de-98e1-8802f394a5fb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.647873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9da3016b-065f-44de-98e1-8802f394a5fb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.648337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9da3016b-065f-44de-98e1-8802f394a5fb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.669836 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9da3016b-065f-44de-98e1-8802f394a5fb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 200 len: 62 microversion: 2.26 time: 0.038205 Sep 03 21:07:29.674287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2145/4533] 10.222.0.16 () {60 vars in 1292 bytes} [Sat Sep 3 21:07:29 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 62 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:29.686946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '.version_select at 0x7fae65d7d9d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:29.700132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.701161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.701841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.702412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.712177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.713136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.714259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.715925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.715925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.716498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.747650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:29.755693 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-233e35ce-880f-47bd-aa06-8274435f08db tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "POST /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98/action" status: 202 len: 0 microversion: 2.1 time: 0.144260 Sep 03 21:07:29.756712 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2389/4534] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:07:29 2022] POST /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:07:29.763546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.765644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.766429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.776654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:29.778750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.792063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'flavor' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:29.808340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.808852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.811601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.812253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.812723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.813235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.813699 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e951745-0848-4d52-bba0-e64e64c40702 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags" status: 204 len: 0 microversion: 2.26 time: 0.131689 Sep 03 21:07:29.819823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2146/4535] 10.222.0.16 () {60 vars in 1295 bytes} [Sat Sep 3 21:07:29 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:07:29.826436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:29.827845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:29.842337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.842675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.843210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.844019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:29.844562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:29.845145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:29.882126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:29.997729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-945398bc-fb5e-4825-9659-4f7ff31bdfbb tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 204 len: 0 microversion: 2.26 time: 0.175307 Sep 03 21:07:29.998787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2147/4536] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:07:29 2022] DELETE /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:07:30.010149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:30.010856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:30.023091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.023839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.024572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.025772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.026705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.027672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.153223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.163926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.164585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cef48574-e0c7-40d0-841f-28c0eaaac4b0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1493 microversion: 2.1 time: 0.403050 Sep 03 21:07:30.166048 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2390/4537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:29 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1493 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:30.171329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:30.172613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:30.174037 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51c75280-fa6b-42c6-b12b-178b56c1b3e7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1286 microversion: 2.1 time: 0.171551 Sep 03 21:07:30.174643 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2148/4538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:29 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:30.181576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.182376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.183051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.184018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.185003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.185704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.196069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:30.196694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:30.205942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.206443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.206887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.208332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.208826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.209365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.513364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.524036 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7497113-94ac-47a3-9803-ddb73acef354 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.356588 Sep 03 21:07:30.524818 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2391/4539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:30 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:30.604446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf64772-a73f-4bcf-88ff-abc402dffcc7", "tag": "84ea7ffc-0184-4c19-a01b-fb685383ce2d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:30.615448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.616540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.617314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.635796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] Creating event network-changed:84ea7ffc-0184-4c19-a01b-fb685383ce2d for instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 on nch2-master-1 Sep 03 21:07:30.643188 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-45915c96-1382-48dc-8742-82ddd369495f req-32d27319-d0f1-4a1f-83bb-a054acc9ef6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041860 Sep 03 21:07:30.644305 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2392/4540] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:30.650631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:30.651488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:30.659779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.659779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.660190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.661477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:30.661948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:30.662612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:30.736426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.751140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.753732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.755693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d110cdc-97b2-407f-9e18-7c7c413222dd tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1551 microversion: 2.26 time: 0.563656 Sep 03 21:07:30.756513 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2149/4541] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:30 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1551 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:30.936790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:30.948348 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5dc0c990-35af-44cc-a926-19e6ad1e24c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.301901 Sep 03 21:07:30.948972 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2393/4542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:30 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:31.195627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:31.196631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:31.205432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:31.206962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:31.216331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.218275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.218759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.219193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.219737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.220355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.221300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.222157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.222759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.223893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.224737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.227202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.438296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:31.449786 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ce98e199-93e2-4907-a6c0-b4bd82363ad6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.248126 Sep 03 21:07:31.457863 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2394/4543] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:31 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:31.547671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:31.548591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:31.555737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.556689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.557159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.557873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.558329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.558756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.579591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:31.680614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:31.693012 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-699240da-9152-4f66-95be-7936d0d727a0 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1493 microversion: 2.1 time: 0.501158 Sep 03 21:07:31.693779 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2150/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:31 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1493 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:31.730572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:31.740414 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a6f23deb-2f2f-446a-aaa0-c139b82fd557 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.196720 Sep 03 21:07:31.741212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2395/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:31 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:31.786457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:31.787116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:31.794279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.795615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.796266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.797151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.797744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.798378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.972515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:31.974886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:31.981733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.982369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.982947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:31.983752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:31.984450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:31.985124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.142934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:32.151140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:32.152931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:32.154345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd540915-fd29-4c8a-b8fc-d5cc2fabdd39 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1551 microversion: 2.26 time: 0.372651 Sep 03 21:07:32.154970 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2151/4546] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:31 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1551 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:32.207788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:32.217796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf1e7cf4-6b13-463f-851e-577673b66150 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.249849 Sep 03 21:07:32.218560 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2396/4547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:31 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:32.404939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d7891e-5d7b-449f-92bf-86a4476caf41", "name": "network-vif-deleted", "tag": "9f2f7ad9-2eaf-4012-b61e-7e43b24c428e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:32.433195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.434095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.434917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.457259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] Creating event network-vif-deleted:9f2f7ad9-2eaf-4012-b61e-7e43b24c428e for instance a2d7891e-5d7b-449f-92bf-86a4476caf41 on nch1-master-1 Sep 03 21:07:32.467623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fb8637ee-f458-469f-948d-a2b13d8c4a2c req-5a1df85a-8b26-4924-9110-4e08d16966ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063675 Sep 03 21:07:32.468996 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2152/4548] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:32.471577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:32.472408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:32.480973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.481678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.482808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.484211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.484711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.485190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.711801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:32.717535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a68182b-3d3c-4e79-95bd-b29153dbe996", "tag": "61443ac6-32b5-448c-8c2d-7a822e2fccd7"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:32.737672 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-525231ac-a2c1-4aad-85fb-daad57083903 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.268796 Sep 03 21:07:32.740008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2397/4549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:32 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:32.747342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:32.747964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:32.752107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.752881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.753351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.763760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.771501 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] Creating event network-changed:61443ac6-32b5-448c-8c2d-7a822e2fccd7 for instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 on nch1-master-1 Sep 03 21:07:32.775180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.775850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.776754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.777496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.778253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.788421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-863fd8a5-7a20-4510-b5d1-5f70e3e2f0df req-0e06cad7-fc27-46c8-99c9-b00a8d0d89a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084079 Sep 03 21:07:32.790090 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2153/4550] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:32.798089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:32.799086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:32.809787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.810287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.810731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:32.811443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:32.812228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:32.812669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.001948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.011574 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bc5017b-be06-4d4d-a862-588394df1486 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1493 microversion: 2.1 time: 0.270380 Sep 03 21:07:33.012689 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2398/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:32 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1493 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:33.029121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.037751 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-536389b4-5705-478e-b4d5-08553e3b744d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.246184 Sep 03 21:07:33.038965 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2154/4552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:32 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:33.180035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:33.180519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:33.187496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.188099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.188544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.189314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.189790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.190223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.231541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.232171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.232718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.233813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lazy-loading 'fault' on Instance uuid a2d7891e-5d7b-449f-92bf-86a4476caf41 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:33.242120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:33.242888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:33.252983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.253956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.255176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.256637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.257356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.258008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.302107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.310616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.312083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5eff5aacf85a4fda97f6eb375da7cf26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae91188b2c8b43d4bc6114581be12847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.313313 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-efeda6b0-e4d5-4c01-a745-685221daa75d tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 200 len: 1351 microversion: 2.26 time: 0.137333 Sep 03 21:07:33.314195 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2399/4553] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:33 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 1351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:07:33.525852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:33.535724 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-96f5fe5e-e4ee-45eb-affd-6b02c8f942aa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.298525 Sep 03 21:07:33.541818 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2155/4554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:33 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:33.762248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:33.762863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:33.768810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.769332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.769765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:33.770460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:33.770913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:33.771340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.036400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.038092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.050308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.052143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.052994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.054153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.054972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.055610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.087211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:34.217873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:34.228122 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67612565-8e32-476a-930b-c0cba4061785 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.469671 Sep 03 21:07:34.228708 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2400/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:33 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:34.237481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.239274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.247481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.248006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.248458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.249207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.249726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.250162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.322917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:34.332003 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9b4f517b-d53b-460e-95bb-a4b158038a0e tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1499 microversion: 2.1 time: 0.300432 Sep 03 21:07:34.333661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2156/4556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:34 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1499 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:34.351646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.352527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] [instance: a2d7891e-5d7b-449f-92bf-86a4476caf41] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.367801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.368309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.368756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.369501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.369960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.370976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.388292 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] HTTP exception thrown: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Request method failure captured: Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 HTTP/1.1 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8H62OaXci8Zc-xwrilJZ06IdlC6P4dYeXozV7moNek78NYNwTWPbqRNYfw4YHlhufSDpqr4gdZvc4YVioPVznanh2Gqg3YKVXjeHbv3O-EFnqCwJG-Eoa_RReoAM3ACz628_jJyHj-I0S5QcaXkUj81cEUM6zADllrHFscA7npBnOo Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.26 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: ae91188b2c8b43d4bc6114581be12847 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerTagsTestJSON-1755876664 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae91188b2c8b43d4bc6114581be12847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ae91188b2c8b43d4bc6114581be12847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ae91188b2c8b43d4bc6114581be12847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ae91188b2c8b43d4bc6114581be12847"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerTagsTestJSON-1755876664 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: ae91188b2c8b43d4bc6114581be12847 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerTagsTestJSON-1755876664 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerTagsTestJSON-1755876664-project Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 5eff5aacf85a4fda97f6eb375da7cf26 Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerTagsTestJSON-1755876664-project Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a2d7891e-5d7b-449f-92bf-86a4476caf41'} Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:34.390529 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:34.395975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] Returning 404 to user: Instance a2d7891e-5d7b-449f-92bf-86a4476caf41 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:34.397001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7bea7a30-8ee1-449e-88b7-af48905c7c38 tempest-ServerTagsTestJSON-1755876664 tempest-ServerTagsTestJSON-1755876664-project] 10.222.0.16 "GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41" status: 404 len: 111 microversion: 2.26 time: 0.057132 Sep 03 21:07:34.397711 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2157/4557] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:07:34 2022] GET /compute/v2.1/servers/a2d7891e-5d7b-449f-92bf-86a4476caf41 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:07:34.406463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.406976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.415479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:34.426051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.426560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.427107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.427712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.428174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.432581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.436949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:34.453264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df03822b-fe19-4adc-b876-ed3613987e12 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.221934 Sep 03 21:07:34.454182 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2401/4558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:34 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:34.464665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:34.561996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.563166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.572871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.577258 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-71916be7-eb84-48ea-96bc-bd1adc1a308c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 204 len: 0 microversion: 2.1 time: 0.175880 Sep 03 21:07:34.577556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.578824 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2158/4559] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:34 2022] DELETE /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:07:34.579913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.584786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.588041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.588875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.598957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:34.600198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:34.625376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.626518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.627377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.628402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:34.629097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:34.630441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:34.768543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:34.779834 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3068ed64-efa4-4963-9119-837983e67921 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.223760 Sep 03 21:07:34.781051 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2402/4560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:34 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:34.893996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:34.903900 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00f65c39-273e-4a53-af9a-bd47b4d593e6 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.318117 Sep 03 21:07:34.905796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2159/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:34 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:35.253878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:35.255650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:35.265160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.265925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.266569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.267968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.268600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.269225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.477576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:35.478302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:35.485683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.486179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.486841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.487539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.488163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.488658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.517927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:35.537903 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-86d23629-8072-4e35-8788-f136f72f342a tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.288571 Sep 03 21:07:35.553839 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2403/4562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:35 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:35.768267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:35.776704 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-565bf1a4-51d6-4fa0-8a31-ff07712b3d1e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.303543 Sep 03 21:07:35.792147 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2160/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:35 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:35.807241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:35.807860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:35.814291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.814776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.815399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.816181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.816636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.817793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.933130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:35.934357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:35.942685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.943181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.943691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.944606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:35.945112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:35.945543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:35.950354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:35.955902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:35.964947 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1eabd98b-31b7-481b-ae41-ca56aeb254d7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.164804 Sep 03 21:07:35.965582 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2404/4564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:35 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:36.298998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:36.406348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:36.414786 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7fd1f67a-d16f-4fab-91e1-b5b972ed1496 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.485605 Sep 03 21:07:36.415478 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2161/4565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:35 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:36.561502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:36.562025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:36.563946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:36.564640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:36.571691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:36.572191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:36.572637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:36.573440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:36.573911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:36.574348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:36.709324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:36.718417 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c64d69d5-3501-4d07-a94f-e69663c1269e tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.160585 Sep 03 21:07:36.732299 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2405/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:36 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:36.799760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:36.801042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:36.808103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:36.808610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:36.809087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:36.809810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:36.810278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:36.810711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:36.997176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:36.998259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:37.003671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:37.011171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.015087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.015825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.016786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.019544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.020804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.132098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:37.150805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c118fe7-296f-41c4-851c-b9191382f1ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.350909 Sep 03 21:07:37.153239 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2162/4567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:36 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:37.172496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf64772-a73f-4bcf-88ff-abc402dffcc7", "name": "network-vif-plugged", "status": "completed", "tag": "84ea7ffc-0184-4c19-a01b-fb685383ce2d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:37.182943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.183698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.184274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.200536 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] Creating event network-vif-plugged:84ea7ffc-0184-4c19-a01b-fb685383ce2d for instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 on nch2-master-1 Sep 03 21:07:37.206311 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6c3aff3a-6bef-4991-8684-bc330cd1274b req-d85cc0b5-ec8c-4b7c-b903-2cba4e52ac30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Sep 03 21:07:37.207997 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2163/4568] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:37.262866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:37.272106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d8a6708-9606-4ca4-8de7-14cf5ff1b084 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.283328 Sep 03 21:07:37.287902 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2406/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:36 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:37.439527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:37.440568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:37.447765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.449677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.450352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.451256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.451875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.452459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.698550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:37.708133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56b2a05e-2a83-41a4-9dc1-58d5d16d8708 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1505 microversion: 2.1 time: 0.272870 Sep 03 21:07:37.708998 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2164/4570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:37 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:37.745614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:37.746902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:37.764052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.764555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.767750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:37.768570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:37.769080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:37.773201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.105119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:38.115245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1144b8bb-9182-4049-9c70-fe0c57940ae9 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.374971 Sep 03 21:07:38.118986 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2407/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:37 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:38.180976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:38.188320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:38.205591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.206120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.206706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.207954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.208578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.209082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.296109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:38.297191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:38.303981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.304518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.305201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.306079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.306548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.307289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.413444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:38.430871 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e396e5d7-74b1-435f-8a90-e4f62cb99cb6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.258618 Sep 03 21:07:38.432350 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2165/4572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:38 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:38.542886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30001215-9654-4e7e-850c-2a38e10f4f98", "name": "network-vif-deleted", "tag": "4c8c0a6a-9409-4de7-9ffb-761acf93c281"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:38.552333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.552829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.553297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.565257 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] Creating event network-vif-deleted:4c8c0a6a-9409-4de7-9ffb-761acf93c281 for instance 30001215-9654-4e7e-850c-2a38e10f4f98 on nch2-master-1 Sep 03 21:07:38.572516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-719e4cbf-ae7d-45b5-b0af-07b7c6f88142 req-c85f68b5-03c6-4568-a28a-adf84e883a23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Sep 03 21:07:38.577415 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2166/4573] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:38.657094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:38.667931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f6dd285-9e18-4b74-8f9a-5c975d1114ff tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1309 microversion: 2.1 time: 0.376460 Sep 03 21:07:38.668544 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2408/4574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:38 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1309 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:38.735222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:38.735915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:38.744405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.745214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.745808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.746673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:38.747285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:38.747862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:38.838004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:38.892238 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e1df1b62-8d86-414b-a44d-82de2d3afcab tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 200 len: 1297 microversion: 2.1 time: 0.160892 Sep 03 21:07:38.914832 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2167/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:38 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:39.145378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:39.146034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:39.156730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.157707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.158356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.162055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.162716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.163322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.414573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:39.425339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c2e62c6e-39e8-4c54-9ec7-0e3b84e2968b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.283953 Sep 03 21:07:39.426110 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2409/4576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:39 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:39.463488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:39.465935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:39.476488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.477321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.478208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.479139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.479860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.480399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.699566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:39.700871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:39.714762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.715493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.716219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.717110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.717796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.718303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.813268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:39.824697 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3de30ebb-cc46-483a-b44f-d7062cf85b92 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.370116 Sep 03 21:07:39.825977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2168/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:39 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:39.891657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:39.901043 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19d1a8d6-1bf6-4786-948b-0b691bc2bb84 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1489 microversion: 2.1 time: 0.205504 Sep 03 21:07:39.901787 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2410/4578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:39 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1489 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:39.924437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:39.925183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: 30001215-9654-4e7e-850c-2a38e10f4f98] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:39.933698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:39.937220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.937796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.938309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.939220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.939685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.940114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.942866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:39.962386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.963494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.964279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.965195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:39.965829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:39.966268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:39.990716 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] HTTP exception thrown: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Request method failure captured: Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 HTTP/1.1 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8GoXg4S_OoQLeo9HsKK-v7KyBmEJVFul7ps8tE5JhqgZQ4R04w-ggDBDlu9MK6cj30rAqR39MN4DltHpRulZtNBX1D7H1TzKwkdoIVHsIS0CqiSm5SaD5X-6ZBJoEXQ34C_M_tgZmsu7uLUQclSm3DqMR4WKspWaEKFhTuQXS_Yv7I Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 79959bbc9a594e1f81d7e60e5d175e2e Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 79959bbc9a594e1f81d7e60e5d175e2e Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerRescueTestJSON-622109911-project Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: fb144426dd4a46caa03a9ebe77e95c4c Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerRescueTestJSON-622109911-project Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '30001215-9654-4e7e-850c-2a38e10f4f98'} Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:39.992473 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:39.996785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Returning 404 to user: Instance 30001215-9654-4e7e-850c-2a38e10f4f98 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:40.004993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3dde1a14-909b-401f-b91d-af24b734aff5 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98" status: 404 len: 111 microversion: 2.1 time: 0.087367 Sep 03 21:07:40.005442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2169/4579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:39 2022] GET /compute/v2.1/servers/30001215-9654-4e7e-850c-2a38e10f4f98 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:40.015089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.015592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.025830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.026790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.027544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.028918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.029396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.029825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.063791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:40.183818 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bdadc78c-467a-43c3-a697-7ac8b0d94baf tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 204 len: 0 microversion: 2.1 time: 0.172987 Sep 03 21:07:40.189637 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2170/4580] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:40 2022] DELETE /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:07:40.198736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:40.208275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:40.216850 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e62c6c55-54d2-42c4-8bf5-fd181f4328a8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1490 microversion: 2.1 time: 0.286958 Sep 03 21:07:40.217401 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2411/4581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:39 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1490 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:40.226923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.228396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.238106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.239932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.240474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.241336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.242157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.242430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.242857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.243401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.253334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.254349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.254975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.255988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.256605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.257256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.408121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:40.417129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a619613f-18b3-4325-a0ae-538e08938dde tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1489 microversion: 2.1 time: 0.180387 Sep 03 21:07:40.417713 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2412/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:40 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1489 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:40.422324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a68182b-3d3c-4e79-95bd-b29153dbe996", "name": "network-vif-plugged", "status": "completed", "tag": "61443ac6-32b5-448c-8c2d-7a822e2fccd7"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:40.442741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.443265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.443722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.458600 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] Creating event network-vif-plugged:61443ac6-32b5-448c-8c2d-7a822e2fccd7 for instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 on nch1-master-1 Sep 03 21:07:40.463983 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6d4177e3-a1b4-41a7-96a9-f8bec227fa27 req-1ddc7f1e-a2b3-4196-953f-6ba0e881bfca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045152 Sep 03 21:07:40.467097 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2413/4583] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:40.474577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.475164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.481749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.482250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.482691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.483472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.483930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.484361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.513853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:40.580565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:40.594874 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5606dde-0bbe-407f-9ced-a42b6d052da3 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1492 microversion: 2.1 time: 0.402021 Sep 03 21:07:40.596371 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2171/4584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:40 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1492 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:40.601339 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05c60978-6e8a-4775-93e8-7dea0b9efca0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 204 len: 0 microversion: 2.1 time: 0.132269 Sep 03 21:07:40.602297 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2414/4585] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:40 2022] DELETE /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:07:40.604265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.605095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.620698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.621393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.621919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.622847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.623339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.623836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.624282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.625030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.631627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.632118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.632562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.633292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.633750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.634180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.781436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:40.791555 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e2234de5-3d2b-40ab-97ba-417a33580693 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1495 microversion: 2.1 time: 0.171362 Sep 03 21:07:40.792840 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2415/4586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:40 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1495 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:40.851769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:40.852548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:40.859999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.860569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.861137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.862125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:40.862657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:40.863292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:40.902132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:40.910972 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a736b65-f8c9-4bbd-b3d5-65f5be899d63 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.312568 Sep 03 21:07:40.911571 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2172/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:40 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:41.070714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:41.079609 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6355e5f1-1403-41ce-a075-151f77bacea0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.235756 Sep 03 21:07:41.080460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2416/4588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:40 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:41.620264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:41.621495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:41.640760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.641295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.641944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:41.642947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.643609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.644200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:41.820244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:41.821552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:41.836167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.837265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.837870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:41.839761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.840396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.841404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:41.935457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:41.948949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0221ad6c-7dc3-45f2-a11e-bfec38dd601c tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1492 microversion: 2.1 time: 0.332386 Sep 03 21:07:41.962643 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2173/4589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:41 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1492 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:41.975220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:41.976027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:41.983779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.984505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.985165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:41.986075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:41.986685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:41.987282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:42.053570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:42.069564 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-18bbefe6-2f04-4c8a-8d53-dd17d5561d09 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1495 microversion: 2.1 time: 0.256572 Sep 03 21:07:42.070591 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2417/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:41 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1495 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:42.234929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac116a08-804d-4fa7-9749-30608bf676f2 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] Calling method '.version_select at 0x7fae65b79af0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.309473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac116a08-804d-4fa7-9749-30608bf676f2 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.203761 Sep 03 21:07:42.312465 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2418/4591] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:42.331086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.334260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:42.346613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:42.347544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:42.348829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:42.349891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:42.350363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:42.350791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:42.510560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:42.520140 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d81ca3d-b093-4b90-8d97-88029ba769d1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.198682 Sep 03 21:07:42.521174 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2419/4592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:42.526505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-420d4c2e-705a-48ca-9867-e0c6ba1c0558 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] Calling method '.version_select at 0x7fae65b94700>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.604974 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-420d4c2e-705a-48ca-9867-e0c6ba1c0558 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1" status: 200 len: 371 microversion: 2.1 time: 0.082235 Sep 03 21:07:42.605496 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2420/4593] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:42.620424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1e07e50a-20f4-4659-bc40-40a698cdc9a2 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] Calling method '.version_select at 0x7fae65be6dc0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.644297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:42.656242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63dec2ec-0ad9-4974-b262-d74ac18e80da tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.685366 Sep 03 21:07:42.657115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2174/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:41 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:42.689198 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1e07e50a-20f4-4659-bc40-40a698cdc9a2 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.072666 Sep 03 21:07:42.701066 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2421/4595] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1/defaults => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:42.705702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4437c67-7b74-4ab4-b89d-b93bda5f9495 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] Calling method '.version_select at 0x7fae65d04670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.802382 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4437c67-7b74-4ab4-b89d-b93bda5f9495 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1" status: 200 len: 371 microversion: 2.1 time: 0.100364 Sep 03 21:07:42.810160 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2175/4596] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1 => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:42.820990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbe967fc-28e5-4b7c-a46f-4776fe4da773 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] Calling method '.version_select at 0x7fae65be60d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.956281 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fbe967fc-28e5-4b7c-a46f-4776fe4da773 tempest-QuotasTestJSON-102623755 tempest-QuotasTestJSON-102623755-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1?user_id=a23d411e5bdf418faf309ebf380a67e7" status: 200 len: 371 microversion: 2.1 time: 0.140282 Sep 03 21:07:42.958035 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2422/4597] 10.222.0.16 () {58 vars in 1323 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/os-quota-sets/76c8ada6f940405c9aa2b3fecbfd34e1?user_id=a23d411e5bdf418faf309ebf380a67e7 => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:42.978762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:42.979390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:42.996529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:42.997910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:42.998381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.001427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.002602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.003069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.092822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:43.093711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:43.106263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.107020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.107752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.108692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.110556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.111166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.465085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:43.480838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:43.486730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-696784b2-12da-4a78-a8d0-cd2ce196c01f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 200 len: 1495 microversion: 2.1 time: 0.398106 Sep 03 21:07:43.487816 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2423/4598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:43 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 1495 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:43.494712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49735f5-cea0-4bae-8708-ce4ef7e646a5", "name": "network-vif-deleted", "tag": "472e432f-6933-4569-92c7-0f66d8831b58"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:43.497699 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac5f1550-e5d8-4cc3-9c3a-bf3e3e3dd624 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1492 microversion: 2.1 time: 0.525956 Sep 03 21:07:43.498796 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2176/4599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:42 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1492 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:43.507161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.507849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.508565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.544137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:43.544761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:43.546225 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] Creating event network-vif-deleted:472e432f-6933-4569-92c7-0f66d8831b58 for instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 on nch1-master-1 Sep 03 21:07:43.553762 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-88d31861-997d-42de-98fc-6ec56e31032e req-837e9dcb-f646-4af4-9bad-6a848979763f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063762 Sep 03 21:07:43.555008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2424/4600] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:43.558541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.559053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.559501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.560228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.560708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.561171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.681304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:43.682025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:43.727528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.728258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.733064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.736555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.740216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.744748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.831544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:43.854694 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9e1b6ac0-109b-47d1-a52f-e1c3c406bb2b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.314699 Sep 03 21:07:43.856167 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2177/4601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:43 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:43.862322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf64772-a73f-4bcf-88ff-abc402dffcc7", "name": "network-vif-deleted", "tag": "84ea7ffc-0184-4c19-a01b-fb685383ce2d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:43.877508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:43.878433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:43.879654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:43.907621 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] Creating event network-vif-deleted:84ea7ffc-0184-4c19-a01b-fb685383ce2d for instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 on nch2-master-1 Sep 03 21:07:43.914803 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-74fae02e-64c7-41f7-a873-2164c4aed6e9 req-2780f7e3-41fb-4e0b-8c5b-8461e6589843 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056915 Sep 03 21:07:43.916144 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2178/4602] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:44.034404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:44.047354 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-516beaeb-14df-49aa-a900-0f53d2ca0887 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1328 microversion: 2.1 time: 0.370327 Sep 03 21:07:44.060961 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2425/4603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:43 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:44.513771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:44.514950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:44.523577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:44.524195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:44.535282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.535744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.536185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.540988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.541662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.541944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.542658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.543251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.543853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.544725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.545197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.548481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.586642 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 HTTP/1.1 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4cf64772-a73f-4bcf-88ff-abc402dffcc7'} Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:44.589275 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:07:44.594183 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:44.601687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:44.603534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e489b1c4-3561-455b-8891-736fcb6fe00f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 404 len: 111 microversion: 2.1 time: 0.093964 Sep 03 21:07:44.605238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.606264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.607004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.607508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lazy-loading 'fault' on Instance uuid c49735f5-cea0-4bae-8708-ce4ef7e646a5 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:44.613196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2179/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:44 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:44.620073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:44.624257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:44.641363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.644463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.648638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.650850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.654923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.655466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.675568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:44.736274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:44.740247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb144426dd4a46caa03a9ebe77e95c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79959bbc9a594e1f81d7e60e5d175e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:44.760185 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0bbcda56-a2c0-4d1a-a3e5-499a1062d872 tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 200 len: 1304 microversion: 2.1 time: 0.241358 Sep 03 21:07:44.773257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2426/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:44 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:44.881029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:44.881791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:44.897862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.898966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.899616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.900562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.901250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.901899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.919098 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f390512-a4f1-4c14-aab1-d4c862355fb9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 204 len: 0 microversion: 2.1 time: 0.304203 Sep 03 21:07:44.921688 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2180/4606] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:44 2022] DELETE /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:07:44.939322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:44.942422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:44.959846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.961170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.962631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:44.964553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:44.966094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:44.966796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.101489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:45.116684 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c1d397c-2ff9-4cd0-bf0d-f3007f146216 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.240296 Sep 03 21:07:45.120795 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2427/4607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:44 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:45.133490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:45.135649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:45.160753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.161916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.163781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.166389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.166885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.167327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.210298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:45.220677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8664b866-b829-47af-a708-a05b11409d7a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1496 microversion: 2.1 time: 0.292228 Sep 03 21:07:45.222256 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2181/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:44 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:45.387612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:45.402399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a72c9306-edde-4f77-bb72-6cace52f86b7 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1529 microversion: 2.1 time: 0.278637 Sep 03 21:07:45.403349 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2428/4609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:45 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1529 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:45.425608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:45.426473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:45.437816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.438557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.439237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.440159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.440842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.442090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.607046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:45.617551 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d98b6f9a-1f33-4a98-bf72-a1f9455e5790 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1529 microversion: 2.1 time: 0.196029 Sep 03 21:07:45.619160 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2182/4610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:45 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1529 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:45.786861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:45.788208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] [instance: c49735f5-cea0-4bae-8708-ce4ef7e646a5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:45.795435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.796069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.796515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.797278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.797733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.798158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.816966 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] HTTP exception thrown: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Request method failure captured: Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 HTTP/1.1 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8GoXg4S_OoQLeo9HsKK-v7KyBmEJVFul7ps8tE5JhqgZQ4R04w-ggDBDlu9MK6cj30rAqR39MN4DltHpRulZtNBX1D7H1TzKwkdoIVHsIS0CqiSm5SaD5X-6ZBJoEXQ34C_M_tgZmsu7uLUQclSm3DqMR4WKspWaEKFhTuQXS_Yv7I Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 79959bbc9a594e1f81d7e60e5d175e2e Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/79959bbc9a594e1f81d7e60e5d175e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 79959bbc9a594e1f81d7e60e5d175e2e Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerRescueTestJSON-622109911 Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerRescueTestJSON-622109911-project Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: fb144426dd4a46caa03a9ebe77e95c4c Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerRescueTestJSON-622109911-project Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c49735f5-cea0-4bae-8708-ce4ef7e646a5'} Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:45.818758 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] Returning 404 to user: Instance c49735f5-cea0-4bae-8708-ce4ef7e646a5 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2068bbc-16b3-4e83-8926-fe13dfbf4eda tempest-ServerRescueTestJSON-622109911 tempest-ServerRescueTestJSON-622109911-project] 10.222.0.16 "GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5" status: 404 len: 111 microversion: 2.1 time: 0.037767 Sep 03 21:07:45.822586 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2183/4611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:45 2022] GET /compute/v2.1/servers/c49735f5-cea0-4bae-8708-ce4ef7e646a5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:07:45.873737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:45.874251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:45.880743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.881278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.881750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.882462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.882917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.883346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.898379 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] HTTP exception thrown: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Request method failure captured: Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 HTTP/1.1 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8IMDRycOrtjXBxuLdISJFuVjoQGatl0kaQ6vcsV3h53mvRJKOCJMr4T8aRS368AvcVlIwCzHEUSkfEGBPxEMfh-bVsqTpv-AUXDQKXvHqLvJB037NHz2GlI04cbvaV3Q9_qTxoDP-7UJfhFVa-3Tjg2e0aB0TUOLNXjNYejeFDxXHo Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: e2834d4f687747f2b38e3ab7ffa8fd56 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: e2834d4f687747f2b38e3ab7ffa8fd56 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1407532866-project Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: e052a3c319774afb8b373adf58417a46 Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866-project Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4a68182b-3d3c-4e79-95bd-b29153dbe996'} Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:45.899965 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:45.903587 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:07:45.905637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Returning 404 to user: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:45.906685 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-197ea846-40c2-4459-aca7-97888ce2871c tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 404 len: 111 microversion: 2.1 time: 0.270082 Sep 03 21:07:45.907414 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2429/4612] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:45 2022] DELETE /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:45.916808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:45.917687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:45.923703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.924310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.924614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:45.925522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:45.926010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:45.926438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.149792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:46.150337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:46.156752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.157410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.157856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.158569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.159024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.159456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.240740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:46.251479 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56b72106-7512-48c7-9688-5822b62c0a3b tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1529 microversion: 2.1 time: 0.338640 Sep 03 21:07:46.252774 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2184/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:45 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1529 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:46.258974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:46.260061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:46.268452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.269263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.270698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.272640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.273446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.273950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.668812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:46.676886 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04432e7a-e078-479b-8787-ce8cfcc219af tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1496 microversion: 2.1 time: 0.422605 Sep 03 21:07:46.677423 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2185/4614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:46 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1496 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:46.682676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Action: 'update', calling method: >, body: {"server": {"name": "4a68182b-3d3c-4e79-95bd-b29153dbe996_new"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:46.685284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:46.691330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.692624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.693326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.694261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.694918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.695542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.710668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] HTTP exception thrown: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Request method failure captured: Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 HTTP/1.1 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 64 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IMDRycOrtjXBxuLdISJFuVjoQGatl0kaQ6vcsV3h53mvRJKOCJMr4T8aRS368AvcVlIwCzHEUSkfEGBPxEMfh-bVsqTpv-AUXDQKXvHqLvJB037NHz2GlI04cbvaV3Q9_qTxoDP-7UJfhFVa-3Tjg2e0aB0TUOLNXjNYejeFDxXHo Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: e2834d4f687747f2b38e3ab7ffa8fd56 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e2834d4f687747f2b38e3ab7ffa8fd56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: e2834d4f687747f2b38e3ab7ffa8fd56 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1407532866-project Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: e052a3c319774afb8b373adf58417a46 Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1407532866-project Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "4a68182b-3d3c-4e79-95bd-b29153dbe996_new"}} Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4a68182b-3d3c-4e79-95bd-b29153dbe996', 'body': {'server': {'name': '4a68182b-3d3c-4e79-95bd-b29153dbe996_new'}}} Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:07:46.712753 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] Returning 404 to user: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:46.718701 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-860b202b-a575-4301-930c-ea3ed004d9b8 tempest-ServersNegativeTestMultiTenantJSON-1407532866 tempest-ServersNegativeTestMultiTenantJSON-1407532866-project] 10.222.0.16 "PUT /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 404 len: 111 microversion: 2.1 time: 0.035741 Sep 03 21:07:46.722097 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2186/4615] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:07:46 2022] PUT /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:46.727530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:46.728076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:46.734500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.734985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.735424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.736122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.736579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.737030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.749094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:46.758929 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5831a313-77f9-4905-9461-e5e041fafded tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.614981 Sep 03 21:07:46.773304 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2430/4616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:46 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:46.774442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:07:46.858324 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73935423-f247-459f-98f9-45e13b992bf6 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 204 len: 0 microversion: 2.1 time: 0.134717 Sep 03 21:07:46.859274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2187/4617] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:07:46 2022] DELETE /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:07:46.868767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:46.870323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:46.878404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.879291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.879887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:46.880605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:46.881256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:46.881890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.195249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:47.206527 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55941d47-e2ea-495e-8d44-dbaf439eab0d tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1535 microversion: 2.1 time: 0.341654 Sep 03 21:07:47.207797 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2431/4618] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:46 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1535 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:47.422540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b26b46-d45d-4134-8c34-2e398dda06cb", "name": "network-vif-deleted", "tag": "71f9b9b4-1172-404f-83cc-d000ab628f24"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:47.447525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.448973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.450462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.467111 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] Creating event network-vif-deleted:71f9b9b4-1172-404f-83cc-d000ab628f24 for instance 42b26b46-d45d-4134-8c34-2e398dda06cb on nch2-master-1 Sep 03 21:07:47.473708 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8db99ffe-f177-40e4-9846-2b3dc945a62e req-76e63d3a-80eb-4259-8e16-5834af85d14e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056491 Sep 03 21:07:47.482609 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2188/4619] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:47.703404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:47.704029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:47.712726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.717610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.718733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.720060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.720696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.721369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.757921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:47.785867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:47.786735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:47.788168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.789164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.798824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.799508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.800091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.801737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.802003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lazy-loading 'fault' on Instance uuid 42b26b46-d45d-4134-8c34-2e398dda06cb {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:47.804847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:47.805453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:47.806109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:47.946226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:47.957294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0c05a7d-cacd-4788-bee5-4e9b4b7d4ea8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 200 len: 1299 microversion: 2.1 time: 0.257349 Sep 03 21:07:47.958711 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2432/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:47 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 1299 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:48.207479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:48.219117 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-306151ee-c6a1-4c77-a5ea-323d3527684a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1512 microversion: 2.1 time: 0.438893 Sep 03 21:07:48.220211 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2189/4621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:47 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:48.231518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:48.232738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:48.249673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:48.250656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:48.252672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:48.254169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:48.255948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:48.257431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:48.882759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:48.898707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b1c12b02-c2fe-4f12-96eb-58d70fe35c9f tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1535 microversion: 2.1 time: 0.664874 Sep 03 21:07:48.909285 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2433/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:48 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1535 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:48.985094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:48.986474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:48.999159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.003821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.005151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.006064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.006677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.008718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.035618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb HTTP/1.1 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '42b26b46-d45d-4134-8c34-2e398dda06cb'} Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:49.039151 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:49.044628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:49.047013 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e65deecc-f433-48e4-903b-8a8d91ba25be tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 404 len: 111 microversion: 2.1 time: 0.067098 Sep 03 21:07:49.052164 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2190/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:48 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:07:49.239523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-368345699", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:49.247598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:49.248433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:49.258611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.262088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.264098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.266393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.267355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.269421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.532032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:49.544538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dfd5b31-7136-4f47-8033-75a8b56a1350 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1489 microversion: 2.1 time: 0.300851 Sep 03 21:07:49.545357 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2191/4624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:49 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1489 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:49.576841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:49.579751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:49.605466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.606689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.607401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.608387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.609133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.609851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.723663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:49.726896 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c827008-9b28-4c06-8052-fd574db1e293 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 200 len: 146 microversion: 2.1 time: 0.154006 Sep 03 21:07:49.733935 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2192/4625] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:07:49 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 146 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:07:49.742851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:49.743826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:49.752854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.753760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.754459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:49.755435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:49.756130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:49.756747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.104874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:50.114912 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cac1e71f-32aa-467e-a5a4-9b2ef4b4f8e9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.377906 Sep 03 21:07:50.128924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2193/4626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:49 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:50.151677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:50.152634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:50.168338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.169676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.170236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.171226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.172015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.172610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.431516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:50.447821 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3537bd9-42fd-47bf-90bc-8f597f1c3310 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1535 microversion: 2.1 time: 0.330082 Sep 03 21:07:50.449063 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2194/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:50 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1535 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:50.466563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:50.467731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:50.470186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:50.478077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.478850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.479401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.480360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.481124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.483191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.739607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:50.754636 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01f4aa3e-6cc4-4f5a-92c1-5e23b7b1c36c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.303710 Sep 03 21:07:50.755227 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2195/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:50.779301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:50.788248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:50.798508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.799808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.800422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:50.803016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:50.803016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:50.805181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.323752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:51.338010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:51.343981 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08d5db90-6ddc-482b-b207-a371c76b3ce2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.567813 Sep 03 21:07:51.376326 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2196/4629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:51.383365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a68182b-3d3c-4e79-95bd-b29153dbe996", "name": "network-vif-deleted", "tag": "61443ac6-32b5-448c-8c2d-7a822e2fccd7"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:51.419870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.420956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.422056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.457645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:51.459632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:51.462482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:51.463655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:51.471903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:51.488196 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] Creating event network-vif-deleted:61443ac6-32b5-448c-8c2d-7a822e2fccd7 for instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 on nch1-master-1 Sep 03 21:07:51.505446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.506069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.506519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.507389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.507854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.508360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.516781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8cc98b6f-16cc-4cff-950e-c0b6e8179718 req-ab7a53cd-0fe3-4871-aab4-d6e557a0ee0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138798 Sep 03 21:07:51.528806 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2197/4630] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:51.538363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:51.545979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:51.549001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:51.550032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:51.564527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.566645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:51.571347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.571871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.572625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.573114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:51.573260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.573552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.656086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b782d34-268c-44fd-97c6-1f1804c654fa tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420942 Sep 03 21:07:51.656756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2434/4631] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:07:51.667106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:51.669929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:51.686991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.687545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.688061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.688714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.689345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.690269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.758000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:51.760298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:51.766333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:51.767195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lazy-loading 'fault' on Instance uuid 4a68182b-3d3c-4e79-95bd-b29153dbe996 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:07:51.898924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf3a90cb1034ae39f67fb0fa74366f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1646ccd0c1d442bdbab54ad9f44e3aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:51.914168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f664279-db38-43f3-899f-f5bda8029841 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 200 len: 1318 microversion: 2.1 time: 0.253934 Sep 03 21:07:51.933080 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2435/4632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:51 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:51.938205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ea76911-bd5d-4c6e-ba76-93a9f9b67da6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:51.939748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ea76911-bd5d-4c6e-ba76-93a9f9b67da6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:52.048219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ea76911-bd5d-4c6e-ba76-93a9f9b67da6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:52.065753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:52.069243 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ea76911-bd5d-4c6e-ba76-93a9f9b67da6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1208 microversion: 2.1 time: 0.131581 Sep 03 21:07:52.069870 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2436/4633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:51 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:52.093781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea356d21-7799-4f3f-bd56-4543fef8fc6b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.563240 Sep 03 21:07:52.094690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2198/4634] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:51 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:52.238817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-952740310", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b1cd1193-a10d-479f-9da3-5114ed491f2f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:07:52.311304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] validate_networks() for [('b1cd1193-a10d-479f-9da3-5114ed491f2f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:07:52.938340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:52.939578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] [instance: 4a68182b-3d3c-4e79-95bd-b29153dbe996] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:52.950700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:52.953072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:52.953752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:52.954368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:52.955271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:52.955907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:52.956491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:52.975520 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] HTTP exception thrown: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Request method failure captured: Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 HTTP/1.1 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IDghGMAwZzq0jUqZqVvMaj-Mm5J93Bs4gbk3n6OQ0cKvXjabVwojbECelcytAfsHIfwx8hK3d8Mhob7RbH4vlnfAE7PW6nJF7Alo8-7bF9riXLpGRFkYFK4Lpx4nol3i571iV7X4vJNz2qZKA7-G6Z1TsltEG1cPavoC59uzyhzvE Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 1646ccd0c1d442bdbab54ad9f44e3aa6 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2138823580 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1646ccd0c1d442bdbab54ad9f44e3aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1646ccd0c1d442bdbab54ad9f44e3aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1646ccd0c1d442bdbab54ad9f44e3aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1646ccd0c1d442bdbab54ad9f44e3aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2138823580 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 1646ccd0c1d442bdbab54ad9f44e3aa6 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2138823580 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2138823580-project Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 1cf3a90cb1034ae39f67fb0fa74366f7 Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2138823580-project Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4a68182b-3d3c-4e79-95bd-b29153dbe996'} Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:52.978604 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. Sep 03 21:07:52.983168 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:07:52.985612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] Returning 404 to user: Instance 4a68182b-3d3c-4e79-95bd-b29153dbe996 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:07:52.986879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28dcaf4f-3471-43af-9a5e-064ec4108b57 tempest-ServersNegativeTestMultiTenantJSON-2138823580 tempest-ServersNegativeTestMultiTenantJSON-2138823580-project] 10.222.0.16 "GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996" status: 404 len: 111 microversion: 2.1 time: 0.052355 Sep 03 21:07:52.989530 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2199/4635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:52 2022] GET /compute/v2.1/servers/4a68182b-3d3c-4e79-95bd-b29153dbe996 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:07:53.095657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:53.096547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:53.109850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:53.110672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:53.111269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:53.115000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:53.115787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:53.116507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:53.307143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:53.325583 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15b9c5e3-0c84-41c8-9fb9-0dd21d893929 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1260 microversion: 2.1 time: 0.233819 Sep 03 21:07:53.341850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2200/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:53 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:53.568076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:07:53.568650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:07:53.571009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:07:53.571644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:07:53.572187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:07:53.595595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:53.595779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:53.596234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:53.601015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:53.601518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:53.609917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:53.637866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:53.654489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:07:53.681518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:07:53.725125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:07:53.729353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:07:53.829883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597779 Sep 03 21:07:53.837134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2437/4637] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:07:53.842258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:53.842891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:54.006183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:54.020963 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1214 microversion: 2.1 time: 0.182575 Sep 03 21:07:54.021560 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2201/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:53 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:54.308321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:54.309328 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001328 Sep 03 21:07:54.316418 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2438/4639] 10.222.0.16 () {56 vars in 886 bytes} [Sat Sep 3 21:07:54 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 03 21:07:54.318534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:54.320019 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002286 Sep 03 21:07:54.320755 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2202/4640] 10.222.0.16 () {54 vars in 1035 bytes} [Sat Sep 3 21:07:54 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 03 21:07:54.327846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:54.329173 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cf0099b-faed-4cc0-bfae-1fb9cd6af302 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Sep 03 21:07:54.338413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:54.340306 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3921a1f2-e36d-4d6c-804e-6c0b224cce8f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001795 Sep 03 21:07:54.349852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2203/4642] 10.222.0.16 () {56 vars in 886 bytes} [Sat Sep 3 21:07:54 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 03 21:07:54.350826 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2439/4642] 10.222.0.16 () {54 vars in 1041 bytes} [Sat Sep 3 21:07:54 2022] GET /compute/v2.1/ => generated 388 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:07:54.354892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:54.355804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:54.382709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:54.385477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:54.386978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:54.389162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:54.391224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:54.391898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:54.607318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:54.625521 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6430e14e-1c70-4c14-bd2a-1e573d4f9dd3 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1266 microversion: 2.1 time: 0.271395 Sep 03 21:07:54.628274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2204/4643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:54 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:55.048096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:55.048784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:55.066805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:55.070528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:55.072339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:55.075268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:55.075992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:55.076677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:55.229994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:55.245023 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-94920745-94a1-4b37-a3ed-c07929aeaa86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1266 microversion: 2.1 time: 0.201621 Sep 03 21:07:55.258424 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2440/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:55 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:55.650358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:55.651251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:55.660823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:55.661687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:55.662322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:55.663314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:55.664037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:55.664695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:56.274009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:56.274622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:56.287062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:56.293738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:56.294585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:56.295550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:56.296999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:56.299954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:56.431015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:56.441877 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c21e6360-9164-42f6-8532-9d0309407acd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1272 microversion: 2.1 time: 0.171606 Sep 03 21:07:56.445115 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2441/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:56 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:07:56.923977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:56.936949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4fa13aa5-7d78-4879-b3bd-bc248e270db0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 1.291049 Sep 03 21:07:56.940670 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2205/4646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:55 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:57.470323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:57.470958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:57.483443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:57.484070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:57.484398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:57.485140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:57.499353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:57.499953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:57.781469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:57.790402 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b6d223f-f845-4c02-bc4f-74b0b87ee40e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1272 microversion: 2.1 time: 0.324074 Sep 03 21:07:57.790814 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2442/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:57 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:57.962780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:57.966808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:57.987395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:57.989278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:57.990149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:57.991724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:57.992424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:57.993313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:58.652934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:58.665099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c287a14-4b78-4ad8-a780-3ea07667f34b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.707957 Sep 03 21:07:58.666211 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2206/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:57 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:58.813682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:58.814438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:58.835153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:58.835664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:58.836111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:58.840818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:58.854722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:58.855296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:59.013950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:07:59.055616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfb5b224-beae-4bc8-b69d-e5189f01dee5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1272 microversion: 2.1 time: 0.226693 Sep 03 21:07:59.056298 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2443/4649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:58 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:07:59.690001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:07:59.691913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:07:59.700713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:59.701495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:59.702270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:07:59.703148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:07:59.703834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:07:59.704437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:00.098801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:00.100814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:00.111554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:00.112389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:00.113021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:00.114904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:00.115937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:00.116888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:00.339299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:00.352429 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20791743-6c5f-4161-a416-2384fe471e91 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.258118 Sep 03 21:08:00.354004 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2444/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:00 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:00.364079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9210929-ca1c-487b-91be-9692ef5669a9", "tag": "ba5e5742-db96-429e-8a03-5550d29d76a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:00.398169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:00.398670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:00.399118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:00.411257 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] Creating event network-changed:ba5e5742-db96-429e-8a03-5550d29d76a4 for instance b9210929-ca1c-487b-91be-9692ef5669a9 on nch2-master-1 Sep 03 21:08:00.417359 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-22cea83e-867d-485a-a37f-30b6cff44758 req-6e69efc1-97c4-4573-a9a0-678bb8624fa5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061905 Sep 03 21:08:00.418681 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2445/4651] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:00.538974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:00.554476 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a482af7d-e588-4cc5-8c38-430dc194a11d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.868100 Sep 03 21:08:00.559868 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2207/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:07:59 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:01.379461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:01.380309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:01.401506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:01.402094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:01.402966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:01.403296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:01.403760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:01.404196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:01.527422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05783b1c-6d29-46e7-9bfd-d868867a6035 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: .version_select at 0x7fae65ca4790>, body: {"keypair": {"name": "tempest-keypair-1554293275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD+9aEet6aUa3ELcPBFQA3O9i7sWwMFwITNhnYfAjAXl8+QfylSmrQd9NbFxDiibNNM572tCgDsiVHpD5D+QMPg8eu7JWGQ1YmOdfl7WgXwjCw8AQxJGqgDpAx44bk05w=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:01.549803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-05783b1c-6d29-46e7-9bfd-d868867a6035 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:08:01.565590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-05783b1c-6d29-46e7-9bfd-d868867a6035 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:08:01.645189 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05783b1c-6d29-46e7-9bfd-d868867a6035 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.330664 Sep 03 21:08:01.646569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2446/4653] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:08:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:01.652474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:01.654464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:01.671950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:01.672480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:01.673044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:01.673861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:01.674399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:01.674910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:02.182279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:02.199872 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-528b3196-b6b3-4405-a5d2-2b1fa79f1390 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.550388 Sep 03 21:08:02.201787 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2447/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:01 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:02.234368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:02.258796 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a71bf895-3c6b-4092-a37f-41e1b5a3a980 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.879474 Sep 03 21:08:02.275673 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2208/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:01 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:02.962887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6", "tag": "2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:02.991312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:02.991999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:02.993871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:03.030861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] Creating event network-changed:2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c for instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 on nch2-master-1 Sep 03 21:08:03.043911 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b0a08142-037c-49e3-b0a3-a10be0514fed req-d66af33e-97a7-4da2-9fef-b07d3e14628d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085612 Sep 03 21:08:03.045909 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2448/4656] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:03.225878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:03.227667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:03.245769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:03.249059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:03.252281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:03.253327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:03.254497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:03.256232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:03.288388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:03.289147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:03.300109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:03.303262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:03.303900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:03.306421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:03.307366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:03.307993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:03.619487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:04.010535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:04.109206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:04.119668 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee2b6d89-9a51-4ed8-9e05-f5b66d2af5db tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.899041 Sep 03 21:08:04.120761 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2209/4657] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:03 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:04.909118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:04.937455 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fae3295c-faa0-4a6a-ba79-78dd4c5f0e27 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 1.644460 Sep 03 21:08:04.944231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2449/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:03 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:05.143444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:05.144185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:05.157491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:05.176197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:05.176784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:05.177599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:05.178082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:05.178519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:05.695122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9210929-ca1c-487b-91be-9692ef5669a9", "name": "network-vif-plugged", "status": "completed", "tag": "ba5e5742-db96-429e-8a03-5550d29d76a4"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:05.729742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:05.730252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:05.730702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:05.779258 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] Creating event network-vif-plugged:ba5e5742-db96-429e-8a03-5550d29d76a4 for instance b9210929-ca1c-487b-91be-9692ef5669a9 on nch2-master-1 Sep 03 21:08:05.799591 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-45759c1c-0166-4ba4-bf22-5aecbe80c4fd req-41382248-49cf-4915-9be1-30bb6409f467 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107938 Sep 03 21:08:05.810531 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2450/4659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:05.975266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:05.976093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:05.985076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:05.985589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:05.986065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:05.986790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:05.987252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:05.987823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:06.021501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:06.036516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e272a30-f16c-4617-acc0-373d0214d275 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.896881 Sep 03 21:08:06.038592 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2210/4660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:05 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:06.211609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1074853166", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63485524-b841-48df-9f2a-17fe5709555c"}], "security_groups": [{"name": "tempest-securitygroup--660635265"}], "key_name": "tempest-keypair-1554293275", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:06.248599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:06.260863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aa7c869e-9eef-4985-b528-955e4b1a9e60 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.289741 Sep 03 21:08:06.262113 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2451/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:05 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:06.608625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] validate_networks() for [('63485524-b841-48df-9f2a-17fe5709555c', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:08:07.062841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:07.064146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:07.078517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:07.081231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:07.083028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:07.084663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:07.086609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:07.087412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:07.360618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:07.369948 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0850e9f1-fc82-4cc7-b138-e1d9731c0c8e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1308 microversion: 2.1 time: 0.311507 Sep 03 21:08:07.373085 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2452/4662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:07 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:07.379381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:07.380209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:07.388598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:07.389504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:07.390138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:07.411718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:07.415425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:07.416152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:07.665802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:07.677064 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f373062-c860-44f8-8edc-8a77c8fef201 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.302465 Sep 03 21:08:07.678267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2453/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:07 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:08.227716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:08:08.229959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:08:08.231517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:08:08.232633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:08:08.233255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:08:08.255613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.256390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.257077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.258253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.258922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.259553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.280144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:08:08.290832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:08:08.311630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:08:08.315210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:08:08.390251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2689066-63ad-45a8-9bdc-ef56c2e7996e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.184031 Sep 03 21:08:08.393060 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2211/4664] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:08:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:08:08.396623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:08.397300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:08.411908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.412110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3481d068-c534-49c6-be8f-430f800c5871 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:08.412419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.412868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.413422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3481d068-c534-49c6-be8f-430f800c5871 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:08.413615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.414088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.421870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.654793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3481d068-c534-49c6-be8f-430f800c5871 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:08.666079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3481d068-c534-49c6-be8f-430f800c5871 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1242 microversion: 2.1 time: 0.265971 Sep 03 21:08:08.667510 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2212/4665] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:08 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:08.701574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:08.702201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:08.712369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.712853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.713335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.714056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.714520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.714955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.749261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:08.759831 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db524963-3567-46b8-b007-a18ec25bd973 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1488 microversion: 2.1 time: 0.367937 Sep 03 21:08:08.760574 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2454/4666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:08 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1488 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:08.791259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:08.794105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:08.801052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.801563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.802014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.802739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:08.803618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:08.804071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:08.953547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:08.965897 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52467e86-59bc-4fcd-acf1-c3333fdab40b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "PUT /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1083 microversion: 2.1 time: 0.179456 Sep 03 21:08:08.971661 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2455/4667] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:08:08 2022] PUT /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1083 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:08.991801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:08.993217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:09.006606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.007612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.010665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.012882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.013599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.015073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.142058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:09.153867 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.457092 Sep 03 21:08:09.154528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2213/4668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:08 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:09.192505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:09.193622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae2e2d60-6e7b-43ad-9ab8-ab7cddf9a4ac tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001440 Sep 03 21:08:09.201392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2214/4669] 10.222.0.16 () {56 vars in 886 bytes} [Sat Sep 3 21:08:09 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 03 21:08:09.211436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:09.219645 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3c5e7691-68f2-45f8-b51f-1db39d256cc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1509 microversion: 2.1 time: 0.231716 Sep 03 21:08:09.221352 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2456/4670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:08 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:09.254743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:09.255367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:09.281605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.283902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.288375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.290750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.291313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6", "name": "network-vif-plugged", "status": "completed", "tag": "2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:09.292829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.293582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.311951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.316773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.319440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.341552 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] Creating event network-vif-plugged:2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c for instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 on nch2-master-1 Sep 03 21:08:09.379312 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2c6e8afd-ab20-45c4-a265-c02ca81cbe8a req-bb147bff-5aeb-4514-bf4d-0f0721046d6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089277 Sep 03 21:08:09.380467 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2457/4671] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:09.640279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:09.660835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6a46929-5660-4cbb-9e2c-9d8929d1c98f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1509 microversion: 2.1 time: 0.414976 Sep 03 21:08:09.662181 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2215/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:09 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:09.690678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:09.691332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:09.693991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:09.695022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:09.706587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.707109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.707562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.711000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.717271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.717857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.718601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.719087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.719742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.719951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.721100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.723215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.801914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:08:09.900691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:09.913333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5a6365a-cdab-4afc-84ac-b3fb2d114446 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1238 microversion: 2.1 time: 0.225771 Sep 03 21:08:09.915940 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2216/4673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:09 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1238 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:09.963537 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59bbce28-b7df-47a4-a761-5c4d9010c063 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 204 len: 0 microversion: 2.1 time: 0.277360 Sep 03 21:08:09.964404 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2458/4674] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:08:09 2022] DELETE /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:08:09.977465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:09.978604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:09.986749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.987442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.988364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:09.989509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:09.990134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:09.990965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:10.183003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:10.184172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:10.200197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:10.200714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:10.201199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:10.201935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:10.202497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:10.202834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:10.232752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:10.245915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5018591-15b1-4b1b-be3f-a89b9e5f8077 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1515 microversion: 2.1 time: 0.276803 Sep 03 21:08:10.257505 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2217/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:09 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:10.506222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:10.522432 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dda05a60-870d-4e90-9c93-6e95d76d12cd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 0.343550 Sep 03 21:08:10.537345 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2459/4676] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:10 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:10.939888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:10.941024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:10.948117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:10.948769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:10.949331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:10.950048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:10.950918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:10.951439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:11.048076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:11.063869 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8f84a07-cae5-45e8-82b6-f127247a7c62 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1300 microversion: 2.1 time: 0.128085 Sep 03 21:08:11.064674 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2218/4677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:10 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:11.272390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:11.273078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:11.284530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:11.285662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:11.294811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:11.295685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:11.296184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:11.296633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:11.552838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:11.553884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:11.564577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:11.565315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:11.566137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:11.568529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:11.569212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:11.569803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:11.584489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:11.708462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:11.724214 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab8e3fd1-daa2-4c54-891f-aaa2ea12c4c7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1515 microversion: 2.1 time: 0.455890 Sep 03 21:08:11.727060 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2460/4678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:11 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:12.091586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:12.092440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:12.105981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:12.106497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:12.106952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:12.107685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:12.109557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:12.110012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:12.408030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:12.424787 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a0b8c6ed-afb3-4917-911c-966348097768 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.341271 Sep 03 21:08:12.426895 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2461/4679] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:12 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:12.615846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:12.628003 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53dcdef6-23ca-4ad0-ae5a-4d6b474da972 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1314 microversion: 2.1 time: 1.081975 Sep 03 21:08:12.629145 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2219/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:11 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:12.755022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:12.755957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:12.767523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:12.769424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:12.770715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:12.772885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:12.774171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:12.774768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.066641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:13.078821 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-755af1b0-3b7b-4638-b484-0b5c4c057781 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1515 microversion: 2.1 time: 0.329639 Sep 03 21:08:13.082135 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2462/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:12 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:13.157322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9e946d-fd59-407d-8add-99b3eee0b8dc", "tag": "55424041-b772-4ec4-9ab6-bad400f22199"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:13.176573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.180613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.181425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.206185 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] Creating event network-changed:55424041-b772-4ec4-9ab6-bad400f22199 for instance ea9e946d-fd59-407d-8add-99b3eee0b8dc on nch1-master-1 Sep 03 21:08:13.215675 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-62c95951-2ba6-477f-859f-8513ec5e604a req-81330102-fec3-48f7-9526-f136225bee5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061939 Sep 03 21:08:13.227656 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2220/4682] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:13.453451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:13.454637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:13.467256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.468118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.470740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.472057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.476071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.479140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.552188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9210929-ca1c-487b-91be-9692ef5669a9", "name": "network-vif-deleted", "tag": "ba5e5742-db96-429e-8a03-5550d29d76a4"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:13.569486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.570071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.570556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.588555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:13.601164 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] Creating event network-vif-deleted:ba5e5742-db96-429e-8a03-5550d29d76a4 for instance b9210929-ca1c-487b-91be-9692ef5669a9 on nch2-master-1 Sep 03 21:08:13.619051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-76fd9a9d-41f0-4b16-b855-eea89cee30c1 req-93ce5b71-a9c0-439b-9cb2-72b192187069 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066236 Sep 03 21:08:13.621513 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2221/4683] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:13.652451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:13.653201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:13.666131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.666341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.666784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.670839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:13.671561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:13.672352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:13.905483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:13.918696 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fdcc6fb6-2ac8-4743-8633-9c7f38bbdb85 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.469104 Sep 03 21:08:13.925310 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2463/4684] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:13 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:14.079647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:14.094268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3277d5cc-2c80-4f5e-813f-9c30353a0713 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1501 microversion: 2.1 time: 0.445689 Sep 03 21:08:14.095956 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2222/4685] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:13 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1501 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:14.116954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:14.118028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:14.133241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.133937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.136318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.136955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:14.140464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.141187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.141747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.145116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:14.164513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.165167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.165701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.166520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.167095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.169054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.242304 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42410ff6-9867-4eb5-b566-74ecbdb01e17 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.117941 Sep 03 21:08:14.242959 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2223/4686] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:14 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:08:14.244081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.244606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.245095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.245833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lazy-loading 'fault' on Instance uuid b9210929-ca1c-487b-91be-9692ef5669a9 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:08:14.314811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:14.329817 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e389a7e0-a696-4ff9-81d9-44ca8f9bb0bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 200 len: 1319 microversion: 2.1 time: 0.219311 Sep 03 21:08:14.330414 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2464/4687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:14 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:14.952020 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:14.953607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:14.965501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.966186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.967275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:14.968569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:14.969238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:14.970105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:15.235113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:15.254421 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6567c0b-da57-4885-848a-aa541f1a7478 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.306846 Sep 03 21:08:15.254964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:15.257644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:15.266431 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2224/4688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:14 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:15.269728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:15.272807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:15.275069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:15.277927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:15.278713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:15.279643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:15.331403 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90047ff8-c17f-4557-bcb3-2e614a3437de tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.080724 Sep 03 21:08:15.333015 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2465/4689] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:15 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:08:15.355672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:15.357711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:15.365882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:15.366891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:15.368356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:15.372427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:15.373388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:15.373997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:15.394802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 HTTP/1.1 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b9210929-ca1c-487b-91be-9692ef5669a9'} Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:08:15.396814 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:08:15.400711 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:15.402651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:08:15.403874 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-70874da5-e93a-4117-a6a3-3e73c0717da9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 404 len: 111 microversion: 2.1 time: 0.053336 Sep 03 21:08:15.404635 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2225/4690] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:15 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:08:15.608649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1115984774", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8dcc21c2-9478-4317-b9bf-b77cdb34a43f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:15.671013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] validate_networks() for [('8dcc21c2-9478-4317-b9bf-b77cdb34a43f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:08:16.279585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:16.281169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:16.289571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.290208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.291053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.292011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.292728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.293436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.569165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:08:16.572002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:08:16.572847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:08:16.574780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:08:16.576270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:08:16.590677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.591379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.592423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.594524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.595373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.595756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:16.596328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.612293 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d20c756d-165b-4e47-8edd-d47da50d87a7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.335287 Sep 03 21:08:16.616655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2226/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:16 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:16.624154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:16.627541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:16.643863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:08:16.653804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.654261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Getting quotas for user 9e686d314d164930bbcfc9905a8b45ce and project 0de6b6fc412742beb94162e078268849. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:08:16.654388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.654863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.655598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:16.661846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:16.662508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:16.671147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:08:16.673941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:08:16.711115 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-186b59a9-cfe0-4e64-b599-b207b476f9d4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.090768 Sep 03 21:08:16.712401 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2227/4692] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:16 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:08:16.743978 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08464b8e-e412-4fdd-9bf7-2ee5df41d99f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139319 Sep 03 21:08:16.746264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2466/4693] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:08:16.757951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac2c9218-fa6b-44c3-b060-a11c0f9280a6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:16.758746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac2c9218-fa6b-44c3-b060-a11c0f9280a6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:16.835035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac2c9218-fa6b-44c3-b060-a11c0f9280a6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:16.849763 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac2c9218-fa6b-44c3-b060-a11c0f9280a6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1209 microversion: 2.1 time: 0.095732 Sep 03 21:08:16.850734 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2228/4694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:16 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:17.640351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:17.642451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:17.658942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.661349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.663119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.666671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.669033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.670865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.723933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:17.726773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:17.741248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.742152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.742747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.743636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.744235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.744974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.786144 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-99334696-a31b-4acb-9399-677f8d2af1cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.066789 Sep 03 21:08:17.793190 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2229/4695] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:17 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:08:17.874266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:17.882570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:17.898136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.899366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.899795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.900519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:17.905535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:17.906022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:17.948973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:17.960807 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-affa988b-7917-437c-b95d-859d56d422df tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.325445 Sep 03 21:08:17.978091 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2467/4696] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:17 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:18.055679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:18.064388 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7638f72a-ee97-4a05-98d7-a3ace86107c9 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1261 microversion: 2.1 time: 0.194601 Sep 03 21:08:18.065147 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2230/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:17 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:18.800013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:18.803262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:18.807676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:18.820135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:18.820647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:18.823373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:18.826540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:18.827290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:18.827954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:18.918130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b74b73c-fef4-4b6f-ab2d-eea091ebed9f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.121563 Sep 03 21:08:18.919485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2468/4698] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:18 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:08:18.984133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:18.984755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:18.994120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:19.001474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.002619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.004613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:19.006244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.008032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.010143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:19.089401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:19.090107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:19.117534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.118078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.127291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:19.128081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.131837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.132305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:19.301995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:19.314728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53d275c2-9bca-48d9-b986-9d7da5825cae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1267 microversion: 2.1 time: 0.229709 Sep 03 21:08:19.332367 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2469/4699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:19 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:19.450254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:19.461483 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5da3c652-d8cb-4e95-99a9-ef1b813b7f41 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.481193 Sep 03 21:08:19.475130 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2231/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:18 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:19.931363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:19.933872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:19.957847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.964722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.965351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:19.966400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:19.966885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:19.967349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.084511 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-714dbaec-b754-4631-99a9-5317cd721ae9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.157944 Sep 03 21:08:20.085232 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2470/4701] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:19 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:08:20.339971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:20.340597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:20.351671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.356691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.357219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.357981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.358460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.358896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.411061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9e946d-fd59-407d-8add-99b3eee0b8dc", "name": "network-vif-plugged", "status": "completed", "tag": "55424041-b772-4ec4-9ab6-bad400f22199"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:20.438403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.441899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.442592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.477425 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] Creating event network-vif-plugged:55424041-b772-4ec4-9ab6-bad400f22199 for instance ea9e946d-fd59-407d-8add-99b3eee0b8dc on nch1-master-1 Sep 03 21:08:20.491642 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-91ba0a92-a88c-461c-a676-dea27da957c7 req-2ca030d1-e4ab-4a28-b960-a6c6460c88a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085365 Sep 03 21:08:20.492264 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2471/4702] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:20.504488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:20.505244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:20.523540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.529653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.533172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.536932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.537910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.540168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.688514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:20.698502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28aeb3e3-60e5-4fce-86ce-eba97da6bbfb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1309 microversion: 2.1 time: 0.363236 Sep 03 21:08:20.702391 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2232/4703] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:20 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:20.866724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36f5497-bf9c-4657-89b6-6e483fcba779", "tag": "db0537f0-1f1b-411e-a6c9-634f9a2d1df9"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:20.886576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:20.891801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:20.892345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:20.892751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:20.926385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] Creating event network-changed:db0537f0-1f1b-411e-a6c9-634f9a2d1df9 for instance f36f5497-bf9c-4657-89b6-6e483fcba779 on nch2-master-1 Sep 03 21:08:20.939776 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-340b8948-e5fc-44b1-ac40-0908d3a8c5c7 req-c5728074-04a6-4fbf-9fa8-b4c473545aac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077736 Sep 03 21:08:20.940392 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2233/4704] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:08:21.096289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:21.099085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:21.107507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:21.109967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:21.112212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:21.113619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:21.115786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:21.117352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:21.117840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:21.118283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:21.120038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0248157f-1d1e-426f-9ea0-f0db0aed2775 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.623929 Sep 03 21:08:21.121213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2472/4705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:20 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:21.185895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-845f9ea5-0557-42a9-aec2-1171f02c275c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.092548 Sep 03 21:08:21.187090 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2234/4706] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:21 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:08:21.726196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:21.727099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:21.734920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:21.735576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:21.736026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:21.736926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:21.738261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:21.739018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:22.097257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:22.109794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82e943cb-9917-464c-b840-adb80a4fbfaf tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1309 microversion: 2.1 time: 0.385436 Sep 03 21:08:22.120956 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2473/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:21 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:22.149592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:22.150400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:22.157683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:22.158184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:22.158636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:22.159352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:22.159903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:22.160273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:22.197994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:22.202188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:22.209237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:22.210134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:22.210829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:22.211729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:22.212776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:22.213479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:22.553038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e80d93b-c59c-4bfb-bd1f-19149a47c15b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.358850 Sep 03 21:08:22.553694 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2474/4708] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:22 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:08:22.702198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:22.716043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06f74290-9b5f-4309-a8da-cc4cf909a287 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1367 microversion: 2.1 time: 0.572031 Sep 03 21:08:22.726483 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2235/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:22 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:23.143100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:23.145130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:23.181159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.181674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.182137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:23.182882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.183357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.208514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:23.565577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:23.569615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:23.579616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.580517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.581200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:23.582973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.583643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.584081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:23.632076 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5cd0fea-f345-41dd-add4-326b5dc9755e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 14 microversion: 2.1 time: 0.071672 Sep 03 21:08:23.633033 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2236/4710] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:23 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 21:08:23.708699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:23.721138 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dabfcfa8-49d5-413b-8659-72dd79db03ec tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1309 microversion: 2.1 time: 0.583900 Sep 03 21:08:23.724944 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2475/4711] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:23 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1309 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:23.743708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:23.744431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:23.758937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.759636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.760101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:23.761508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:23.763892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:23.764951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.057663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:24.066240 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e52f4cac-28c2-4e3f-9299-70654a324654 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1557 microversion: 2.1 time: 0.326558 Sep 03 21:08:24.066824 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2237/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:23 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1557 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:24.092017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:24.092869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:24.106129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.107126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.109030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.110180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.110831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.111278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.228135 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a37cdd2b-36d0-444a-8c9d-8b30efb76e3f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141625 Sep 03 21:08:24.229161 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2476/4713] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:08:24 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:24.644792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:24.647903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:24.657402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.658204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.659029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.660663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.661340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.661971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.721130 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-37477a40-b38d-4b47-a0a5-35f6400564a6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action" status: 200 len: 8206 microversion: 2.1 time: 0.078898 Sep 03 21:08:24.725747 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2238/4714] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:24 2022] POST /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6/action => generated 8206 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:24.738242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:24.739444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:24.746870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:24.747583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:24.749728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.750670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.751216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.752609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.753244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.754168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.759221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.761482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.763100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:24.764026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:24.764728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:24.765284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.061517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:25.072526 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4ce071fd-27cb-4690-93f8-66a7a9ac884e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.342587 Sep 03 21:08:25.073391 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2477/4715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:24 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:25.105846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:25.106480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:25.134603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:25.138972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:25.138972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.138972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:25.138972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:25.138972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.196015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:25.209753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d4047f4-0bc0-4bd5-a2c7-78853de5b1ed tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1309 microversion: 2.1 time: 0.466175 Sep 03 21:08:25.213007 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2239/4716] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:24 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:25.325086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:25.335234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9fe2c6b8-b901-4117-94b9-7ca53463d501 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.233424 Sep 03 21:08:25.346160 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2478/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:25 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:25.360367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:25.361650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:25.372868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:25.373921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:25.374430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.375160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:25.375849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:25.376550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.404290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36f5497-bf9c-4657-89b6-6e483fcba779", "name": "network-vif-plugged", "status": "completed", "tag": "db0537f0-1f1b-411e-a6c9-634f9a2d1df9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:25.422587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:25.423099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:25.423533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:25.450179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] Creating event network-vif-plugged:db0537f0-1f1b-411e-a6c9-634f9a2d1df9 for instance f36f5497-bf9c-4657-89b6-6e483fcba779 on nch2-master-1 Sep 03 21:08:25.455678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3958baea-46aa-47a0-8374-ca471259bbc1 req-8bbc11c4-fb9c-49c8-90fb-80a5e39fda81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055307 Sep 03 21:08:25.456672 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2479/4718] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:08:25.988013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:25.997091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a910c197-a7d6-455c-a792-f771b20b30f5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.641320 Sep 03 21:08:25.997675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2240/4719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:25 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:26.023919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:26.024695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:26.032216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.033749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.034971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.035896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.036580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.037259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.241097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:26.253783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:26.269400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.269931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.270391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.273044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.273534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.274729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.415799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:26.425664 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff2dff4f-1ad4-436c-abe6-955609c664df tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.406042 Sep 03 21:08:26.429381 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2480/4720] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:26 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:26.454931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:26.455524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:26.463584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.464101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.464555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.465433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.465904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.466344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.561690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Locking {{(pid=140520) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 03 21:08:26.604564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:26.613470 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04120a26-fd23-4927-a8c2-0af0514ef345 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1309 microversion: 2.1 time: 0.381196 Sep 03 21:08:26.619870 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2241/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:26 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1309 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:26.633577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:26.639072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9e946d-fd59-407d-8add-99b3eee0b8dc", "tag": "55424041-b772-4ec4-9ab6-bad400f22199"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:26.643658 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-501fcb98-9dbf-4a34-9bd5-5702b03802d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.193059 Sep 03 21:08:26.644641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2481/4722] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:26 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:08:26.658876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:26.660439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:26.663143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.668834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.669501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.674086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:26.678163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.682558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.683001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.683833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:26.686114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:26.686646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:26.689166 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] Creating event network-changed:55424041-b772-4ec4-9ab6-bad400f22199 for instance ea9e946d-fd59-407d-8add-99b3eee0b8dc on nch1-master-1 Sep 03 21:08:26.696394 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-881cf046-4a1c-4b36-918c-48a056e85310 req-4667d3bf-c40c-4804-b4d2-987fa2faba62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069782 Sep 03 21:08:26.701400 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2242/4723] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:08:27.213585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:27.228474 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7996632a-c947-49fe-8c11-de5301ce0d2d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.578796 Sep 03 21:08:27.229184 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2482/4724] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:26 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:27.249869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:27.256648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:27.268342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.269758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.270198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.296873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:27.308873 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action HTTP/1.1 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 15 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: {"os-stop": {}} Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4b25f89a-4721-4b18-838b-0ab9b15212d7', 'body': {'os-stop': {}}} Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked Sep 03 21:08:27.310923 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:08:27.317636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 409 to user: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 is locked {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:08:27.318692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e22bc7e1-d028-4f43-a556-851b14ae1ec0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 409 len: 107 microversion: 2.1 time: 0.069813 Sep 03 21:08:27.322488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2243/4725] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:27 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 107 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:08:27.328048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:27.328610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:27.339482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.340185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.340638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.341853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.343135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.343795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.398381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Unlocking {{(pid=140520) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 03 21:08:27.466998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f654345c-be87-4526-8ef9-830fc6df8781 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.142033 Sep 03 21:08:27.473173 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2483/4726] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:27 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:08:27.478383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:27.486659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.492330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.493007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.525281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Going to try to stop instance {{(pid=140519) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:08:27.583205 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8094da6-57f4-4423-8241-d92084f7f904 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.109164 Sep 03 21:08:27.589972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2244/4727] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:27 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:08:27.597283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:27.597915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:27.609998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.611898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.614656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.615609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.624739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.625504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.640026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:27.640745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:27.652962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.653785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.655449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.656686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.658476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.658930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.916022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:27.927453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9159f0e-0762-4855-8b3b-ff504216fc9b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1489 microversion: 2.1 time: 0.293006 Sep 03 21:08:27.928225 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2245/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:27 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1489 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:27.969946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1778842291"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:27.975087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:27.991349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.992348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.993038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:27.993963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:27.994627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:27.995258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.104794 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ee93909-5e5f-4a9d-87d0-73ef8d5eb4cd tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "PUT /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1074 microversion: 2.1 time: 0.149287 Sep 03 21:08:28.105460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2246/4729] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:08:27 2022] PUT /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1074 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:28.126337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:28.127190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:28.135921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.136794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.137510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.139803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.140497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.141306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.205167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:28.233106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-239bf8f6-c1ec-4f25-a00a-bb0c58d09c97 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.639597 Sep 03 21:08:28.234146 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2484/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:27 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:28.381984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:28.396823 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cfe2f03-fe01-4ce1-ab65-a01740e97843 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1500 microversion: 2.1 time: 0.274284 Sep 03 21:08:28.409082 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2247/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:28 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1500 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:28.424397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:28.434557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:28.460849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.461798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.463833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.464795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.466227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.468882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.757859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:28.763613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:28.771202 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38807d88-c226-4cdc-ac51-a00c406ea09b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1500 microversion: 2.1 time: 0.350060 Sep 03 21:08:28.785400 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2485/4732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:28 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:28.797333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:28.806441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.807390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.808650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.844035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Going to try to stop instance {{(pid=140519) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:08:28.902968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe2d02ba-3adf-4f05-ae31-7647e0ac382c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "POST /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779/action" status: 202 len: 0 microversion: 2.1 time: 0.110534 Sep 03 21:08:28.918310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:28.919046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:28.921944 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2248/4733] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:28 2022] POST /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:08:28.931941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.932437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.933977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:28.934872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:28.935497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:28.936242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:29.192381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:29.202467 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a59ffd9c-5e5c-4eb2-ba40-21406bafe5c1 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.292826 Sep 03 21:08:29.203637 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2486/4734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:28 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:29.263239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:29.264353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:29.278364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:29.279053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:29.280641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:29.281531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:29.285072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:29.285628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:29.482042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:29.494155 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5277ea31-4a1d-401b-a4e3-aaec0b25ce10 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.235904 Sep 03 21:08:29.509371 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2249/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:29 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:30.249489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:30.250947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:30.258728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:30.259222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:30.259813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:30.260527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:30.261192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:30.261783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:30.521937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:30.524093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:30.536564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:30.537403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:30.538148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:30.539231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:30.540021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:30.540612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:30.749513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:30.770170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-71996cc3-fa15-4aff-99da-adeb4cfdd0a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.254765 Sep 03 21:08:30.771093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2250/4736] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:30 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:30.943821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:30.964019 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48f6039c-5579-4794-8a2a-a2a42123ca0f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.737731 Sep 03 21:08:30.964975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2487/4737] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:30 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:31.995265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:31.996740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:32.009671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:32.011010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:32.011728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:32.013167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:32.014135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:32.015241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:32.133009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:32.133969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:32.146040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:32.146543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:32.146993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:32.147702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:32.148180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:32.148592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:32.291333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:32.302945 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a43a39a3-b31a-49b3-bf39-7343314a0f77 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.313761 Sep 03 21:08:32.303719 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2488/4738] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:31 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:32.317683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:32.329448 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c960af5f-0c0e-418a-8cc0-d0d413c352f2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.538683 Sep 03 21:08:32.341122 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2251/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:31 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:33.330045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:33.330698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:33.340152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:33.341581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:33.342032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:33.342957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:33.344103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:33.344715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:33.357074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:33.358632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:33.367416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:33.368468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:33.369170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:33.370384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:33.371046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:33.371830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:33.537883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:33.553750 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5fbcee50-2bd4-4350-b996-ed05ef70f46d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.201407 Sep 03 21:08:33.554964 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2252/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:33 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:33.641888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:33.650662 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79cbe3a3-0e7d-4e65-be00-88630fc65b16 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.327221 Sep 03 21:08:33.651901 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2489/4741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:33 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:34.578813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:34.579449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:34.586860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:34.587658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:34.588112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:34.588886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:34.589415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:34.589871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:34.674355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:34.675164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:34.683485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:34.684383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:34.685100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:34.686177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:34.687191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:34.687916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:34.757361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:34.770966 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94417774-d7d9-4f97-a6a2-9695f70d68cb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.195931 Sep 03 21:08:34.771972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2253/4742] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:34 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:35.032712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:35.042349 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-440277d6-914e-49a3-ae8a-278477ed9e1c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.372092 Sep 03 21:08:35.042933 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2490/4743] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:34 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:35.794989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:35.795689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:35.808341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:35.811977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:35.812716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:35.814177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:35.817223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:35.817860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:36.067741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:36.068371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:36.081993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:36.082497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:36.082952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:36.083691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:36.084163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:36.084599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:36.139565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:36.150385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b127d259-cd03-462c-a8cf-ad0b6adf62d6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.359765 Sep 03 21:08:36.151695 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2254/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:35 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:36.347241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:36.357538 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed3ec2dc-3667-4f5e-be9f-99278e1d6ad7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.293601 Sep 03 21:08:36.359237 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2491/4745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:36 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:37.174235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:37.175577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:37.184021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:37.184798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:37.185427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:37.186309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:37.187665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:37.188296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:37.384178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:37.385502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:37.397404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:37.398062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:37.398533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:37.402629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:37.403251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:37.403828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:37.445116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:37.463389 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a504510f-020a-4656-a2cd-1fa90af49586 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.292435 Sep 03 21:08:37.465733 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2255/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:37 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:37.772500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:37.783644 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83058a5c-9a3f-4d6d-958f-7e80270daf2f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.402370 Sep 03 21:08:37.800938 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2492/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:37 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:38.500619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:38.504495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:38.520417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.522994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.523697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.526116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.526641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.528285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.744453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:38.754417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21b49c4b-e5eb-4766-a1fd-d18c9d83121f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1657 microversion: 2.1 time: 0.263402 Sep 03 21:08:38.755914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2256/4748] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:38 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1657 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:38.778070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:38.785779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.786596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.787432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.810359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:38.811152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:38.821512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.822300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.822898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.825088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.826262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.828195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.836793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Going to try to start instance {{(pid=140520) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 21:08:38.922085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15903de6-c23d-447f-9df3-5c0164c756ed tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.146261 Sep 03 21:08:38.936397 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2493/4749] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:38 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:08:38.954325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:38.957371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:38.968702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.969539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.970140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:38.971050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:38.972359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:38.973103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:39.317178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:39.328495 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-15e2fa11-001a-4dda-8c9f-927ecb0f770d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1666 microversion: 2.1 time: 0.388243 Sep 03 21:08:39.330445 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2494/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:38 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1666 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:39.361241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:39.368625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:39.388523 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a3d2d75b-4bd0-44d4-bce2-6e52c0a9c7ae tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.581100 Sep 03 21:08:39.391183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2257/4751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:38 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:40.354838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:40.355484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:40.369433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:40.369955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:40.370510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:40.387550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:40.388917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:40.389705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:40.427307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:40.427947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:40.436874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:40.438545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:40.440657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:40.442074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:40.443570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:40.444043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:40.697376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:40.708328 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1fbec2d5-370c-4443-8729-ad6d9e47f73f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1666 microversion: 2.1 time: 0.358320 Sep 03 21:08:40.709519 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2495/4752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1666 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:40.796928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:40.807730 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-efd25b1f-7a98-4f67-91c9-3e0c1c800b44 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.396588 Sep 03 21:08:40.825042 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2258/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:40 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:41.734076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:41.735490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:41.743369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.744130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.744837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:41.745805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.746374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.747026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:41.833719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:41.834768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:41.851798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.853320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.853794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:41.857580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.858081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.859634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:41.892940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:41.905775 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-37ceba57-78ad-4571-94ef-5ad6ea70f023 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.175969 Sep 03 21:08:41.921124 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2496/4754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:41 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:41.932863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:41.933678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:41.940001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.940662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.941353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:41.942220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:41.942792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:41.943358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.075363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:42.090092 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ebe44dba-75cb-4ae5-a4c2-a08135ec8266 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.261417 Sep 03 21:08:42.100250 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2259/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:41 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:42.146819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:42.160222 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c60fc20-7e17-4bcf-80f1-34156a7332f1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.232182 Sep 03 21:08:42.161214 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2497/4756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:41 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:42.188554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:42.189270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:42.196697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.197349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.198259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.199398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.200329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.200862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.265054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Unlocking {{(pid=140519) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 03 21:08:42.343318 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c2ddec7-8984-4365-ab59-4b70c88dce55 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.160164 Sep 03 21:08:42.344206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2260/4757] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:42 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:08:42.356021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:42.358078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:42.370950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.371859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.372608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.373592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.374165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.375076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.571769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:42.604066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4e685ac-a25a-4599-8cbf-d8d8ef1a1f43 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.253031 Sep 03 21:08:42.604622 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2498/4758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:42.627943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:42.628599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:42.634889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.635377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.635817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.636644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.637326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.637748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.786373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:42.794696 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64a113a2-10da-4d4c-acf0-0a0f1c1a2364 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.170952 Sep 03 21:08:42.795489 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2261/4759] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:42.819136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:42.819769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:42.826788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.827290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.827745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.828457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:42.829305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:42.829817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:42.977845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:42.986713 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-357fd7a0-60e2-4028-9527-2724fd4e8d81 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.171450 Sep 03 21:08:42.998735 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2499/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:43.013429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:43.014027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:43.022698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.023197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.023811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.024691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.025473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.026051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.105150 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b30b983c-9666-4460-90eb-bbddca5039f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.098722 Sep 03 21:08:43.109119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2262/4761] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:43 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:08:43.116814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:43.118027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:43.125662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.126414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.127031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.128335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.129122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.129767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.138469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:43.139456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:43.155044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.155560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.156013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.157294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:43.158712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:43.159783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:43.298638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:43.306861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed5d484f-6bfb-45ef-a4ba-53643250aa0b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.194813 Sep 03 21:08:43.307428 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2263/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:43 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:43.562290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:43.573390 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b8924c7-2bfb-496a-916f-55fa3d7f2e5b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1675 microversion: 2.1 time: 0.462409 Sep 03 21:08:43.573968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2500/4763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:43 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1675 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:44.330377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:44.332304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:44.341449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:44.342285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:44.342932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:44.343861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:44.345055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:44.345697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:44.611476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:44.612611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:44.627743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:44.628775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:44.629246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:44.629973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:44.630432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:44.630862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:44.679003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:45.054486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:45.077156 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-234a26b9-627e-4928-863e-a56c559d4404 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1655 microversion: 2.1 time: 0.469308 Sep 03 21:08:45.078671 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2501/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:44 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1655 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:45.104505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:45.105439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:45.113440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:45.114803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:45.115293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:45.116065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:45.116732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:45.117392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:45.129415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:45.138964 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73a6183a-203f-4b10-9e83-7ea0750d8d93 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.812267 Sep 03 21:08:45.139538 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2264/4765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:44 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:45.191906 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cc5141b-1291-4f99-af21-882ccd6c146c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.092191 Sep 03 21:08:45.192773 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2502/4766] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:08:45 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:08:45.201481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:45.202344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:45.209195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:45.209917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:45.210645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:45.211569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:45.212286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:45.212858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:45.347236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:45.355711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae6d9c6a-0dae-406a-8789-f7c5b405064e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1662 microversion: 2.1 time: 0.158156 Sep 03 21:08:45.356290 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2265/4767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:45 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:46.165601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:46.166379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:46.173294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.174083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.175191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:46.176097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.176726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.177548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:46.380125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:46.381385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:46.388842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.389645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.390307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:46.391262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.391936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.392961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:46.426613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:46.442757 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bbc24a72-7a12-4295-a2b4-a4d887bd4cbc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.283202 Sep 03 21:08:46.444021 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2503/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:46 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:46.676002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:46.684729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a75316a-f666-4017-86f7-ec763afc0423 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.309234 Sep 03 21:08:46.685717 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2266/4769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:46.709154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:46.710016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:46.718669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.719912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.720531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:46.722083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:46.722721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:46.723421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.067139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:47.075937 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55917ffb-11a0-41d8-bc59-11c8362e037d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.371769 Sep 03 21:08:47.077238 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2504/4770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:47.103391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:47.104088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:47.110583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.111094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.111552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.112316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.112789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.113294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.468278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:47.469134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:47.483004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.483634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.484377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.485364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.486079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.486929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.779752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:47.786314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:47.802693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9d733a1a-9d0b-4516-b666-cc8651e177bb tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.703970 Sep 03 21:08:47.804229 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2267/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:47 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:47.817812 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c6b663ca-5ae1-461d-bdcc-8d1cc54d40d0 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.340909 Sep 03 21:08:47.818765 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2505/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:47 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:47.838318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:47.838945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:47.845963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.847283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.847732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:47.848460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:47.849206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:47.849470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.134749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:48.145007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74185ec6-e642-42be-b534-fa21b2c1164c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.312845 Sep 03 21:08:48.156917 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2268/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:47 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:48.170709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:48.171534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:48.180248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.181763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.182453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.183470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.184148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.184621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.714433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:48.759525 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4dfe1990-526f-429c-8af0-55d739fc86f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.594150 Sep 03 21:08:48.760750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2506/4774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:48.786021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:48.788010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:48.797938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.801918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.804126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.807201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.811106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.811575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.844160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:48.845117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:48.852197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.852938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.853550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:48.854486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:48.855113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:48.855742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:49.014040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:49.022818 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1911fda0-0524-41e8-8f69-66d47b3493f9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.242381 Sep 03 21:08:49.023689 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2269/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:49.194356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:49.203089 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c88a9c41-1bf4-41cc-b7fb-be69f7e3afe8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.363319 Sep 03 21:08:49.216919 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2507/4776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:48 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:08:50.230479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:50.231879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:50.238973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:50.239477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:50.240102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:50.240823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:50.241457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:50.242669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:50.400006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:50.405166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:50.412701 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6dc9ce1-8d0b-4302-b8d0-600fcd97840c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.186250 Sep 03 21:08:50.429419 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2270/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:50 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:51.437040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:51.437833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:51.447150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=79 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:51.453740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:51.455590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:51.456821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:51.458479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:51.459175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:51.460281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:51.830084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:51.848121 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-328eeadd-4d41-48e3-81f8-7a56aba81644 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.414718 Sep 03 21:08:51.859521 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2508/4778] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:51 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:52.879633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:52.880442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:52.892418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=76 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:52.894608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:52.895177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:52.895818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:52.896686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:52.899591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:52.900202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:53.211201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:53.220041 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-058b054d-0541-4867-b154-9c9e283b166d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.346005 Sep 03 21:08:53.233689 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2271/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:52 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:54.260756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:54.262356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:54.273183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:54.274070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:54.275405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:54.276430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:54.277146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:54.277821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:55.173919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:55.187636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dffe2158-975f-4035-b31e-034731e73079 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1510 microversion: 2.1 time: 0.933187 Sep 03 21:08:55.190832 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2509/4780] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:54 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1510 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:56.213843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:56.215025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:56.223588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.224277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.225173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:56.226071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.226694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.227440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:56.610443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:56.639184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d2b8b491-f4ce-440d-afb2-c15be35fe7ab tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1487 microversion: 2.1 time: 0.429062 Sep 03 21:08:56.643828 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2272/4781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:56 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1487 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:56.666212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1514320978"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:08:56.670182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:56.681966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.682480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.682932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:56.683669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.684180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.684624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:56.839132 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d15f4c63-517a-472f-888f-a806030f4e75 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "PUT /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1060 microversion: 2.1 time: 0.176414 Sep 03 21:08:56.853141 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2510/4782] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:08:56 2022] PUT /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1060 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:56.861330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:56.863603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:56.874359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.877675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.878371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:56.879289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:56.880452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:56.883833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.274411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:57.314825 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6237ad64-d957-4f3a-8ade-97b671385690 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1487 microversion: 2.1 time: 0.457933 Sep 03 21:08:57.315474 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2273/4783] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:56 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1487 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:57.340751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:57.341472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:57.348882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.349441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.350390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.351115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.351575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.352201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.653730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:57.665779 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84735b8f-3f06-43a4-b7eb-c6c5d0ef2407 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1487 microversion: 2.1 time: 0.328809 Sep 03 21:08:57.689212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2511/4784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:57 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1487 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:57.691766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:57.692313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:57.703290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.703814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.704263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.705026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.705493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.706473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.739017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:08:57.853525 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3f9d2ac4-e5f6-455f-9012-8ab00d813fc7 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 204 len: 0 microversion: 2.1 time: 0.165101 Sep 03 21:08:57.858918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2274/4785] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:08:57 2022] DELETE /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:08:57.864746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:57.865435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:57.881338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.882159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.882806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:57.883902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:57.885131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:57.885736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:58.253944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:58.272839 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c0940f5f-8aac-413e-b195-31f552809900 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1493 microversion: 2.1 time: 0.412897 Sep 03 21:08:58.274642 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2512/4786] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:57 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1493 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:08:59.305059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:08:59.307387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:08:59.319805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:59.322418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:59.323258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:59.325100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:08:59.326931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:08:59.327485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:08:59.749003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:08:59.763335 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2d90375-2159-4cbc-a4fd-d0fe5a91df55 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1493 microversion: 2.1 time: 0.463320 Sep 03 21:08:59.769256 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2275/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:08:59 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1493 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:00.501494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36f5497-bf9c-4657-89b6-6e483fcba779", "name": "network-vif-deleted", "tag": "db0537f0-1f1b-411e-a6c9-634f9a2d1df9"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:00.520647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:00.521866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:00.522666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:00.542367 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] Creating event network-vif-deleted:db0537f0-1f1b-411e-a6c9-634f9a2d1df9 for instance f36f5497-bf9c-4657-89b6-6e483fcba779 on nch2-master-1 Sep 03 21:09:00.550894 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f40057b3-f9cc-4264-a168-9711130f2172 req-be7be0de-b0a4-485e-afe7-c970d3e2385b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056331 Sep 03 21:09:00.552814 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2513/4788] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:00.788239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:00.796065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:00.803341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:00.805460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:00.807660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:00.808945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:00.810529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:00.811806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:00.855215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:00.855814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:00.856495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:00.857013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lazy-loading 'fault' on Instance uuid f36f5497-bf9c-4657-89b6-6e483fcba779 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:09:00.910741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:00.920099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16ed58d7-25bf-4c26-8460-e09fa0f8867e tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 200 len: 1310 microversion: 2.1 time: 0.137192 Sep 03 21:09:00.921116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2276/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:00 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 1310 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:01.946395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:01.948077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:01.957103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:01.957981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:01.958790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:01.959680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:01.960820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:01.961462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:01.981892 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 HTTP/1.1 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f36f5497-bf9c-4657-89b6-6e483fcba779'} Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:01.986392 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:01.991560 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:01.999459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.003038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-657f3396-ce09-4e07-9741-c8be5ff04635 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 404 len: 111 microversion: 2.1 time: 0.060384 Sep 03 21:09:02.003641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2514/4790] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:01 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.020008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.020556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.034994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.035388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.035841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.038388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.038976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.039611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.057883 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 HTTP/1.1 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'f36f5497-bf9c-4657-89b6-6e483fcba779'} Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.060075 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.064744 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.067180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.068230 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c682c0e4-e1a4-4a75-a573-25eb2c48ee5a tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 404 len: 111 microversion: 2.1 time: 0.053454 Sep 03 21:09:02.069576 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2277/4791] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.077915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.079085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: f36f5497-bf9c-4657-89b6-6e483fcba779] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.090024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.090834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.091448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.092392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.093215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.093810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.113701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 HTTP/1.1 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'f36f5497-bf9c-4657-89b6-6e483fcba779'} Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.115586 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. Sep 03 21:09:02.120223 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.121692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance f36f5497-bf9c-4657-89b6-6e483fcba779 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.123061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-75a28150-17bb-45c7-9168-a7fbd882aee6 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779" status: 404 len: 111 microversion: 2.1 time: 0.049354 Sep 03 21:09:02.124221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2515/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/f36f5497-bf9c-4657-89b6-6e483fcba779 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:09:02.137856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.138685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.152338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.153925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.154580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.157195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.158528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.159782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.179133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 HTTP/1.1 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b9210929-ca1c-487b-91be-9692ef5669a9'} Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.181042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.185567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.187299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.188329 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6157030-22f1-4197-a887-618c5c77643f tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 404 len: 111 microversion: 2.1 time: 0.057085 Sep 03 21:09:02.189078 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2278/4793] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.198657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.199556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b9210929-ca1c-487b-91be-9692ef5669a9] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.207769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.208559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.209278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.211048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.211725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.212511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.228674 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 HTTP/1.1 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b9210929-ca1c-487b-91be-9692ef5669a9'} Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.231347 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. Sep 03 21:09:02.236138 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.237664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b9210929-ca1c-487b-91be-9692ef5669a9 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.238916 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66a639b9-b9c2-4e6d-b1c0-1669c2fa56fc tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9" status: 404 len: 111 microversion: 2.1 time: 0.045228 Sep 03 21:09:02.239944 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2516/4794] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/b9210929-ca1c-487b-91be-9692ef5669a9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:09:02.248425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.249051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.256489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.257301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.257999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.258715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.259480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.259900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.279152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 HTTP/1.1 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4cf64772-a73f-4bcf-88ff-abc402dffcc7'} Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.280227 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab76da52-10bd-4dc5-8afe-644e8fa57f9d tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 404 len: 111 microversion: 2.1 time: 0.038615 Sep 03 21:09:02.284735 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2279/4795] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.292799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.293693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 4cf64772-a73f-4bcf-88ff-abc402dffcc7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.302929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.303451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.303899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.304801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.305632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.306449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.326856 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 HTTP/1.1 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4cf64772-a73f-4bcf-88ff-abc402dffcc7'} Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.328646 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 4cf64772-a73f-4bcf-88ff-abc402dffcc7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c606f0ef-9b33-458d-bed3-cdad8a524357 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7" status: 404 len: 111 microversion: 2.1 time: 0.042968 Sep 03 21:09:02.333645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2517/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/4cf64772-a73f-4bcf-88ff-abc402dffcc7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.341959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.342464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.350561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.351144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.351660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.352468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.353026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.353740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.376497 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb HTTP/1.1 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '42b26b46-d45d-4134-8c34-2e398dda06cb'} Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.379844 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.385658 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.387573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.388700 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba35a4ef-2a18-4f26-9670-3c5697167754 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 404 len: 111 microversion: 2.1 time: 0.052773 Sep 03 21:09:02.389314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2280/4797] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.398734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.400668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 42b26b46-d45d-4134-8c34-2e398dda06cb] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.409302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.410804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.411745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.413144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.413889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.414564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.432200 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb HTTP/1.1 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '42b26b46-d45d-4134-8c34-2e398dda06cb'} Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.434353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. Sep 03 21:09:02.438435 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.442440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 42b26b46-d45d-4134-8c34-2e398dda06cb could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.443513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9bc9372e-c5f1-4b79-9b0d-9da4663cb1bb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb" status: 404 len: 111 microversion: 2.1 time: 0.049962 Sep 03 21:09:02.444359 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2518/4798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/42b26b46-d45d-4134-8c34-2e398dda06cb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.453810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.454490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.461382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.462223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.462804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.463739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.464408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.465160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.481489 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae HTTP/1.1 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '95205acf-bca5-45b7-9bfc-ac86b65402ae'} Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.484416 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.489391 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.490863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.492317 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d74652cb-73ba-4d10-9e43-cdab96547c97 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 404 len: 111 microversion: 2.1 time: 0.043628 Sep 03 21:09:02.493254 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2281/4799] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:09:02.505168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.505837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 95205acf-bca5-45b7-9bfc-ac86b65402ae] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.515221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.518669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.518669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.518669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.518669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.518669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.541785 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae HTTP/1.1 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '95205acf-bca5-45b7-9bfc-ac86b65402ae'} Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.544621 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 95205acf-bca5-45b7-9bfc-ac86b65402ae could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-244e14f6-b571-4820-bd84-c43f1c812deb tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae" status: 404 len: 111 microversion: 2.1 time: 0.048895 Sep 03 21:09:02.549203 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2519/4800] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/95205acf-bca5-45b7-9bfc-ac86b65402ae => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.557220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.557782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.566890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.567473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.568288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.570201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.570922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.572078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.601284 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 HTTP/1.1 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b943d964-ad09-4976-8c76-39f8965201f2'} Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.603200 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.606964 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.611064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.613560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-108c9a1a-0e59-4835-aac8-d03304e79f3b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 404 len: 111 microversion: 2.1 time: 0.060468 Sep 03 21:09:02.614704 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2282/4801] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.625129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.626733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: b943d964-ad09-4976-8c76-39f8965201f2] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.638947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.639611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.640154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.641244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.641821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.642350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.657708 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 HTTP/1.1 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'b943d964-ad09-4976-8c76-39f8965201f2'} Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.659315 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance b943d964-ad09-4976-8c76-39f8965201f2 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f2d97744-427f-4192-b45b-d40b8db201da tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2" status: 404 len: 111 microversion: 2.1 time: 0.042195 Sep 03 21:09:02.667569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2520/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/b943d964-ad09-4976-8c76-39f8965201f2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.669787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.670388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab HTTP/1.1 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '8bd772af-c3b3-43e9-a01e-140c548b82ab'} Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.685173 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a771917-1c4f-410d-af66-1fb8bed5e864 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab" status: 404 len: 111 microversion: 2.1 time: 0.014874 Sep 03 21:09:02.689164 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2283/4803] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.697640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.698651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 8bd772af-c3b3-43e9-a01e-140c548b82ab] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.704545 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab HTTP/1.1 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '8bd772af-c3b3-43e9-a01e-140c548b82ab'} Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:02.706175 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 8bd772af-c3b3-43e9-a01e-140c548b82ab could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90c64bd4-2dd3-4eb7-a163-4f0799c3661b tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab" status: 404 len: 111 microversion: 2.1 time: 0.020333 Sep 03 21:09:02.710204 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2521/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/8bd772af-c3b3-43e9-a01e-140c548b82ab => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:02.716795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.717586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.730032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.731327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.732328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.733724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.734462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.735404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.775126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:09:02.897675 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c08fa6a-e984-4ee0-bcfb-e2c18bac8f94 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "DELETE /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 204 len: 0 microversion: 2.1 time: 0.184368 Sep 03 21:09:02.898848 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2284/4805] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:02 2022] DELETE /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:09:02.909806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:02.910831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:02.920703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.921610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.922254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:02.923250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:02.924460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:02.925669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:03.120081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:03.128642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:03.147021 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5cddc1e-5515-4533-813c-435762ce0ba2 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1478 microversion: 2.1 time: 0.243579 Sep 03 21:09:03.163495 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2522/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:02 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1478 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:04.177465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:04.179282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:04.191412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:04.192118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:04.193214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:04.194102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:04.195809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:04.196523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:04.911507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:04.921996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4cd59710-85db-4bc1-b09a-d2c1885b4016 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1478 microversion: 2.1 time: 0.750713 Sep 03 21:09:04.922927 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2285/4807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:04 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1478 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:05.754570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938b2db4-a6e9-49d8-9d37-29eb8c1445e3", "name": "network-vif-deleted", "tag": "9bb71d2f-09a6-4c00-9e71-2a010eae96a7"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:05.770831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:05.771416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:05.772111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:05.799358 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] Creating event network-vif-deleted:9bb71d2f-09a6-4c00-9e71-2a010eae96a7 for instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 on nch2-master-1 Sep 03 21:09:05.804750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-34795a4a-a023-4531-b9bb-65b00f237ba7 req-0f7c7d69-96c3-4c95-be3e-1b3f56898b75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057226 Sep 03 21:09:05.805480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2523/4808] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:05.948003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:05.948625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:05.967016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:05.969660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:05.972763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:05.975467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:05.975952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:05.979278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:06.076491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:06.079082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:06.080228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:06.081586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lazy-loading 'fault' on Instance uuid 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:09:06.182377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e686d314d164930bbcfc9905a8b45ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de6b6fc412742beb94162e078268849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:06.196947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d6f1dbe-7c53-42d9-bb9d-5e7054662a8c tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 200 len: 1281 microversion: 2.1 time: 0.253360 Sep 03 21:09:06.213456 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2286/4809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:05 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:07.227551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:07.228858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] [instance: 938b2db4-a6e9-49d8-9d37-29eb8c1445e3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:07.238804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:07.239701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:07.240600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:07.241669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:07.242360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:07.243430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:07.269267 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] HTTP exception thrown: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Request method failure captured: Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 HTTP/1.1 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8G4watrYrzVJse4_SRb4i66co6n4c8W-roUOZsxI59TkSzNb_6-Jm3qo4UQ6CMYdeJgVRYrfYTiQBzgb2eIYRE1oTDeoMM6bfFp3HJxyjwF_eUtM33yQSsoXzrMNfV3haDKBljc4W-k0sdmeWq8GqNdJHcF_PGdFLDpPt8Zco-B1yM Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0de6b6fc412742beb94162e078268849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0de6b6fc412742beb94162e078268849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0de6b6fc412742beb94162e078268849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersTestJSON-1673062622 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0de6b6fc412742beb94162e078268849 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersTestJSON-1673062622 Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9e686d314d164930bbcfc9905a8b45ce Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersTestJSON-1673062622-project Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '938b2db4-a6e9-49d8-9d37-29eb8c1445e3'} Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:07.271396 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. Sep 03 21:09:07.275359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:09:07.277982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] Returning 404 to user: Instance 938b2db4-a6e9-49d8-9d37-29eb8c1445e3 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:07.278894 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79380622-b5d5-4afc-b783-5db03ea9afb8 tempest-ServersTestJSON-1673062622 tempest-ServersTestJSON-1673062622-project] 10.222.0.16 "GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3" status: 404 len: 111 microversion: 2.1 time: 0.059618 Sep 03 21:09:07.279487 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2524/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:07 2022] GET /compute/v2.1/servers/938b2db4-a6e9-49d8-9d37-29eb8c1445e3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:13.938943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Calling method '.version_select at 0x7fae65d27790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:13.940797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:13.941500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:13.942897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:13.959200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:13.960036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:13.960651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:13.973105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:13.973639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:13.974089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:13.980759 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-34ce23ea-c246-4aa9-a49c-2fba19d14233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1092348692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.279245 Sep 03 21:09:13.981389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2287/4811] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:09:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:15.953589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5133844c-b932-48d8-88ae-e63060fd7a51 tempest-ComputeTenantNetworksTest-1437612878 tempest-ComputeTenantNetworksTest-1437612878-project] Calling method '.version_select at 0x7fae6b879c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:16.181593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5133844c-b932-48d8-88ae-e63060fd7a51 tempest-ComputeTenantNetworksTest-1437612878 tempest-ComputeTenantNetworksTest-1437612878-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.373229 Sep 03 21:09:16.182796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2525/4812] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 21:09:15 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:16.195844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d2530bd-e0e6-431b-8dd5-fb2ec2926d41 tempest-ComputeTenantNetworksTest-1437612878 tempest-ComputeTenantNetworksTest-1437612878-project] Calling method '.version_select at 0x7fae65ccb4c0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:16.433210 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d2530bd-e0e6-431b-8dd5-fb2ec2926d41 tempest-ComputeTenantNetworksTest-1437612878 tempest-ComputeTenantNetworksTest-1437612878-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/b9086da0-9387-43af-b21b-9d10594a7797" status: 200 len: 139 microversion: 2.1 time: 0.241930 Sep 03 21:09:16.434803 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2288/4813] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:09:16 2022] GET /compute/v2.1/os-tenant-networks/b9086da0-9387-43af-b21b-9d10594a7797 => generated 139 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:26.962081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=33 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:26.962993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:27.399788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-feff3e81-48f3-4ac6-99a2-18a8b5d93a27 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Action: 'create', calling method: .version_select at 0x7fae670ead30>, body: {"keypair": {"name": "tempest-keypair-1471853856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXGOQ/cRUix0EewsAdCrnvyfdbMavbi5gBaOGpTGmqJJZhdBkt/g+MxtMCpJDtR9vEJgpDytD4Y3XgEcRWTh3MoQ0Mo+VbHJsz18ovR7Jsx89WR9uCtex7qvEMJx/Mnvw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:27.429749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-feff3e81-48f3-4ac6-99a2-18a8b5d93a27 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:09:27.437556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-feff3e81-48f3-4ac6-99a2-18a8b5d93a27 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for user 38dddfbdc4f0450e8d5fc7b214796758 and project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:09:27.466940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-feff3e81-48f3-4ac6-99a2-18a8b5d93a27 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.506905 Sep 03 21:09:27.467999 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2526/4814] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 21:09:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 508 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 21:09:29.670866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1713872721", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de044359-2fcb-4807-aee8-5338ac77f32a"}], "security_groups": [{"name": "tempest-securitygroup--1534563431"}], "key_name": "tempest-keypair-1471853856", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:29.687500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:29.688814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:29.919019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] validate_networks() for [('de044359-2fcb-4807-aee8-5338ac77f32a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:09:30.650097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:09:30.650545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:09:30.651017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:09:30.651431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:09:30.651846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:09:30.672766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:30.674107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:30.674836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:30.677273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:30.678046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:30.678699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:30.714904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:09:30.732128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for user 38dddfbdc4f0450e8d5fc7b214796758 and project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:09:30.747994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:09:30.751053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:09:30.822224 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d34dfb8-d395-4a3c-b1ea-7126af0e21f3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.157352 Sep 03 21:09:30.829414 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2289/4815] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:09:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:09:30.835756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:30.836380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:31.042089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:31.058978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:31.061167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:31.063988 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d5de472-d5fa-4c7b-aaed-7edb3c998ce5 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1282 microversion: 2.20 time: 0.233794 Sep 03 21:09:31.067319 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2527/4816] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:30 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:32.105671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:32.106312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:32.120247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:32.120757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:32.124944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:32.131650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:32.132508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:32.133037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:32.270144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:32.300490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:32.311390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:32.317729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b262fb16-f9fa-4dfa-8794-2ac25600994f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1334 microversion: 2.20 time: 0.222516 Sep 03 21:09:32.330788 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2290/4817] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:32 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1334 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:33.347918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:33.348624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:33.357780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:33.358614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:33.359291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:33.360224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:33.360914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:33.361807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:33.459889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:33.467984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:33.475143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:33.480601 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4a34d940-5899-4014-9384-79941cabf9fb tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1340 microversion: 2.20 time: 0.139579 Sep 03 21:09:33.481254 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2528/4818] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:33 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:34.510294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:34.512186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:34.526549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:34.527345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:34.528015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:34.529292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:34.530747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:34.531730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:34.628741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:34.638505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:34.640004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:34.644230 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1e1f159a-06d7-4576-ab5f-eb7b00eb2cfc tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1340 microversion: 2.20 time: 0.136604 Sep 03 21:09:34.644823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2291/4819] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:34 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:35.670757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:35.671513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:35.678508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:35.679059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:35.679471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:35.680202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:35.680670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:35.681143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:35.983078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:36.003150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:36.006048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:36.007329 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-500a4f39-05d1-4aef-b496-36bbd6494f93 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.340509 Sep 03 21:09:36.013234 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2529/4820] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:35 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:36.331557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99d5fa7-a10a-4e96-ba20-12e0676af0ec", "tag": "63ed8d09-dc0f-400e-8384-116069c680a1"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:36.344089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:36.346159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:36.346811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:36.366285 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] Creating event network-changed:63ed8d09-dc0f-400e-8384-116069c680a1 for instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec on nch2-master-1 Sep 03 21:09:36.372378 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-59e5bf8e-6d5d-4e5e-8e9a-0d47077d37b1 req-8e63eef5-cad4-4b13-b09e-eacd7582c220 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 Sep 03 21:09:36.373710 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2292/4821] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:37.036600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:37.037717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:37.059673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:37.061332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:37.062140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:37.063042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:37.063857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:37.064919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:37.357632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:37.372858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:37.375138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:37.378867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b3fe8cb1-b027-4625-b079-f82e6f9dcf31 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.348018 Sep 03 21:09:37.379463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2530/4822] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:37 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:38.406981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:38.409220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:38.417186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:38.418190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:38.418730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:38.419575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:38.420129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:38.420624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:38.740134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:38.748564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:38.750091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:38.751557 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b1e3dfe-cfd8-4039-b68a-f4c30b9f9e4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.349049 Sep 03 21:09:38.752667 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2293/4823] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:38 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:39.780338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:39.781859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:39.789844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:39.790641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:39.791247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:39.792118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:39.792765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:39.793500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:40.028237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:40.042845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:40.045503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:40.047950 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2c68a02-943b-4639-8a75-d11bd454e753 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.271311 Sep 03 21:09:40.049414 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2531/4824] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:39 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:41.076519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:41.077361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:41.086108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:41.089825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:41.092392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:41.093127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:41.094060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:41.094911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:41.096179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:41.096704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:41.267731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:41.279324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:41.284115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:41.286833 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95cf07c0-a61b-4a2c-bd30-c8badc24b704 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.216276 Sep 03 21:09:41.288030 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2294/4825] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:41 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:42.208963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:42.210207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:42.213411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:42.219708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:42.220141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:42.224492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:42.224492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:42.224492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:42.224492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:42.246643 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a3916d5-e006-4af1-991c-6d8e8bdc0117 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc/ips" status: 200 len: 150 microversion: 2.1 time: 0.041982 Sep 03 21:09:42.247438 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2532/4826] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:09:42 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:42.315833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:42.316617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:42.325166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:42.325826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:42.326383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:42.327245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:42.327815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:42.328355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:42.618055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:42.628256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:42.630072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:42.631487 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e7d83484-b081-4f27-8ef6-b858d48c40c0 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.320268 Sep 03 21:09:42.632531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2295/4827] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:42 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:43.670166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:43.672395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:43.688557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:43.693152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:43.693662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:43.694423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:43.694896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:43.697131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:43.708098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99d5fa7-a10a-4e96-ba20-12e0676af0ec", "name": "network-vif-plugged", "status": "completed", "tag": "63ed8d09-dc0f-400e-8384-116069c680a1"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:43.722868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:43.726144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:43.726743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:43.746208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] Creating event network-vif-plugged:63ed8d09-dc0f-400e-8384-116069c680a1 for instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec on nch2-master-1 Sep 03 21:09:43.764518 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-924b1846-a2f7-49f8-a989-85ed2629e451 req-0bf43601-3d3b-47c0-8f2f-ace4119f5f22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282307 Sep 03 21:09:43.765357 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2533/4828] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:43.869949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:43.870663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:43.880048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:43.880554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:43.881205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:43.891002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:43.891761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:43.893764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:43.941388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:09:43.958483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:43.973117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:43.978513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:43.979714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68695b19-76d9-4d5a-8b93-b0c56db8477a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.323405 Sep 03 21:09:43.984548 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2296/4829] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:43 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:44.069747 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb93c5e8-ac6b-4dde-b524-b8dbda3d973e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 204 len: 0 microversion: 2.1 time: 0.204211 Sep 03 21:09:44.070871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2534/4830] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:09:43 2022] DELETE /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:09:44.079537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:44.080421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:44.093902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:44.094545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:44.094893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:44.097126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:44.097126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:44.097296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:44.417358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:44.427327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dc2a91f-ed8d-412c-b06c-6e67acd47bdf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1682 microversion: 2.1 time: 0.351726 Sep 03 21:09:44.428543 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2297/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:44 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1682 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:45.026247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:45.031119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:45.046881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.047760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.048801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.049011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.049693 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.050169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.056876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:45.059921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:45.067785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.068299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.068934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.070368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.070864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.071307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.168277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b145461-1048-43c6-9ebf-6b3bfb0bdbc0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.115062 Sep 03 21:09:45.169131 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2298/4832] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:09:45 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:09:45.182998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:45.186571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:45.198242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.198911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.199257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.200167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.204279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.204838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.474956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:45.494488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-554e8114-45f7-4256-a008-ce1dbdecd459 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1672 microversion: 2.1 time: 0.320900 Sep 03 21:09:45.515339 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2299/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:45 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1672 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:45.521588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:45.522923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:45.533455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.541733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.545431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.546483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:45.546982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:45.547433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:45.810234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:45.811298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:45.821274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:45.823603 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ab5a763-f033-486b-93be-6aa5c3f22277 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1682 microversion: 2.1 time: 0.306838 Sep 03 21:09:45.824282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:45.825196 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2300/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:45 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1682 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:45.825864 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24f8142b-313d-4fb5-9c2d-36817df50ee6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1408 microversion: 2.20 time: 0.806719 Sep 03 21:09:45.826423 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2535/4835] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:45 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1408 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:46.520276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:46.520888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:46.527993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:46.528730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:46.529347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:46.530228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:46.530826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:46.531399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:46.850658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:46.852290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:46.860197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:46.861445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:46.862052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:46.863323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:46.864220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:46.864814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:46.984477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:46.993837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3eefebf9-6e5a-4108-8a84-8e7b78cb5095 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1615 microversion: 2.1 time: 0.150302 Sep 03 21:09:47.007214 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2536/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:46 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1615 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:47.021065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:47.022199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:47.025115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:47.031748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:47.032496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:47.033207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:47.034396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:47.035070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:47.035900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:47.038262 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d470d7c-3686-4c2f-a12d-4ad786766a72 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1672 microversion: 2.1 time: 0.522301 Sep 03 21:09:47.038873 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2301/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1672 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:47.297869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:47.318667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:47.321980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:47.333363 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec8240a4-eb84-427d-af44-8936fc8d90cf tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1599 microversion: 2.20 time: 0.310224 Sep 03 21:09:47.334759 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2537/4838] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:09:47 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1599 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:09:47.360379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:47.361778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:47.381601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:47.383303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:47.384342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:47.385327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:47.385983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:47.387021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:47.550723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-393f4a01-b45d-4b45-bf94-c933bbd55604 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.195091 Sep 03 21:09:47.552256 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2302/4839] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Sep 3 21:09:47 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:09:47.813704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9e946d-fd59-407d-8add-99b3eee0b8dc", "name": "network-vif-deleted", "tag": "55424041-b772-4ec4-9ab6-bad400f22199"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:47.841785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:47.843987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:47.848314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:47.868923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] Creating event network-vif-deleted:55424041-b772-4ec4-9ab6-bad400f22199 for instance ea9e946d-fd59-407d-8add-99b3eee0b8dc on nch1-master-1 Sep 03 21:09:47.888311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a0e9f3ba-4b04-4719-9254-14105bcc6de8 req-354487a6-af08-4fd1-8e10-c15378136335 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079588 Sep 03 21:09:47.892122 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2538/4840] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:48.027440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:48.028145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:48.050500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:48.051008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:48.051450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:48.052171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:48.052626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:48.053090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:48.067404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:48.068118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:48.078388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:48.078899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:48.079352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:48.080126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:48.080612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:48.081083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:48.352669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:48.361237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:48.369623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e4f3a044-00c0-4dbb-86ae-82ca8e7d68f9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1615 microversion: 2.1 time: 0.348649 Sep 03 21:09:48.373787 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c59c33f6-3e91-4924-a76e-50a46f95731a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1677 microversion: 2.1 time: 0.310571 Sep 03 21:09:48.384917 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2539/4841] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:09:48.385190 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2303/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:48 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1615 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:49.407189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:49.409467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:49.412727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:49.413156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:49.431391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:49.432658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:49.433379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:49.433874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:49.434633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:49.436193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:49.437204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:49.438802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:49.442101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:49.443185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:49.443423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:49.446953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:49.711858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:49.734668 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04716fdd-cd78-4202-a414-a2222fbe3edc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1615 microversion: 2.1 time: 0.345222 Sep 03 21:09:49.738587 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2540/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:49 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1615 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:49.848606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:49.861626 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c617af76-f20a-47c7-b6db-23ccd4785d62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1677 microversion: 2.1 time: 0.462562 Sep 03 21:09:49.862252 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2304/4844] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:49 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1677 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:09:49.928494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99d5fa7-a10a-4e96-ba20-12e0676af0ec", "tag": "63ed8d09-dc0f-400e-8384-116069c680a1"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:49.946226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:49.946719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:49.947166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:49.987927 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] Creating event network-changed:63ed8d09-dc0f-400e-8384-116069c680a1 for instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec on nch2-master-1 Sep 03 21:09:49.995452 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ad512206-815e-4549-83fa-4bc4ce12b3e0 req-44dd9f36-5573-4089-b584-c16e74f7c4f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072421 Sep 03 21:09:49.996097 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2541/4845] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:50.761820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:50.762439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:50.770041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:50.770856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:50.771455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:50.772426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:50.773078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:50.773663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:50.891291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:50.893454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:50.900097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:50.921816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:50.922333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:50.922453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b322652-eff8-4cda-b47e-d6c4f9d53dbb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1615 microversion: 2.1 time: 0.163833 Sep 03 21:09:50.922833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:50.924913 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2305/4846] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:50 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1615 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:50.925234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:50.925715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:50.926272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:51.167541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:51.185420 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1574190-3289-4db2-a42f-0bbbe16df93e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1677 microversion: 2.1 time: 0.300590 Sep 03 21:09:51.186992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2542/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:51.947558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:51.948450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:51.956173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:51.956672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:51.957387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:51.957855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:51.958314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:51.959872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:51.967894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:52.043825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:52.055198 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8a70176-1fac-47d6-87f4-8f512629f1a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1615 microversion: 2.1 time: 0.111370 Sep 03 21:09:52.069149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2306/4848] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:51 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1615 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:52.210520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:52.211150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:52.219832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:52.220707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:52.222161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:52.223105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:52.223766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:52.224400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:52.600742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:52.624737 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a98f0f9b-60f3-4732-a041-3003935c388a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1677 microversion: 2.1 time: 0.418658 Sep 03 21:09:52.627940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2543/4849] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:52 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1677 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:53.082080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:53.082701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:53.089931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:53.090421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:53.090860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:53.091567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:53.092216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:53.092649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:53.154619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:53.155005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:53.155679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:53.156377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lazy-loading 'fault' on Instance uuid ea9e946d-fd59-407d-8add-99b3eee0b8dc {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:09:53.232945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:53.250173 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-857a8538-59a6-4d42-845d-843b1a583524 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 200 len: 1332 microversion: 2.1 time: 0.172338 Sep 03 21:09:53.252943 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2307/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:53 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 1332 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:53.654657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:53.664949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:53.674463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:53.675241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:53.676067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:53.677044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:53.677754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:53.678471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:53.922741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:09:53.954012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79e6d6c9-b203-48ea-9c12-c0f59fab0254 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.303165 Sep 03 21:09:53.955257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2544/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:53 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:09:54.278253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:54.279148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:09:54.287837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:54.288404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:54.289122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:54.290121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:09:54.290913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:09:54.292037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:09:54.316041 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc HTTP/1.1 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ea9e946d-fd59-407d-8add-99b3eee0b8dc'} Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:09:54.317794 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa297b9b-1dcc-4390-af67-7a0d26fe7949 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 404 len: 111 microversion: 2.1 time: 0.046890 Sep 03 21:09:54.322235 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2308/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:09:54 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:09:54.328336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1960eba7-440e-4372-b0f1-0474e2d73474 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '.version_select at 0x7fae668fb280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:09:54.350843 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1960eba7-440e-4372-b0f1-0474e2d73474 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554293275" status: 202 len: 0 microversion: 2.1 time: 0.026050 Sep 03 21:09:54.352098 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2545/4853] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:09:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554293275 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:09:56.129581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: .version_select at 0x7fae65d27c10>, body: {"keypair": {"name": "tempest-keypair-1127218603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2MXC2XHvtBGXOpv5YMsZbcjMwoUE7fOGvuI/WcZqyxgFz171BAMEVwgFZo93VHHLMz7sZXtb8m4Vs7vCQXP8ZpoFzoeMrAI5IkJKDA5GvDzrQ4W64a8aEXX35g0i9kvA=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:56.152166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:09:56.159661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:09:56.174549 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [21cbac9b-28ae-492d-b04d-cdc7da74f7c2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:09:57.183898 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [21cbac9b-28ae-492d-b04d-cdc7da74f7c2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52404. Sep 03 21:09:57.205440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c454cfd-b513-4244-bde0-ae0f66fa47d9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.079790 Sep 03 21:09:57.206813 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2309/4854] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:09:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:09:59.325584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-606168882", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63485524-b841-48df-9f2a-17fe5709555c"}], "security_groups": [{"name": "tempest-securitygroup--2073671560"}], "key_name": "tempest-keypair-1127218603", "user_data": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:09:59.342367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:59.533537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] validate_networks() for [('63485524-b841-48df-9f2a-17fe5709555c', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:10:00.729862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:10:00.730461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:10:00.731173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:10:00.731803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:10:00.733212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:10:00.759112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:00.762208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:00.763035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:00.765259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:00.767464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:00.767934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:00.782276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:00.812929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:00.833765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:00.857660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:10:00.861732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:10:00.914718 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ec714bf-cd89-402e-a483-40cb83471398 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.593511 Sep 03 21:10:00.915877 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2546/4855] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:09:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:10:00.929555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b41cab91-af4c-42fd-8029-2524b8c18a21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:00.930596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b41cab91-af4c-42fd-8029-2524b8c18a21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:00.937366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:01.013449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b41cab91-af4c-42fd-8029-2524b8c18a21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:01.022947 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b41cab91-af4c-42fd-8029-2524b8c18a21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1241 microversion: 2.1 time: 0.099920 Sep 03 21:10:01.036920 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2310/4856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:00 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:02.049505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:02.051654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:02.058908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:02.059661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:02.060298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:02.061233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:02.061915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:02.062539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:02.152674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:02.167304 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d485c01-75bf-49b0-a2e3-0e21bfce5037 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1293 microversion: 2.1 time: 0.123248 Sep 03 21:10:02.186302 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2547/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:02 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:03.196571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:03.198015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:03.210401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:03.211434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:03.212534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:03.214904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:03.216672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:03.218044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:03.310989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:03.327151 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e85722b8-39f1-4291-8c9f-3cf06b1b015b tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1299 microversion: 2.1 time: 0.134318 Sep 03 21:10:03.327752 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2311/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:03 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:04.357855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:04.359257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:04.366400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:04.367926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:04.368477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:04.369695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:04.370267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:04.371095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:04.597466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:04.606741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9018951d-cdb6-4f79-8265-d03557c662d0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.253430 Sep 03 21:10:04.607903 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2548/4859] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:04 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:05.229987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee883ce-5f55-41a9-a07f-7543a98ff3c7", "tag": "3dcd5d14-807a-4f09-bac2-71baeca3ff3c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:05.242988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:05.243488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:05.243930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:05.256339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] Creating event network-changed:3dcd5d14-807a-4f09-bac2-71baeca3ff3c for instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 on nch2-master-1 Sep 03 21:10:05.262523 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a0af7f2d-f9f8-4af4-9eb9-15fde1f8256b req-f648d8b6-244d-484b-b9f5-0da99f40d54e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242568 Sep 03 21:10:05.263098 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2312/4860] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:10:05.630561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:05.631911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:05.639577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:05.640108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:05.640567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:05.641543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:05.642536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:05.643166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:05.882770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:05.891576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c935899e-f66c-41a3-8317-00528a78ce76 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.265064 Sep 03 21:10:05.905410 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2549/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:05 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:06.917641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:06.919609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:06.932956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:06.934194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:06.934823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:06.936720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:06.937581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:06.938026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:07.235766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:07.243793 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29f61283-b331-42af-860d-5bbb41171915 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.331885 Sep 03 21:10:07.244407 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2313/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:06 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:08.266746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:08.267964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:08.276497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:08.277029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:08.277478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:08.278285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:08.278950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:08.279386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:08.526976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:08.536418 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70a92bdc-ac4a-4588-92b9-1869634de81f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.273624 Sep 03 21:10:08.537159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2550/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:08 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:09.559974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:09.561340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:09.569711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:09.570213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:09.570657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:09.571395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:09.571853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:09.572283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:09.733639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:09.742438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dda2730-6369-4fd3-a1f7-a54f41459238 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.186953 Sep 03 21:10:09.743167 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2314/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:09 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:10.767883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:10.768662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:10.776180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:10.777205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:10.777509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:10.778200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:10.778688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:10.779124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:10.784262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:10.843972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:10.995264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:11.007791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cff08d58-0e8d-4cfe-a1bc-fafd116a40ac tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.244938 Sep 03 21:10:11.008874 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2551/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:10 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:11.555432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee883ce-5f55-41a9-a07f-7543a98ff3c7", "name": "network-vif-plugged", "status": "completed", "tag": "3dcd5d14-807a-4f09-bac2-71baeca3ff3c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:11.562061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:11.569746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:11.570565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:11.571013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:11.584441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] Creating event network-vif-plugged:3dcd5d14-807a-4f09-bac2-71baeca3ff3c for instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 on nch2-master-1 Sep 03 21:10:11.589984 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6c4ad42e-5136-4040-b1bc-c9e12e3c9f31 req-ac4eb2b2-1f55-47f2-9f9e-58a8952502ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038279 Sep 03 21:10:11.590775 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2315/4866] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:12.033792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:12.034497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:12.041398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:12.041900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:12.042353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:12.043216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:12.043865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:12.044348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:12.336152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:12.345925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-919a4996-ab92-4768-807b-16581008529d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1367 microversion: 2.1 time: 0.317901 Sep 03 21:10:12.346668 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2552/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:12 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:13.373501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:13.374727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:13.383947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:13.383947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:13.383947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:13.383947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:13.384355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:13.384706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:13.535559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:13.543729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54d0d354-60b3-4772-b5fd-7eb7c70ceefc tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1557 microversion: 2.1 time: 0.176022 Sep 03 21:10:13.544502 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2316/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:13 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:13.567992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:13.568650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:13.578951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:13.732679 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-230110bf-0c80-43de-b1b6-b020af5b205e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169304 Sep 03 21:10:13.733539 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2553/4869] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:10:13 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:15.180477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee883ce-5f55-41a9-a07f-7543a98ff3c7", "tag": "3dcd5d14-807a-4f09-bac2-71baeca3ff3c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:15.191806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:15.192302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:15.192739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:15.205605 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] Creating event network-changed:3dcd5d14-807a-4f09-bac2-71baeca3ff3c for instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 on nch2-master-1 Sep 03 21:10:15.210914 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-405ecf31-953f-4374-9a42-c280dbd7a351 req-24fb2fae-c9b4-4c63-a04b-4823d29d4471 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034097 Sep 03 21:10:15.211838 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2317/4870] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:23.407031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:23.409101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:23.416091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:23.416786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:23.417444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:23.418150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:23.418603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:23.419030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:23.452179 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a029eb9f-48c9-4d22-9bc0-ae66dd98e8c6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec/ips" status: 200 len: 151 microversion: 2.20 time: 0.051077 Sep 03 21:10:23.453169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2554/4871] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Sep 3 21:10:23 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:10:24.925460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:24.926033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:24.932227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:24.932716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:24.933190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:24.933900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:24.934354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:24.934781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:24.939042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=45 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:24.961664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:10:25.053640 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed6360e3-9e64-4a16-b977-65959a4930c2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 204 len: 0 microversion: 2.20 time: 0.133167 Sep 03 21:10:25.054618 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2318/4872] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:10:24 2022] DELETE /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:10:25.065302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:25.066550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:25.072948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:25.076870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:25.077362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:25.078096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:25.078570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:25.079550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:25.217740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:25.228357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:25.229906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:25.231233 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d1e0289-7656-4325-a8cb-b555eaa2d30c tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1724 microversion: 2.20 time: 0.172254 Sep 03 21:10:25.231796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2555/4873] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:25 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:26.258790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:26.259697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:26.273720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:26.275038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:26.275398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:26.276153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:26.278728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:26.280552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:26.603567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:26.613630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:26.615220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:26.616423 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2adbfc04-7089-45cf-a687-297f777f81d6 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1724 microversion: 2.20 time: 0.362329 Sep 03 21:10:26.617206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2319/4874] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:26 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:27.642364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:27.642916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:27.650264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:27.650759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:27.651404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:27.652322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:27.652788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:27.653247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:27.747649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:27.757398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:27.759144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:27.760535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-711eaaea-fc30-46bd-a45a-626b75c486ed tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 200 len: 1656 microversion: 2.20 time: 0.122797 Sep 03 21:10:27.774103 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2556/4875] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:27 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 1656 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:10:27.877594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99d5fa7-a10a-4e96-ba20-12e0676af0ec", "name": "network-vif-deleted", "tag": "63ed8d09-dc0f-400e-8384-116069c680a1"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:27.899974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:27.900620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:27.901111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:27.923858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] Creating event network-vif-deleted:63ed8d09-dc0f-400e-8384-116069c680a1 for instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec on nch2-master-1 Sep 03 21:10:27.933993 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e57b2b7b-94c4-4e19-9bd4-2d7641714d69 req-2e3efdb6-266e-4119-922b-9f8daf8b5332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058265 Sep 03 21:10:27.936719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2320/4876] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:28.788949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:28.789695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:28.796685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:28.797707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:28.798355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:28.799355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:28.800019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:28.800684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:28.820515 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec HTTP/1.1 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c99d5fa7-a10a-4e96-ba20-12e0676af0ec'} Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:10:28.823195 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:10:28.828363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:10:28.830885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:10:28.832061 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3641ab9b-7fa9-482a-adbb-8244536a0cee tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 404 len: 111 microversion: 2.20 time: 0.047450 Sep 03 21:10:28.833069 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2557/4877] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:28 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:10:28.842433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9dddd25-504f-4559-a229-3c074cf8af00 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '.version_select at 0x7fae65cb2670>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:28.870817 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9dddd25-504f-4559-a229-3c074cf8af00 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471853856" status: 204 len: 0 microversion: 2.20 time: 0.032030 Sep 03 21:10:28.871529 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2321/4878] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 21:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471853856 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:10:29.692865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-462e11d4-986c-4ec7-88ff-35f014d2fa99 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Action: 'create', calling method: .version_select at 0x7fae6741f700>, body: {"keypair": {"name": "tempest-keypair-1820476872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+Z+vEKPdx+vw7LlUXCjIcN0/A1AV3ATh16lwnIazEZoCK6mMfLLSYkkdoL6lZbyF4+Gl3bAEXQiBr3q4Hr3KjQ9WXi2iXngRRbNViInqTkyoGtowAMAu7WgEJ+NzRXw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:29.700027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:29.712422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-462e11d4-986c-4ec7-88ff-35f014d2fa99 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:29.718132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-462e11d4-986c-4ec7-88ff-35f014d2fa99 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for user 38dddfbdc4f0450e8d5fc7b214796758 and project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:29.754334 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-462e11d4-986c-4ec7-88ff-35f014d2fa99 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.065772 Sep 03 21:10:29.760951 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2558/4879] 10.222.0.16 () {62 vars in 1200 bytes} [Sat Sep 3 21:10:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 21:10:32.199443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1167332048", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de044359-2fcb-4807-aee8-5338ac77f32a"}], "security_groups": [{"name": "tempest-securitygroup--204005762"}], "key_name": "tempest-keypair-1820476872", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:32.215363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:32.321943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] validate_networks() for [('de044359-2fcb-4807-aee8-5338ac77f32a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:10:32.798434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:10:32.798907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:10:32.799403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:10:32.799828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:10:32.800280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:10:32.812128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:32.812950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:32.815315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:32.816278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:32.817164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:32.817928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:32.844000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:32.851271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Getting quotas for user 38dddfbdc4f0450e8d5fc7b214796758 and project 0f4fe674ef004caf8df73b8b06f7dd23. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:32.865439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:10:32.868133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:10:32.918330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3b8b066-6ec3-4fdb-a86e-b0792133304a tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.723926 Sep 03 21:10:32.919703 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2322/4880] 10.222.0.16 () {62 vars in 1188 bytes} [Sat Sep 3 21:10:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 21:10:32.931421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:32.932219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:33.155862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:33.166165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:33.168046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:33.169533 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b07ed56c-d967-46cb-9003-16f4e04627a2 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1282 microversion: 2.20 time: 0.242141 Sep 03 21:10:33.170256 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2559/4881] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:32 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:34.201089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:34.202496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:34.210779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:34.211459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:34.211977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:34.212888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:34.213660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:34.214207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:34.323830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:34.333560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:34.335100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:34.337500 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40db252e-05f6-4fdc-86de-9426b90c0526 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1342 microversion: 2.20 time: 0.141132 Sep 03 21:10:34.338348 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2323/4882] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:34 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:35.365514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:35.366072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:35.397848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:35.398357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:35.398858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:35.399645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:35.400147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:35.400618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:35.420822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=60 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:35.690688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:35.701711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:35.703952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:35.705347 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-732f7c70-4ed8-4e14-997d-591f37865e85 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.345507 Sep 03 21:10:35.706316 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2560/4883] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:35 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:36.224475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd8dab1-c7d2-4116-9957-e60d8fe37c42", "tag": "c4905fc7-1bd3-4374-9419-1ddad8b26dd2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:36.247309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:36.248499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:36.249462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:36.267625 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] Creating event network-changed:c4905fc7-1bd3-4374-9419-1ddad8b26dd2 for instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 on nch1-master-1 Sep 03 21:10:36.273625 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-7e80ad5c-9cb8-4646-be52-8a152c4f0eaa req-9a7acf0f-6b84-4c34-8e0a-d651ea5d2b39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066681 Sep 03 21:10:36.274835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2324/4884] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:36.735036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:36.735683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:36.743860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:36.744362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:36.744801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:36.745551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:36.746850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:36.747299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:36.986726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:36.995976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:36.998075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:36.999600 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5e60e71c-11a5-406f-965e-60d592d839fd tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.271803 Sep 03 21:10:37.000185 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2561/4885] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:36 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:38.026888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:38.028060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:38.034583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:38.035083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:38.035530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:38.036237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:38.036699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:38.037159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:38.174583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:38.182749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:38.184207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:38.185358 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e9dc5a2a-f3c1-4592-88e2-c8eaad6ceec7 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.163687 Sep 03 21:10:38.185930 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2325/4886] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:38 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:39.213075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:39.214323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:39.222724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:39.223227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:39.223780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:39.224512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:39.225005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:39.225441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:39.369310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:39.384952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:39.386426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:39.387556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd7348c6-3862-4de1-8c64-bce913195c09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.180759 Sep 03 21:10:39.388129 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2562/4887] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:39 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:40.412471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:40.413160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:40.420400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:40.421167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:40.421764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:40.422673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:40.423308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:40.423747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:40.659243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:40.667998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:40.669610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:40.670716 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a52eef20-695a-4011-9516-0b8b486a8d4e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.262071 Sep 03 21:10:40.671236 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2326/4888] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:40 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:10:41.698370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:41.698997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:41.706006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:41.706531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:41.706979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:41.707689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:41.708154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:41.708594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:41.849526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:41.858180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:41.860627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:41.862183 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d954509-b264-4023-9058-442d66d720ad tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.167613 Sep 03 21:10:41.863017 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2563/4889] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:41 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:42.265496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:42.266758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:42.273678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.274420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.275280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.276148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.276621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.277094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.428726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:42.438256 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-caf51984-7726-476f-b109-8bb9771e6717 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.177041 Sep 03 21:10:42.438841 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2327/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:42.464519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:42.465924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:42.473827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.474325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.475005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.475726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.476602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.477236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.651757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:42.660294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09b7a0f5-38ed-4249-8760-2d60e2a59b7e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.201378 Sep 03 21:10:42.665299 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2564/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:42.683610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:42.684483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:42.695270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.695781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.696443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.697729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.698441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.698892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.831508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:42.859125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:42.878680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:42.888273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:42.888837 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49ebb8e7-7f59-47bc-9032-d1e6386f11a4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.209122 Sep 03 21:10:42.889046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:42.889825 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2328/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:42.918162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8dab1-c7d2-4116-9957-e60d8fe37c42", "name": "network-vif-plugged", "status": "completed", "tag": "c4905fc7-1bd3-4374-9419-1ddad8b26dd2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:42.918452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.919287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.920072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.921597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.922883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.923515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.959776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:42.962037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:42.962705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:42.986858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] Creating event network-vif-plugged:c4905fc7-1bd3-4374-9419-1ddad8b26dd2 for instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 on nch1-master-1 Sep 03 21:10:42.993429 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-cde2f73f-b73e-43b0-b695-6100826c4484 req-b2f7ae9b-ac17-41b7-8836-8e33b5b87756 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087250 Sep 03 21:10:42.994516 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2329/4893] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:43.003074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:43.003783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:43.010883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:43.011937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:43.012443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:43.013362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:43.014150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:43.014727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:43.165106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:43.218801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:43.237031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:43.239006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:43.241271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ac7227d-6e7a-4c4e-a67b-e11d3464ebe3 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.356835 Sep 03 21:10:43.242167 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2565/4894] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:42 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 21:10:43.284391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:43.294382 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d667bce-4220-4bcb-a395-3f2e2273d72c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.295588 Sep 03 21:10:43.295193 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2330/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:43.431521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1783925547", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b1cd1193-a10d-479f-9da3-5114ed491f2f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:43.496386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] validate_networks() for [('b1cd1193-a10d-479f-9da3-5114ed491f2f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:10:44.185346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:10:44.186525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:10:44.187546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:10:44.188885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:10:44.189561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:10:44.199700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:44.200464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:44.201171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:44.202906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:44.203418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:44.204531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:44.234727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:44.242489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:44.260242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:10:44.269509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:44.269709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:10:44.271013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:44.279710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:44.282104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:44.283034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:44.284558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:44.285832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:44.286629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:44.345968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29d66471-24d4-4141-9fc3-2bbd1f650e88 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919045 Sep 03 21:10:44.351436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2566/4896] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:10:44.371934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-71d15dd0-289a-4a6f-bd8d-86cc056f59fa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:44.375054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-71d15dd0-289a-4a6f-bd8d-86cc056f59fa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:44.492222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:44.504427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:44.505958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:44.507113 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f18d538-213c-4770-9dbb-ada62d2e2997 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1407 microversion: 2.20 time: 0.243176 Sep 03 21:10:44.509661 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2331/4897] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:44 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:44.525114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-71d15dd0-289a-4a6f-bd8d-86cc056f59fa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:44.544128 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-71d15dd0-289a-4a6f-bd8d-86cc056f59fa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1215 microversion: 2.1 time: 0.182153 Sep 03 21:10:44.544998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2567/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:44 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:45.537682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:45.538505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:45.549649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:45.550450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:45.551132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:45.553288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:45.553933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:45.554564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:45.573079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:45.574585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:45.585207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:45.586643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:45.587133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:45.587861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:45.588324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:45.588750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:45.693267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:45.704549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-99593b7a-caf9-490b-92ec-04a8cd63e188 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1267 microversion: 2.1 time: 0.137830 Sep 03 21:10:45.705425 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2568/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:45 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:45.953062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:45.973668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:45.976801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:45.978800 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-69c9b230-f8aa-4f91-b835-e00f347e8c90 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1599 microversion: 2.20 time: 0.447940 Sep 03 21:10:45.981362 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2332/4900] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:10:45 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1599 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:10:46.005905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:46.006622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:46.013472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:46.014293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:46.014984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:46.016407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:46.017070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:46.017665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:46.151387 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5aefb60a-d7d9-4d67-8570-0523326a7f61 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.149613 Sep 03 21:10:46.153178 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2569/4901] 10.222.0.16 () {60 vars in 1316 bytes} [Sat Sep 3 21:10:46 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:10:46.728358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:46.729112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:46.744274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:46.745248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:46.745972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:46.746996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:46.747732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:46.748377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:46.940625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:46.971550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f25119de-acb0-4e34-b70e-3216b0e925d7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1273 microversion: 2.1 time: 0.231627 Sep 03 21:10:46.972820 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2333/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:46 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:47.999460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:48.000716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:48.015525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:48.017196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:48.017865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:48.018891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:48.019415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:48.019941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:48.353922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:48.365159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b2d22ed7-4a1a-486d-bcd5-a0ff35927a7f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.370421 Sep 03 21:10:48.377334 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2570/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:47 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:48.731023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd8dab1-c7d2-4116-9957-e60d8fe37c42", "tag": "c4905fc7-1bd3-4374-9419-1ddad8b26dd2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:48.743131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:48.744610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:48.745144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:48.782312 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] Creating event network-changed:c4905fc7-1bd3-4374-9419-1ddad8b26dd2 for instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 on nch1-master-1 Sep 03 21:10:48.794131 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3ff344a1-dca4-4550-b080-d9a2ac188ccf req-f0bf7aae-5749-4586-a45d-b443657fbdbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310700 Sep 03 21:10:48.795091 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2334/4904] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:49.281248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c887c6f-b87b-4a74-8889-2291d9d6f2fd", "tag": "274a4b54-51b0-4f79-b4f8-c18c50b982a8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:49.298166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:49.301302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:49.301802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:49.334977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] Creating event network-changed:274a4b54-51b0-4f79-b4f8-c18c50b982a8 for instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd on nch2-master-1 Sep 03 21:10:49.370638 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2b11bebd-f208-4221-936a-7215605c4ca0 req-70009fc2-a1f3-4c98-a8b1-accce5ba4684 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065535 Sep 03 21:10:49.371572 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2571/4905] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:49.390082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:49.391156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:49.402452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:49.407675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:49.408345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:49.409295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:49.409958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:49.410572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:49.952186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:49.965944 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b019f3aa-7bd4-4282-b5e6-a3518976766a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.578596 Sep 03 21:10:49.966544 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2335/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:49 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:50.993252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:50.995318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:51.007782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:51.008720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:51.014795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:51.015873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:51.017090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:51.017856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:51.355156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:51.365096 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d80dd622-428e-4566-9ae2-6a5ba9700e45 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.377128 Sep 03 21:10:51.366468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2572/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:50 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:51.604802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:51.605430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:51.618996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:51.620248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:51.622785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:51.624088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:51.624773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:51.625979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:51.684519 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9496db97-1c2b-4f6f-b698-235bce403fa9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.084352 Sep 03 21:10:51.685746 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2336/4908] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:10:51 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:52.391789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:52.392562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:52.401035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:52.401866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:52.402661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:52.403632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:52.404346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:52.406081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:52.635317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:52.657663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7582c0fb-3067-4aa3-a0fc-99f13ac0d559 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.269253 Sep 03 21:10:52.658580 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2573/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:52 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:53.357576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:53.358903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:53.367465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.368530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.369563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.370546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.371414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.372534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.431229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:10:53.439496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:53.571579 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ab36381-cdff-493a-baa1-d9de18ec7ca7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 204 len: 0 microversion: 2.1 time: 0.209982 Sep 03 21:10:53.576058 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2337/4910] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:10:53 2022] DELETE /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:10:53.582974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:53.583758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:53.593179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.594174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.594759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.596376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.599958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.601484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.685184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:53.686749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:53.700481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.701819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.702531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.704025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:53.704662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:53.705284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:53.915092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:53.926488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e08bc2e-fcb6-4142-bf15-bb9abc58ba86 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.247544 Sep 03 21:10:53.927906 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2338/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:53 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:53.978186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:53.994651 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3dc17334-cd38-43ad-b2f8-fa0804fca2cb tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1682 microversion: 2.1 time: 0.416978 Sep 03 21:10:54.010684 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2574/4912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:53 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1682 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:54.796178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c323b26f-5bde-4de0-9a27-996600123731 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: .version_select at 0x7fae65d67a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1736549631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcD3ID2EzvSSlHBIzO3F9RIozOCgB+AUcTAKceUxevk/523WgXzbUQ+PyNYbOK5dFAgcSz+TqM/RVWAgE4FgcW+vad9ew4/sleMyn89U+4g9MKHPc1/LJ5Vgg8Djor2jw=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:54.835579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c323b26f-5bde-4de0-9a27-996600123731 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:54.857532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c323b26f-5bde-4de0-9a27-996600123731 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:54.928828 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c323b26f-5bde-4de0-9a27-996600123731 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.136604 Sep 03 21:10:54.936755 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2339/4913] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:10:54 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:54.954609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:54.965715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:54.973306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:54.974486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:54.980437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:54.981271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:54.982328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:54.983878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:54.984724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:54.985643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:55.019298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:55.019916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:55.033165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:55.033533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:55.034178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:55.035465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:55.036211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:55.037080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:55.412771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:55.433729 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4794d693-7adb-41d1-9995-f8ba2c6e1568 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.485926 Sep 03 21:10:55.436639 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2575/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:54 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:55.463272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:55.477608 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eff7d5b9-94a8-436d-8e32-ba178f38c8ca tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1682 microversion: 2.1 time: 0.462986 Sep 03 21:10:55.480327 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2340/4915] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:55 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1682 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:56.472848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:56.474033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:56.485760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:56.486668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:56.487298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:56.489203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:56.489837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:56.490452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:56.503722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:56.504343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:56.517934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:56.518673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:56.520738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:56.521674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:56.525649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:56.526352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:56.704838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:56.722640 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b871fc6b-1633-441f-9d79-c5f65b4548b7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1614 microversion: 2.1 time: 0.222767 Sep 03 21:10:56.724009 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2341/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:56 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1614 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:56.782189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:56.797072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52130211-338e-4e70-839e-a58b69491bd4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.334458 Sep 03 21:10:56.797758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2576/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:56 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:57.713747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee883ce-5f55-41a9-a07f-7543a98ff3c7", "name": "network-vif-deleted", "tag": "3dcd5d14-807a-4f09-bac2-71baeca3ff3c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:57.752450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:57.753524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:57.767724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:57.770802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:57.773981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:57.775369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:57.775672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:57.776626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:57.777184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:57.777574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:57.780939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:57.820039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] Creating event network-vif-deleted:3dcd5d14-807a-4f09-bac2-71baeca3ff3c for instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 on nch2-master-1 Sep 03 21:10:57.838143 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-7b7f9d06-5509-4983-af5d-364f6ce8df52 req-8ef0a39a-e303-4d66-9e98-1d39fd1880b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128022 Sep 03 21:10:57.839715 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2342/4918] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:57.872152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:57.873135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:57.910855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:57.911214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:57.917939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:57.920984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:57.921591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:57.923432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:57.931092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:57.956069 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3266d0c0-7f1b-418a-a494-0eff21560fd8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 200 len: 1326 microversion: 2.1 time: 0.197843 Sep 03 21:10:57.975401 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2577/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:57 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 1326 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:58.157519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c887c6f-b87b-4a74-8889-2291d9d6f2fd", "name": "network-vif-plugged", "status": "completed", "tag": "274a4b54-51b0-4f79-b4f8-c18c50b982a8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:58.200929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:58.202645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:58.204311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:58.235081 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] Creating event network-vif-plugged:274a4b54-51b0-4f79-b4f8-c18c50b982a8 for instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd on nch2-master-1 Sep 03 21:10:58.248373 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1de0b295-308d-4cb6-aa94-efd503113aab req-914a700f-ce2c-44fa-a11a-8bc5aa3f5786 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093111 Sep 03 21:10:58.249519 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2578/4920] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:10:58.324034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:58.337037 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c4304ea-7b56-4ea8-9729-e7f8a6b34bc7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.494268 Sep 03 21:10:58.346667 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2343/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:57 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:10:58.479863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2050395702", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "e1628c89-7adc-4f85-b117-9bcc53678e33"}], "key_name": "tempest-TestNetworkBasicOps-1736549631", "security_groups": [{"name": "tempest-secgroup-smoke-1428839829"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:10:58.695543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] validate_networks() for [('e1628c89-7adc-4f85-b117-9bcc53678e33', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:10:58.983676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:58.991765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:59.017206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.017722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.018165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.021098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.021600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.022038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.046240 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 HTTP/1.1 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4ee883ce-5f55-41a9-a07f-7543a98ff3c7'} Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:10:59.049728 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:10:59.054865 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:10:59.056559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:10:59.057856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02d860a1-8bb9-4e20-b673-8f0a9f68f396 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 404 len: 111 microversion: 2.1 time: 0.079248 Sep 03 21:10:59.059630 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2344/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:58 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:10:59.070939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ccef2a4d-174b-4a1d-8135-009629ded58d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '.version_select at 0x7fae65d9d0d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:59.104365 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ccef2a4d-174b-4a1d-8135-009629ded58d tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127218603" status: 202 len: 0 microversion: 2.1 time: 0.039316 Sep 03 21:10:59.104950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2345/4923] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:10:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127218603 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:10:59.325967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:10:59.326492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:10:59.326872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:10:59.327293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:10:59.327714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:10:59.345462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.345979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.347463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.348464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.348976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.349420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.364029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:59.365078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:59.379162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:10:59.385915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:10:59.395723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.397958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.398609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.400169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:10:59.401248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:10:59.402743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:10:59.404140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:10:59.404855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:10:59.475834 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-02e27edf-df5c-44e6-a09a-3406d6a15b9e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.000160 Sep 03 21:10:59.477476 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2579/4924] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:10:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:10:59.489752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ca36002-8ece-4229-9d90-2c4d85347964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:10:59.490810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7ca36002-8ece-4229-9d90-2c4d85347964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:10:59.567895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7ca36002-8ece-4229-9d90-2c4d85347964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:59.602693 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ca36002-8ece-4229-9d90-2c4d85347964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1249 microversion: 2.1 time: 0.112942 Sep 03 21:10:59.603353 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2580/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:59 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1249 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:10:59.625311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:10:59.634362 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4efcbcc0-b85e-48eb-8555-3fa9105bf5b8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1315 microversion: 2.1 time: 0.275438 Sep 03 21:10:59.635254 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2346/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:10:59 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:00.023819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-046a403e-15c1-43e0-b935-26c24de934c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: .version_select at 0x7fae6b93e310>, body: {"keypair": {"name": "tempest-keypair-2141963223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1t8eGvPDwaliYLFEmiJ1CLRSytm0ggAJYpnUs4pLfUIjJ+N/BhaafBd1xjgtfPXnZplJ50Gjr03wvCXeexIxSCZExbveBtVG380iQ+8e2pPdti7xPaJ/gUvIZ5jjVPhQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:00.030912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:00.044635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-046a403e-15c1-43e0-b935-26c24de934c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:11:00.050874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-046a403e-15c1-43e0-b935-26c24de934c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:11:00.081631 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-046a403e-15c1-43e0-b935-26c24de934c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062255 Sep 03 21:11:00.082567 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2581/4927] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:11:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:00.626556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:00.627742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:00.636792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:00.637364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:00.637931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:00.639345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:00.639889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:00.640396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:00.663272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:00.664416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:00.673306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:00.677159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:00.677818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:00.678552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:00.679020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:00.679456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:00.751670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:00.763753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d3640ba-6e12-4a14-bdcb-5d5e63174207 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1301 microversion: 2.1 time: 0.141805 Sep 03 21:11:00.765084 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2347/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:00 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1301 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:00.967647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:00.970940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:00.981367 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-35ae147e-ab38-4b04-815b-9962e15494da tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1502 microversion: 2.1 time: 0.322875 Sep 03 21:11:00.981971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2582/4929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:00 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:01.006167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:01.007032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:01.013623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:01.013909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:01.014680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:01.015401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:01.016556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:01.017009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:01.347934 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.network.security_group_api [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Removing security group fc250ac1-a6ad-4caf-9e34-7b2d0ed50df2 from port 274a4b54-51b0-4f79-b4f8-c18c50b982a8 Sep 03 21:11:01.789154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:01.789772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:01.797639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:01.798132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:01.798576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:01.799288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:01.799748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:01.800176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:01.895732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:01.905038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c3209b5-a263-4155-8e60-881961bf078d tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1307 microversion: 2.1 time: 0.119697 Sep 03 21:11:01.906367 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2583/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:01 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:02.138178 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d72ec841-eeee-4496-9b21-2ac851510e74 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd/action" status: 202 len: 0 microversion: 2.1 time: 1.136591 Sep 03 21:11:02.140521 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2348/4931] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:01 2022] POST /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:02.148614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c887c6f-b87b-4a74-8889-2291d9d6f2fd", "tag": "274a4b54-51b0-4f79-b4f8-c18c50b982a8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:02.149522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:02.150380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:02.156944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.157781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.158449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.159387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.160687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.161381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.170636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.171140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.171590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.193131 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] Creating event network-changed:274a4b54-51b0-4f79-b4f8-c18c50b982a8 for instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd on nch2-master-1 Sep 03 21:11:02.210834 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ab156c94-cf3a-42b6-b66b-769f3c3f35d7 req-d563b8d9-2ba6-4bec-afe6-4bcedd1efa1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065793 Sep 03 21:11:02.211463 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2584/4932] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:02.411959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:02.432415 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4fad933a-0d0f-455f-bee0-5626b7ccf549 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1460 microversion: 2.1 time: 0.287348 Sep 03 21:11:02.433369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2349/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:02 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1460 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:02.459921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:02.461504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:02.477014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.478773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.479888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.480871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.482363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.483043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.754897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:02.766921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7d6839f-3bf7-426c-955a-7665c4f22438 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.312314 Sep 03 21:11:02.767836 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2585/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:02 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:02.799084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:02.799708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:02.802542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:02.808215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.809111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.809800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.810745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:02.811407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:02.812066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:02.918261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-706701899", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63485524-b841-48df-9f2a-17fe5709555c"}], "security_groups": [{"name": "tempest-securitygroup--825612979"}], "key_name": "tempest-keypair-2141963223", "user_data": "}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:03.152704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] validate_networks() for [('63485524-b841-48df-9f2a-17fe5709555c', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:11:03.257157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:03.266392 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-db91c888-f0ad-45db-97f3-6a74a97380c7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.471368 Sep 03 21:11:03.274105 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2350/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:02 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:03.278505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:03.279511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:03.288282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.289251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.289908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:03.290635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.291251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.291693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:03.634401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:03.643622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4143f14-c0ad-4f5f-b8e7-af3d2bca0155 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.374659 Sep 03 21:11:03.644221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2351/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:03 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:03.649726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:03.650606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:03.657624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.658635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.659399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:03.660135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.660599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.661080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:03.897446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:03.907084 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a5686ef-253e-4c46-8f81-1722a2853d3f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.260506 Sep 03 21:11:03.908037 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2352/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:03 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:03.935651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:03.936770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:03.945011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.945610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.946293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:03.947294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:03.948365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:03.949049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.150019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:11:04.151074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:11:04.151982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:11:04.152278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:11:04.153612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:11:04.166644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:04.170490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:04.171384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:04.172727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.173821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:04.178909 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b842c7a-2647-4f3d-a527-0949f05163c6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.249722 Sep 03 21:11:04.180189 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2353/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:03 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:04.210188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:04.210961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.245069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:11:04.258198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Getting quotas for user 3e79edf1a33e45ddac92ba8cd8429d9b and project 15985a3823b5409c8a18e31048f82ff7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:11:04.274971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:11:04.277480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:11:04.281923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc9eaca-b629-4481-9ad7-209f07da003c", "tag": "03794b01-96d5-45df-9cae-05c6153c885a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:04.297160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:04.300484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:04.301151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.324982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] Creating event network-changed:03794b01-96d5-45df-9cae-05c6153c885a for instance 6cc9eaca-b629-4481-9ad7-209f07da003c on nch2-master-1 Sep 03 21:11:04.337883 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0985d261-7a8b-44f6-8a04-1d43ef60cb7e req-90d09935-c5d6-4d5e-9842-eef505287cb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059591 Sep 03 21:11:04.340616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc334554-941e-4c57-b62d-e4316a50b2d7 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.426304 Sep 03 21:11:04.353737 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2354/4939] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:04.353737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-336739433", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b1cd1193-a10d-479f-9da3-5114ed491f2f"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:04.354566 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2586/4940] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:11:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:11:04.360916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ed20284-69b5-4631-8af6-f06a0a11c20c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:04.361760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ed20284-69b5-4631-8af6-f06a0a11c20c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:04.428515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ed20284-69b5-4631-8af6-f06a0a11c20c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:04.448209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] validate_networks() for [('b1cd1193-a10d-479f-9da3-5114ed491f2f', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:11:04.451005 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ed20284-69b5-4631-8af6-f06a0a11c20c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1241 microversion: 2.1 time: 0.095121 Sep 03 21:11:04.465532 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2587/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:04 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:04.668329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:04.669473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:04.681918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:04.682884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:04.683868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.686810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:04.689171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:04.690260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:04.882884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:05.031466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:05.045535 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8be39c70-2d37-4624-8b69-ba7875e316e8 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.381948 Sep 03 21:11:05.062185 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2588/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:04 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:05.481656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:05.482298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:05.488604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:05.489522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:05.490158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:05.491039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:05.491535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:05.491966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:05.518200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:11:05.518781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:11:05.519272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:11:05.519898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:11:05.520414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:11:05.530225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:05.530739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:05.531768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:05.532524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:05.533017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:05.533494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:05.550956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:11:05.556289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Getting quotas for user d485394bc49e4380b152d32d09440281 and project 8915b5da4f224da89e9699a7599350a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:11:05.569065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:11:05.569242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:05.571861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:11:05.577298 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-658a5075-d553-4a7a-8217-38cba746711c tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1293 microversion: 2.1 time: 0.100014 Sep 03 21:11:05.578954 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2589/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:05 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:05.622691 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1df346fd-1163-4768-a18d-3b989b1daad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277368 Sep 03 21:11:05.624444 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2355/4944] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:11:05.635753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1e48164-53ed-428d-be3a-b675b2aad3e1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:05.636056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1e48164-53ed-428d-be3a-b675b2aad3e1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:05.697767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d1e48164-53ed-428d-be3a-b675b2aad3e1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:05.706204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1e48164-53ed-428d-be3a-b675b2aad3e1 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1214 microversion: 2.1 time: 0.074749 Sep 03 21:11:05.707400 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2590/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:05 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:06.070907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:06.071566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:06.080431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.081209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.082139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.083069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.083715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.084336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.421421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:06.430098 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65efd306-a04d-45c4-a7ed-418af2cfc827 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.364346 Sep 03 21:11:06.430769 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2356/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:06 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:06.603382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:06.604619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:06.628330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.628850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.634982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.635751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.636239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.636746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.730469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:06.731100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:06.738255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.739152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.739767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.743005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:06.743800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:06.744440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:06.793863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:06.802636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-636f53b7-c602-4dca-94f1-75d010c9e2c9 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1299 microversion: 2.1 time: 0.204123 Sep 03 21:11:06.803696 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2591/4947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:06 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:06.832920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:06.835534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:06.844524 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e78b8a83-bfdd-405c-948f-cd1e84d55111 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1266 microversion: 2.1 time: 0.117734 Sep 03 21:11:06.845312 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2357/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:06 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:07.458417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:07.460099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:07.467127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.467942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.468726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.470428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.472579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.473725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.763603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:07.774187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4ac2c918-7d65-4bbc-a477-34febd7f89c5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.323864 Sep 03 21:11:07.789864 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2592/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:07 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:07.829394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:07.830631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:07.838367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.839124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.839824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.840765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.841494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.842158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.868809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:07.870058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:07.883688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.884925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.885760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.887032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:07.887889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:07.888572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:07.987977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:08.014857 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80153b36-21b5-4d7f-9df9-277882877caa tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1272 microversion: 2.1 time: 0.149858 Sep 03 21:11:08.033498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2593/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:07 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:08.291518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:08.303021 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4836595d-83e0-4b40-8767-ed2a356f898f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.479881 Sep 03 21:11:08.304291 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2358/4951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:07 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:08.799409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:08.800022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:08.817096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:08.818771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:08.821294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:08.822277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:08.825100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:08.825744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.052229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:09.053230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:09.061921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:09.062798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:09.063469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.064435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:09.065163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:09.066521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.136150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:09.160788 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c21b8d98-e904-4fec-a370-c7ec062e1957 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.365729 Sep 03 21:11:09.173832 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2594/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:08 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:09.341549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:09.347493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:09.368090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:09.369007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:09.369762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.370867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:09.371602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:09.372772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.514107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:09.523466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18b37aad-4d87-4086-bd41-f470648a1239 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.476951 Sep 03 21:11:09.524716 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2359/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:09 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:09.529621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21dbd3e-1f99-4e77-88d3-4a17eb88529b", "tag": "36554336-777c-4315-8829-c6aae0bdd35a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:09.544841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:09.545623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:09.546318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:09.560062 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] Creating event network-changed:36554336-777c-4315-8829-c6aae0bdd35a for instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b on nch1-master-1 Sep 03 21:11:09.566765 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c3398d62-4c50-43b4-808c-8570df488335 req-2ec1eacd-f87b-4a55-bc3c-e3ff72239b72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040498 Sep 03 21:11:09.567792 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2360/4954] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:09.733231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:09.750181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-772cc19c-4470-48e5-b2cd-e48aae2e9a48 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.427076 Sep 03 21:11:09.768685 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2595/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:09 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:10.188803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:10.189536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:10.213018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.213737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.214442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.215408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.215875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.216387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.549615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:10.549793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:10.550238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:10.557594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.558448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.559110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.560044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.560722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.561396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.564200 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e56b44d2-2951-49d2-bfa8-254b54784638 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.381783 Sep 03 21:11:10.578574 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2361/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:10 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:10.779249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:10.780219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:10.786751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.787590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.788534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.789847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:10.790529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:10.791173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:10.814287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:10.825708 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c4ea4098-91eb-4f18-bd1d-48726a6ea43c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.279889 Sep 03 21:11:10.826310 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2596/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:10 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:11.120150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:11.128457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc2e575e-5634-4155-a2dd-c265fe5b4f21 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.353369 Sep 03 21:11:11.129054 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2362/4958] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:10 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:11.586223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d6897f-93e4-48fc-abcc-f5dd15b21dea", "tag": "6c185131-a096-4044-82e2-9bce13787529"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:11.588552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:11.589271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:11.596264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.597158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.597601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:11.598007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.598311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.598795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.599159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.599278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:11.600008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:11.612540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] Creating event network-changed:6c185131-a096-4044-82e2-9bce13787529 for instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea on nch2-master-1 Sep 03 21:11:11.617725 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a4ba1b36-30be-4554-b338-8b05763b3873 req-9d10d3ff-c1d5-4250-b114-f1992ade29c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035255 Sep 03 21:11:11.618372 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2597/4959] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:11.782182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc9eaca-b629-4481-9ad7-209f07da003c", "name": "network-vif-plugged", "status": "completed", "tag": "03794b01-96d5-45df-9cae-05c6153c885a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:11.795084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.795783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.796237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:11.812562 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] Creating event network-vif-plugged:03794b01-96d5-45df-9cae-05c6153c885a for instance 6cc9eaca-b629-4481-9ad7-209f07da003c on nch2-master-1 Sep 03 21:11:11.817715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1cfa60d0-ccd3-4321-81b9-0e2c530d2b43 req-6ba7cf4e-e308-4942-9de1-65fed170272d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040642 Sep 03 21:11:11.818698 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2598/4960] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:11:11.845709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:11.853919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:11.855207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:11.856655 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04ff2e8e-ed69-4ac4-8ee5-4c84b7b11178 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.271797 Sep 03 21:11:11.872270 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2363/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:11 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:11.872490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:12.012072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:12.020217 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-051ce1a1-784a-43bd-b714-19ac6169a3e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.172900 Sep 03 21:11:12.020792 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2599/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:11 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:12.151989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:12.152610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:12.159404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:12.159913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:12.160362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:12.161109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:12.161754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:12.162188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:12.294889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:12.306175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbea4da6-e8bc-484f-906a-987153f2f97f tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.158032 Sep 03 21:11:12.306951 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2364/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:12 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:12.881490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:12.883076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:12.895255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:12.896098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:12.896621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:12.897598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:12.898276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:12.898714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:13.046217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:13.049114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:13.064481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:13.065609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:13.066276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:13.067543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:13.068692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:13.069879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:13.215801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:13.229689 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39dd2caa-eb23-4c9c-bbd6-30698cc9e359 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1375 microversion: 2.1 time: 0.352773 Sep 03 21:11:13.231437 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2600/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:12 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1375 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:13.333469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:13.338525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:13.353615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:13.356945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:13.357625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:13.358569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:13.362626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:13.363365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:13.388639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:13.398637 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c3aa43c-0d7e-4372-83d6-663160a24d8d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.357531 Sep 03 21:11:13.399802 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2365/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:13 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:14.042980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:14.051522 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f43889bc-0400-4cef-9a88-267ebc2fd848 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.725712 Sep 03 21:11:14.052213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2601/4966] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:13 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:14.256730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:14.257332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:14.264368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.264928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.267527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.270275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.270743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.271179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.421975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:14.423353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:14.424295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:14.429651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:14.431912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.432508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.433234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.434013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.434714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.435271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.443543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a27f96b7-55d3-45ba-ba3f-de6892f249cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1546 microversion: 2.1 time: 0.190785 Sep 03 21:11:14.448881 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2366/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:14 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:14.472508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:14.473434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:14.480654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.488798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.488798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.488798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:14.488798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:14.488798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:14.667947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:14.676863 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a28260d0-7c44-429e-858a-2855598e0a6d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.258480 Sep 03 21:11:14.677705 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2602/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:14 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:14.716408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:14.726432 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07864c5e-2be5-4c97-8533-135d355b64fc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1546 microversion: 2.1 time: 0.258176 Sep 03 21:11:14.727035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2367/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:14 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:15.037117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21dbd3e-1f99-4e77-88d3-4a17eb88529b", "name": "network-vif-plugged", "status": "completed", "tag": "36554336-777c-4315-8829-c6aae0bdd35a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:15.049125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:15.050358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:15.050808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:15.066771 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] Creating event network-vif-plugged:36554336-777c-4315-8829-c6aae0bdd35a for instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b on nch1-master-1 Sep 03 21:11:15.074427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-20cceee2-5afc-468a-86a9-1845e7155ff3 req-f20ee6a0-2a1f-4996-a537-8e63c678f323 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044749 Sep 03 21:11:15.075886 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2603/4970] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:15.077146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:15.078640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:15.086791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:15.087802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:15.088413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:15.089850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:15.090702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:15.095932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:15.354790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:15.370845 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c76f386-3b15-4ab7-a2da-c5c6aa323539 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.299352 Sep 03 21:11:15.374016 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2368/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:15 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:15.705918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:15.707089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:15.716017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=22 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:15.737592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:15.740590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:15.742521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:15.744555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:15.746301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:15.746995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:15.963276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:15.973157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:15.979703 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b2cf2f2b-a3d6-4e95-822a-025fd889c8be tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.282857 Sep 03 21:11:15.982283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2604/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:15 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:16.396794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:16.397435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:16.403552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:16.404960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:16.408882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:16.409831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:16.410443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:16.411367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:16.412031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:16.412620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:16.714491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:16.733745 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-433334d3-abb7-4e46-b078-04cadd53b8c0 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1366 microversion: 2.1 time: 0.340680 Sep 03 21:11:16.753814 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2369/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:16 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:17.018690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:17.025570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:17.036482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:17.049073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:17.050969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc9eaca-b629-4481-9ad7-209f07da003c", "tag": "03794b01-96d5-45df-9cae-05c6153c885a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:17.051387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:17.052975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:17.053488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:17.053961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:17.085494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:17.087156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:17.088200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:17.110289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] Creating event network-changed:03794b01-96d5-45df-9cae-05c6153c885a for instance 6cc9eaca-b629-4481-9ad7-209f07da003c on nch2-master-1 Sep 03 21:11:17.118872 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-acb9f050-e621-4a11-b6b4-4e0b42544adb req-e6700087-a42a-401e-a290-fa242a835cbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077536 Sep 03 21:11:17.120112 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2370/4974] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:17.352020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:17.364641 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5bb4751d-d938-4c88-b7a6-05e14e2467b5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.362140 Sep 03 21:11:17.378139 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2605/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:16 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:17.783876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:17.787628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:17.805248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:17.806128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:17.808086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:17.809105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:17.823534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:17.824270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:18.290303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:18.306431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1434d9b1-3c9f-4de0-85a8-f78b83c219a1 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1555 microversion: 2.1 time: 0.542462 Sep 03 21:11:18.307231 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2371/4976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:17 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1555 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:18.341613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:18.342915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:18.365409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:18.367820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:18.368286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:18.369053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:18.371158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:18.371870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:18.389361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:18.389887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:18.407494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:18.407990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:18.408646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:18.409569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:18.410193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:18.410784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:18.522151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2fc1137c-6cc9-4b2b-bd63-e4b2b58f3bd2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190866 Sep 03 21:11:18.522749 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2606/4977] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:11:18 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:18.982075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:19.003664 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e952bc9-7305-4fe7-b49e-637e264c3d94 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.610982 Sep 03 21:11:19.019591 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2372/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:18 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:19.162711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d6897f-93e4-48fc-abcc-f5dd15b21dea", "name": "network-vif-plugged", "status": "completed", "tag": "6c185131-a096-4044-82e2-9bce13787529"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:19.183829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:19.184581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:19.185478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:19.213294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] Creating event network-vif-plugged:6c185131-a096-4044-82e2-9bce13787529 for instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea on nch2-master-1 Sep 03 21:11:19.228223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0272cde7-45a8-4110-a5d1-ad4c0ab04bf4 req-7ccd6f30-435c-49e1-8294-6f4f06294292 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069289 Sep 03 21:11:19.230686 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2607/4979] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:20.034401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:20.035764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:20.049364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:20.050576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:20.054646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:20.055774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:20.056480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:20.057196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:20.285577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:20.296124 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-581dff5e-faba-4dfd-9026-4d332917c2c0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1314 microversion: 2.1 time: 0.268933 Sep 03 21:11:20.299077 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2373/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:20 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:20.556361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21dbd3e-1f99-4e77-88d3-4a17eb88529b", "tag": "36554336-777c-4315-8829-c6aae0bdd35a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:20.575175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:20.576214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:20.576866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:20.597956 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] Creating event network-changed:36554336-777c-4315-8829-c6aae0bdd35a for instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b on nch1-master-1 Sep 03 21:11:20.611912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9ce7d182-cd52-4ce8-b6a5-c05f857de029 req-225f7254-c475-42d1-a682-669094b11509 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060771 Sep 03 21:11:20.617461 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2608/4981] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:21.322943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:21.324190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:21.333101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.333857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.334313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:21.335203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.335859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.336457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:21.589502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:21.599560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4aeafdd5-d795-4117-9abb-29802145c3e6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1501 microversion: 2.1 time: 0.280699 Sep 03 21:11:21.611870 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2374/4982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:21 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:21.632544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:21.634291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:21.643158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.644323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.645539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:21.646552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.647258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.649019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:21.739178 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52abc0d2-24c5-4dfd-823d-a200a0fa5ed8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea/action" status: 202 len: 0 microversion: 2.1 time: 0.117674 Sep 03 21:11:21.740946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2609/4983] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:21 2022] POST /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:21.747830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:21.748516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:21.756521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.757311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.757944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:21.759381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:21.760096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:21.760848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:22.004179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:22.009112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:22.019385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e21e894-6067-4bca-b6dd-321459abd550 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1506 microversion: 2.1 time: 0.274927 Sep 03 21:11:22.020120 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2375/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:21 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:23.049124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:23.049844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:23.062706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.063477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.064236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.065643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.066559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.067229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.267644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:23.275694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f637f456-9ce1-49fd-a87d-be839455300e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1486 microversion: 2.1 time: 0.233407 Sep 03 21:11:23.276968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2610/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:23 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1486 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:23.301823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:23.302412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:23.312490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.313117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.313784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.314560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.315056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.315534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.342108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lazy-loading 'flavor' on Instance uuid 21d6897f-93e4-48fc-abcc-f5dd15b21dea {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:11:23.547982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d63d3fd9-ec22-44f9-ba31-eff534d5eea5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea/action" status: 202 len: 0 microversion: 2.1 time: 0.249917 Sep 03 21:11:23.548735 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2376/4986] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:23 2022] POST /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:11:23.557167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:23.557798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:23.570890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.571393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.571849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.572578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:23.573075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:23.573516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:23.798340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:23.806137 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-377ab23c-0d5a-47c0-bfe5-58320704233c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1492 microversion: 2.1 time: 0.253111 Sep 03 21:11:23.806713 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2611/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:23 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:24.831821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:24.832560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:24.840302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:24.841064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:24.841513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:24.842411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:24.842872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:24.844148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:24.996794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:25.006935 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c3d4a7fa-bf52-4b9d-ad43-b4829ad572d8 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1513 microversion: 2.1 time: 0.180507 Sep 03 21:11:25.007746 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2377/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:24 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:26.032097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:26.032656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:26.054941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:26.055458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:26.055908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:26.056673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:26.057175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:26.057617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:26.247412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:26.262227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-28851449-c49d-4b54-92db-1e2665bf8ad0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1513 microversion: 2.1 time: 0.234478 Sep 03 21:11:26.263436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2612/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:26 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:26.308189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d6897f-93e4-48fc-abcc-f5dd15b21dea", "name": "network-vif-plugged", "status": "completed", "tag": "6c185131-a096-4044-82e2-9bce13787529"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:26.319187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:26.319714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:26.320185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:26.334818 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] Creating event network-vif-plugged:6c185131-a096-4044-82e2-9bce13787529 for instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea on nch2-master-1 Sep 03 21:11:26.341087 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1798cdad-a1f0-4105-ab3e-08f8ec2b082a req-144c69c6-0862-41f5-a35a-4f1cf0d1bc88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036572 Sep 03 21:11:26.342119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2378/4990] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:27.289119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:27.289741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:27.299510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:27.300293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:27.300921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:27.301816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:27.302436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:27.303022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:27.494263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:27.503711 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd0c92e7-c5a7-434d-8e66-76bb4443ed01 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.218615 Sep 03 21:11:27.504309 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2613/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:27 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:28.529294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:28.530154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:28.538402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:28.539266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:28.539864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:28.540738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:28.541394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:28.542335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:28.814601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:28.839627 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0fdce5c3-e447-41a0-a169-59334f180081 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.315575 Sep 03 21:11:28.840939 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2379/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:28 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:29.865420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:29.866202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:29.873775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:29.874636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:29.875324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:29.876310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:29.877055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:29.877717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:30.134505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:30.145272 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a47cfb75-3886-485c-882c-2a4738bcff44 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.284387 Sep 03 21:11:30.157037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2614/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:29 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:31.171645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:31.172939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:31.188003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:31.188828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:31.189472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:31.190390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:31.191021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:31.191631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:31.433762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:31.447943 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-411c7af1-108a-460f-bdea-c786a00a714e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.279820 Sep 03 21:11:31.467871 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2380/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:31 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:32.476126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:32.477036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:32.481120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:32.485063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:32.485894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:32.486508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:32.487399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:32.487869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:32.488309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:32.731283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:32.743652 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fda6fe65-6b76-4bb3-984f-28e8a0d0a41f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.274542 Sep 03 21:11:32.772239 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2615/4995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:32 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:33.767788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:33.768489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:33.771435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:33.777390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:33.778119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:33.778768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:33.779755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:33.780232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:33.781776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:33.960285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:33.968125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c591348-a545-4c34-a31f-4cda40b1e00b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.204351 Sep 03 21:11:33.969801 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2381/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:33 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:34.993299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:34.996431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:35.004389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:35.005491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:35.006248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:35.007186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:35.007937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:35.008694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:35.219382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:35.227936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36cc740f-f08e-43fa-b1d6-032370158d1f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.239241 Sep 03 21:11:35.242040 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2616/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:34 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:36.252339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:36.253879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:36.260455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:36.262833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:36.264487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:36.267146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:36.268595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:36.269327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:36.849484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:36.858076 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-897c30c0-d821-441f-93dc-2cfdaa54997b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.610325 Sep 03 21:11:36.861580 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2382/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:36 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:37.883839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:37.884467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:37.891572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:37.892065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:37.892547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:37.893307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:37.893773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:37.894211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:38.063094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:38.072053 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9682c39-c72c-432e-8ed3-ddc5851265ea tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1505 microversion: 2.1 time: 0.192171 Sep 03 21:11:38.072655 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2617/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:37 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:39.095587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:39.096120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:39.103459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:39.103960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:39.104408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:39.105143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:39.105608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:39.106045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:39.249736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:39.258537 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb43846f-afd5-4d33-98d1-8a40a60e802d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1505 microversion: 2.1 time: 0.167338 Sep 03 21:11:39.272199 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2383/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:39 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:40.212274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d6897f-93e4-48fc-abcc-f5dd15b21dea", "name": "network-vif-unplugged", "status": "completed", "tag": "6c185131-a096-4044-82e2-9bce13787529"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:40.227986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.228785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.229517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.260883 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] Creating event network-vif-unplugged:6c185131-a096-4044-82e2-9bce13787529 for instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea on nch2-master-1 Sep 03 21:11:40.268504 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-82c43c35-a82f-4a9b-b44a-f91d31c67a08 req-63b1da3c-cc04-4ad7-81ed-832d21e1e182 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058761 Sep 03 21:11:40.273065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2618/5001] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:40.289346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:40.290720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:40.301449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.302737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.303348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.304317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.304667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.305630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.453844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:40.461875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e84a533e-22bc-4c93-902f-bf5514035059 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 200 len: 1508 microversion: 2.1 time: 0.183042 Sep 03 21:11:40.462448 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2384/5002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:40 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:40.486231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:40.486933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.496283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.649648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:40.663068 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7b591e2a-494e-4164-b30d-6e773b008859 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.181499 Sep 03 21:11:40.665362 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2619/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:40.700718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:40.703142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:40.720658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.722751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.723219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.723966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.724426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.724852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.890400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:40.898462 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d67c62ab-3f46-4039-bff3-9c7d94ee57cf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.208368 Sep 03 21:11:40.899066 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2385/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:40.921106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:40.921759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:40.928041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.928532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.929007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:40.929716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:40.930178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:40.930616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.071834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:41.080119 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6828baf5-e72d-40c1-886a-19cd1422518c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.162910 Sep 03 21:11:41.080694 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2620/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:40 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:41.102629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:41.103244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:41.109731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.110217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.110655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.111359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.111807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.112233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.248776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:41.258394 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ead4f62-8cd6-4a52-b3d8-6a5318dd160d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.159750 Sep 03 21:11:41.258910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2386/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:41 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:41.281215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:41.288179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.288678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.289252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.313931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:11:41.348173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:41.366352 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3100585f-e6fb-4762-bc0c-7ffe81cd9467 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.088757 Sep 03 21:11:41.367583 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2621/5007] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:41 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:41.377184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:41.378437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:41.386090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.386876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.387247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.388092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.388700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.389115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.531959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:41.541339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07f719ce-2ae6-4a86-82db-9fb33c63670a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.169839 Sep 03 21:11:41.542287 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2387/5008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:41 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:41.830377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:41.833666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:41.840421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.840927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.841617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.842328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:41.842790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:41.843223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:41.899529 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-119fd868-a6df-453c-a4ce-8073b0daaa98 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c/action" status: 200 len: 24569 microversion: 2.1 time: 0.074513 Sep 03 21:11:41.900181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2622/5009] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:41 2022] POST /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:11:42.567931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:42.568546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:42.575956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:42.576482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:42.577151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:42.577887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:42.578343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:42.578770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:42.724925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:42.733392 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-629db336-014c-4356-b702-19572feebaa3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.169517 Sep 03 21:11:42.734526 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2388/5010] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:42 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:43.757949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:43.759414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:43.766924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:43.767677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:43.768340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:43.769401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:43.770059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:43.770687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:43.907079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:43.915174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5cfb73bb-fbf2-4c73-9264-d974a34fcddc tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.161636 Sep 03 21:11:43.915816 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2623/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:43 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:44.939537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:44.940153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:44.947006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:44.947632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:44.947933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:44.948623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:44.949106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:44.949537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:45.083410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:45.091366 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4b26b509-260a-49c4-b419-05e21b8004d2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.155765 Sep 03 21:11:45.092011 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2389/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:44 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:46.115833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:46.116457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:46.125072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:46.125577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:46.126026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:46.126943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:46.127404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:46.127843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:46.270871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:46.278871 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b266011-85c6-479c-9b90-8d8c33f7f654 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.167214 Sep 03 21:11:46.279447 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2624/5013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:46 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:47.302654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:47.303274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:47.313300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:47.313796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:47.314243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:47.314948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:47.315407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:47.315838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:47.447050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:47.455359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-967ec702-1b9e-41b2-a586-d729ea64b809 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.156605 Sep 03 21:11:47.455938 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2390/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:47 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:48.480798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:48.481534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:48.489171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:48.489667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:48.490270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:48.490990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:48.491447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:48.491888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:48.668244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:48.677886 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63674f4c-0e34-4e99-be06-ffa35adffb66 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.201636 Sep 03 21:11:48.683101 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2625/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:48 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:49.701879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:49.702598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:49.710426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:49.711056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:49.711570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:49.712366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:49.712957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:49.713458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:49.716795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:49.859595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:49.867506 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d34e6106-b856-4611-8515-28e3cd6f01d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.169782 Sep 03 21:11:49.868013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2391/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:49 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:50.890838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:50.891666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:50.899177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:50.899762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:50.900279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:50.901122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:50.901771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:50.902211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:51.033688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:51.042508 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-580d1164-43ae-4a9b-a423-7f506cdf930c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1680 microversion: 2.1 time: 0.156182 Sep 03 21:11:51.043291 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2626/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:50 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:52.066397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:52.067023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:52.074081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:52.074578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:52.075025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:52.075747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:52.076227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:52.076663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:52.213038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:52.221652 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c45153c9-c4e1-4b04-969b-793152657835 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1657 microversion: 2.1 time: 0.159225 Sep 03 21:11:52.222236 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2392/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:52 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:52.245402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:52.252778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:52.253354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:52.253810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:52.277421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Going to try to start instance {{(pid=140520) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 21:11:52.321611 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-16f2847c-d5f2-434d-b903-627b4a223e70 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.080518 Sep 03 21:11:52.322653 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2627/5019] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:52 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:52.331309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:52.331929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:52.338859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:52.339049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:52.339369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:52.340071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:52.340525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:52.341384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:52.502988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:52.511980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-776c937e-1bfc-45ab-86fc-fd905daac73c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1666 microversion: 2.1 time: 0.184603 Sep 03 21:11:52.516977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2393/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:52 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1666 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:53.537153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:53.537807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:53.545567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:53.546146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:53.546632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:53.547385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:53.547897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:53.548339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:53.702932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:53.711531 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-31e14b02-0046-4f36-bb82-158dc31a7b26 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1666 microversion: 2.1 time: 0.178457 Sep 03 21:11:53.712576 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2628/5021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:53 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1666 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:53.729181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:53.730272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:53.737244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:53.737845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:53.738196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:53.739002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:53.739766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:53.740045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:53.774473 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11a350e5-7de2-40f9-b724-a7d65d58374e tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42/ips" status: 200 len: 152 microversion: 2.20 time: 0.049512 Sep 03 21:11:53.775389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2394/5022] 10.222.0.16 () {60 vars in 1289 bytes} [Sat Sep 3 21:11:53 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:11:54.737654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:54.738308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:54.746139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:54.746816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:54.747270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:54.747995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:54.748462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:54.748941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:54.885090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:54.893649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2a1a2cce-f699-4c75-94b7-86f0ecd46f04 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.160800 Sep 03 21:11:54.894221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2629/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:54 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:54.916996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:54.917641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:54.924649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:54.925181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:54.925633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:54.928299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:54.928792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:54.929281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.066385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.074340 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dcbe783-1039-4661-a1d8-bc8091e43380 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.161658 Sep 03 21:11:55.074950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2395/5024] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:54 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:55.099912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.102444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.108461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.109015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.109467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.110220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.110690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.111129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.170739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.171032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.179086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.179669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.180365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.181279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.182190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.182870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.210276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:11:55.259339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.268109 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7128d6d-472d-4f80-a589-8ee5e051e686 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.172809 Sep 03 21:11:55.268689 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2630/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:55.291961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.292597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.298795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.299516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.310322 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d6652d1-c09e-4a8e-9fb3-9df8c9217ded tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 204 len: 0 microversion: 2.20 time: 0.143860 Sep 03 21:11:55.311052 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2396/5026] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:11:55 2022] DELETE /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 21:11:55.312679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.315303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.316221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.316947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.333254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.334557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.341422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.341921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.342359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.343171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.344081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.344521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.502216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.511538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.516649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.518219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.519511 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-614592c4-e44b-4c37-8ecb-a22481e99a52 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1724 microversion: 2.20 time: 0.190510 Sep 03 21:11:55.520001 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-998bc744-96ab-4d45-bb95-3e24c0757229 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.232292 Sep 03 21:11:55.520301 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2397/5027] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:11:55 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:11:55.520963 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2631/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:55.542724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.543420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.550064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.550621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.551131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.551897 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.552421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.552960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.714966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:55.723720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f81ee967-0f95-417c-bfd7-b4116fd59131 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.184658 Sep 03 21:11:55.724307 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2398/5029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:55.746839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:55.747580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.755637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.756265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.756717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.757624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.758094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.758531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.784586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lazy-loading 'flavor' on Instance uuid 4b25f89a-4721-4b18-838b-0ab9b15212d7 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:11:55.863228 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dc7bc33a-cb87-44da-b256-780ff34a8282 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.120698 Sep 03 21:11:55.863803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2632/5030] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:55 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:55.871902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:55.872613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:55.878891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.879461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.879997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:55.880771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:55.881328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:55.881858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:56.036008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:56.048096 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6fb9c28-923a-4db8-afc3-be4a2e0a6ff4 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1678 microversion: 2.1 time: 0.180048 Sep 03 21:11:56.062674 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2399/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:55 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:56.547606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:56.548629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:56.563066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:56.563581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:56.564031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:56.564765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:56.565260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:56.565705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:56.744800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:56.764460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:56.766293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:56.767677 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-60c4e554-85a3-4067-a9b8-9dbfd96831aa tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1724 microversion: 2.20 time: 0.225535 Sep 03 21:11:56.782339 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2633/5032] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:11:56 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:11:57.078618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:57.079863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:57.086724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:57.087621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:57.088242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:57.089800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:57.090437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:57.091040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:57.261464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4cea479-ab9a-4103-90ae-04dff41d3964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: .version_select at 0x7fae670e8160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1646815947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJR4ImLtDTFRVo3kuLci3GgU1CH94JFCJRqqRKR02rDKRUOVLz66S7MmoL9+KvraKVCzXkRF03hJws7LHEF3WZNsMx9JC2/ca6qObAexej7iAacGgGNUi20rjTJegTLTw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:57.289826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:57.290337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f4cea479-ab9a-4103-90ae-04dff41d3964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:11:57.299474 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24ef8c86-1caa-4791-b672-fa7315f17414 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1678 microversion: 2.1 time: 0.229176 Sep 03 21:11:57.300496 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2400/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:57 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:57.303370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f4cea479-ab9a-4103-90ae-04dff41d3964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:11:57.344109 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4cea479-ab9a-4103-90ae-04dff41d3964 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.087098 Sep 03 21:11:57.348203 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2634/5034] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:11:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:57.798608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:57.799495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:57.809919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:57.810849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:57.812208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:57.814887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:57.815604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:57.816233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.032790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:58.044151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:58.046216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:58.047725 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60dc1f47-8e7f-47aa-8a89-cd3affc7080d tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1724 microversion: 2.20 time: 0.255951 Sep 03 21:11:58.048321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2401/5035] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:11:57 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:11:58.324440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:58.328638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:58.378481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:58.379005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:58.379461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.381590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:58.382158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:58.382696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.756663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8dab1-c7d2-4116-9957-e60d8fe37c42", "name": "network-vif-deleted", "tag": "c4905fc7-1bd3-4374-9419-1ddad8b26dd2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:58.789561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:58.806846 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aa63f62f-422b-401d-b1b3-ccacf39b7e59 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1661 microversion: 2.1 time: 0.487035 Sep 03 21:11:58.807381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:58.808139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:58.808490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.809759 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2635/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:58 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1661 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:11:58.839160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:58.840615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:58.849121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:58.849903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:58.850817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.852148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:58.852840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:58.854189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:58.860389 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] Creating event network-vif-deleted:c4905fc7-1bd3-4374-9419-1ddad8b26dd2 for instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 on nch1-master-1 Sep 03 21:11:58.874824 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c049eed8-7bf3-46dc-837c-85e3731dfa76 req-118763db-b867-4976-91cf-68178b1e85b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128222 Sep 03 21:11:58.875440 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2402/5037] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:11:58.919457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:58.990105 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42231161-a71e-49d2-a4a7-371d1b7924a2 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action" status: 202 len: 0 microversion: 2.1 time: 0.159802 Sep 03 21:11:58.991065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2636/5038] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:11:58 2022] POST /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:11:59.013302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:59.015946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:59.030463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:59.030971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:59.031424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:59.032139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:59.048061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:59.048671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:59.105564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:11:59.112541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:11:59.159225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:59.159763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:59.160206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:59.160959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:59.161426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:59.161859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:59.249358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:11:59.250185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:11:59.251077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:11:59.251867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lazy-loading 'fault' on Instance uuid 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:11:59.362462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:59.382329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:59.385798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38dddfbdc4f0450e8d5fc7b214796758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4fe674ef004caf8df73b8b06f7dd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:59.392764 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ba9db1e-57bd-47b1-bfa3-cfed808f7565 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 200 len: 1372 microversion: 2.20 time: 0.318785 Sep 03 21:11:59.396685 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2637/5039] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:11:59 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 21:11:59.502616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1951123166", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "d1881191-35bc-41b5-a663-861a5b324e1a"}], "key_name": "tempest-TestNetworkBasicOps-1646815947", "security_groups": [{"name": "tempest-secgroup-smoke-460771270"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:11:59.570727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:11:59.584781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-80beb48e-37c6-4d50-8050-b687cee98e83 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1667 microversion: 2.1 time: 0.589031 Sep 03 21:11:59.587538 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2403/5040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:11:58 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1667 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:11:59.761726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] validate_networks() for [('d1881191-35bc-41b5-a663-861a5b324e1a', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:12:00.423474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:00.424215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:00.434343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.435283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.440207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.441560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.442332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.443419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.464417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 HTTP/1.1 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6bd8dab1-c7d2-4116-9957-e60d8fe37c42'} Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:00.466205 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd340710-82ef-4359-a277-76929ce33dd1 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 404 len: 111 microversion: 2.20 time: 0.048841 Sep 03 21:12:00.473039 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2404/5041] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:12:00 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:12:00.477722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbbb24c3-ec05-4649-8337-2c8cfc30593f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '.version_select at 0x7fae6b8abee0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:00.497484 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbbb24c3-ec05-4649-8337-2c8cfc30593f tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820476872" status: 204 len: 0 microversion: 2.20 time: 0.023917 Sep 03 21:12:00.498297 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2405/5042] 10.222.0.16 () {60 vars in 1262 bytes} [Sat Sep 3 21:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820476872 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:12:00.532383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:12:00.533542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:12:00.533700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:12:00.534366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:12:00.534882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:12:00.545294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.546069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.546625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.547472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.548028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.548732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.568468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:12:00.574075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:12:00.589403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:12:00.593273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:12:00.611306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:00.612051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:00.620198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.621929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.622394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.623123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:00.624454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:00.625114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:00.657421 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-86b2ce46-e40b-4f9d-af66-0dd11445856a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.160564 Sep 03 21:12:00.658639 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2638/5043] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:11:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:12:00.687773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61921f59-208f-4c85-a0dd-0b8099ec1edb tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:00.689691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61921f59-208f-4c85-a0dd-0b8099ec1edb tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:00.803881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-61921f59-208f-4c85-a0dd-0b8099ec1edb tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:00.814309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61921f59-208f-4c85-a0dd-0b8099ec1edb tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1249 microversion: 2.1 time: 0.136847 Sep 03 21:12:00.814893 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2639/5044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:00 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:00.930176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:00.939529 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9ee714dc-effe-4c77-9950-75c6f1f6bd2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1667 microversion: 2.1 time: 0.332430 Sep 03 21:12:00.943695 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2406/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:00 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1667 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:01.825503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:01.826016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:01.836666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.837411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.838990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.839422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:01.840421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:01.840776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.841435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.842088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.850533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.851047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.851498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.852785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.853189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.853619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.861808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 HTTP/1.1 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6bd8dab1-c7d2-4116-9957-e60d8fe37c42'} Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:01.865353 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.870644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.872622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:01.873875 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-896910e7-4be1-4ee0-9adf-b8b2e68f9768 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 404 len: 111 microversion: 2.20 time: 0.052210 Sep 03 21:12:01.874615 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2640/5046] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:12:01 2022] DELETE /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:12:01.886173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:01.887068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: 6bd8dab1-c7d2-4116-9957-e60d8fe37c42] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:01.894504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.895002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.895448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.896275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.896836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.897339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.917898 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 HTTP/1.1 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6bd8dab1-c7d2-4116-9957-e60d8fe37c42'} Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.920577 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance 6bd8dab1-c7d2-4116-9957-e60d8fe37c42 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1a7459cd-7e12-46e8-bb9d-47a48ce91d60 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42" status: 404 len: 111 microversion: 2.20 time: 0.043682 Sep 03 21:12:01.925937 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2641/5047] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:12:01 2022] GET /compute/v2.1/servers/6bd8dab1-c7d2-4116-9957-e60d8fe37c42 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:12:01.931164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:01.940923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c33e90f-c0a3-47d6-93e1-eac0a054a0f6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1301 microversion: 2.1 time: 0.105977 Sep 03 21:12:01.942184 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2407/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:01 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:01.967364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:01.968597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:01.978873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.979580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.980038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:01.982184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:01.983174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:01.984552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.161270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:02.161777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:02.170794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.171299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.171748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.172469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.172948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.173390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.202878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec HTTP/1.1 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c99d5fa7-a10a-4e96-ba20-12e0676af0ec'} Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:02.205588 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.211222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.212358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:02.213529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:02.214398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-da047c29-c6d4-4582-8058-9f4e67d598d9 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 404 len: 111 microversion: 2.20 time: 0.057175 Sep 03 21:12:02.217572 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19ecfd9d-dbf0-4b0a-8ce8-ce1a6b3c81f6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.257484 Sep 03 21:12:02.218204 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2408/5049] 10.222.0.16 () {60 vars in 1280 bytes} [Sat Sep 3 21:12:02 2022] DELETE /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:12:02.220008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2642/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:01 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:02.223055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:02.223847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] [instance: c99d5fa7-a10a-4e96-ba20-12e0676af0ec] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:02.230594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.233559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.233559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.233559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.233559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.233559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.241865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:02.242484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:02.248066 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] HTTP exception thrown: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.249538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.250043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.250488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.251459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.251938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.252375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Request method failure captured: Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec HTTP/1.1 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8KGqTVbK6DVdFkznHQCs83k6X8cDiU1UPVJMZ38Xnz0XYHoZINsSBzxj99O1l46qTRcYw2LDw_VykNTOPPwslbRooYS5AzZSwQRFSVx_7umMhLjiZG8nTxw26i7amVDQHXv-6fo7a9b5hKzGBpm1mEsUWIG3gYJ4RCP20CDp-8G938 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0f4fe674ef004caf8df73b8b06f7dd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 0f4fe674ef004caf8df73b8b06f7dd23 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1579334333 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 38dddfbdc4f0450e8d5fc7b214796758 Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1579334333-project Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c99d5fa7-a10a-4e96-ba20-12e0676af0ec'} Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.254166 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. Sep 03 21:12:02.258673 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:02.260205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] Returning 404 to user: Instance c99d5fa7-a10a-4e96-ba20-12e0676af0ec could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:02.261268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-174a2fa3-baad-4e11-827c-6a18f6d3eb09 tempest-AttachVolumeShelveTestJSON-1579334333 tempest-AttachVolumeShelveTestJSON-1579334333-project] 10.222.0.16 "GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec" status: 404 len: 111 microversion: 2.20 time: 0.042061 Sep 03 21:12:02.266128 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2409/5051] 10.222.0.16 () {60 vars in 1277 bytes} [Sat Sep 3 21:12:02 2022] GET /compute/v2.1/servers/c99d5fa7-a10a-4e96-ba20-12e0676af0ec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:12:02.509491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:02.520314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8798a1b-aa82-4ad6-9235-38ee951969e3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1670 microversion: 2.1 time: 0.282080 Sep 03 21:12:02.521224 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2643/5052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:02 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:02.544815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:02.546074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:02.553458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.554213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.554756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.555933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:02.556337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:02.557123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:02.563195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:02.590094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:02.596804 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Working on deleting snapshot 8b09aed2-9b58-4e71-a461-d39d3d91cc05 from shelved instance... Sep 03 21:12:02.980446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:02.981367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:02.990053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:02.996726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:03.000991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:03.004461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:03.005577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:03.006840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:03.009144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:03.372566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:03.384504 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-caa1bcf7-752d-45e5-be76-6b67304bd6ac tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.409813 Sep 03 21:12:03.385444 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2644/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:02 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:03.707901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Doing local delete in cell 38d2e9dc-0987-488d-b3fa-dcbf4105c477(cell1) {{(pid=140519) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 03 21:12:03.709296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:03.709808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:03.710278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:03.710781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 03 21:12:03.715930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] deallocate_for_instance() {{(pid=140519) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 03 21:12:04.126219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b1236a-38d7-4be3-bfda-bca4a8bca762", "tag": "aaa9084f-4382-4f8b-bf94-540fb06950d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:04.147796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:04.148457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:04.149008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:04.172628 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] Creating event network-changed:aaa9084f-4382-4f8b-bf94-540fb06950d5 for instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 on nch2-master-1 Sep 03 21:12:04.183187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-89e30625-1ee2-44cc-836e-5ce01984e0dc req-e1fbba29-be68-4078-8a63-e3c6718a4d3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062293 Sep 03 21:12:04.184330 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2645/5054] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:12:04.413566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:04.414452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:04.421658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:04.422172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:04.422600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:04.423372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:04.423782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:04.424350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:04.872637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Updating instance_info_cache with network_info: [] {{(pid=140519) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 03 21:12:05.225118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:05.234976 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09da70f0-ebd6-486f-b786-40a4077b5e12 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.825758 Sep 03 21:12:05.239076 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2646/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:04 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:05.384523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:05.489926 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3a5ec26f-d903-4b22-b55c-50c8472c0f6e tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 204 len: 0 microversion: 2.1 time: 2.948225 Sep 03 21:12:05.490625 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2410/5056] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:02 2022] DELETE /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 0 bytes in 2950 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:05.502556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:05.503316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 21d6897f-93e4-48fc-abcc-f5dd15b21dea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:05.512504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.513288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.514815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.516076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.516784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.517493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.535860 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea HTTP/1.1 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '21d6897f-93e4-48fc-abcc-f5dd15b21dea'} Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:05.544424 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 404 to user: Instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d82c712c-ede0-4ecd-a31f-1bd33ef63693 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea" status: 404 len: 111 microversion: 2.1 time: 0.050627 Sep 03 21:12:05.548936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2647/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:05 2022] GET /compute/v2.1/servers/21d6897f-93e4-48fc-abcc-f5dd15b21dea => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:05.555065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:05.555727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:05.562300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.562886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.563372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.564221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.564821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.565289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.595215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:05.688672 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-39473523-9a19-4976-85fc-a43b438863fd tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 204 len: 0 microversion: 2.1 time: 0.137345 Sep 03 21:12:05.689669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2411/5058] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:05 2022] DELETE /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:05.699893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:05.700656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:05.708478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.709385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.709974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.710884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:05.711355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:05.711801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:05.839792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:05.850959 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1eefa358-4145-401c-ba46-ad79214cc4d3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1466 microversion: 2.1 time: 0.156661 Sep 03 21:12:05.852828 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2648/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:05 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:06.223646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d6897f-93e4-48fc-abcc-f5dd15b21dea", "name": "network-vif-deleted", "tag": "6c185131-a096-4044-82e2-9bce13787529"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:06.235075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:06.235719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:06.236262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:06.252577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_external_events [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] Unable to find a host for instance 21d6897f-93e4-48fc-abcc-f5dd15b21dea. Dropping event network-vif-deleted {{(pid=140519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 21:12:06.254087 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-cc955b28-5a1e-46c2-a430-bb7a34ee95be req-bff99d58-1ec6-44fb-a17e-c5072fcfd077 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.037095 Sep 03 21:12:06.255278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2412/5060] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 03 21:12:06.263709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:06.265116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:06.272799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:06.273612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:06.280577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:06.281798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:06.282288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:06.282729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:06.449767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:06.461837 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3cf5b296-0860-488c-be7b-59d65b5ac1f4 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.202072 Sep 03 21:12:06.476985 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2649/5061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:06 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:06.879352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:06.879352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:06.895017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:06.895777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:06.896455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:06.897390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:06.898030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:06.898802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:07.123214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:07.143478 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-264b1ec8-3132-4960-985a-1bf926e69f65 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1466 microversion: 2.1 time: 0.272132 Sep 03 21:12:07.144475 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2413/5062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:06 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1466 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:07.489286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:07.490717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:07.503355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:07.504518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:07.505878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:07.506632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:07.508054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:07.508811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:07.724656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:07.742511 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b38a16ea-2652-4c7f-a12a-044cee599d55 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.253665 Sep 03 21:12:07.743599 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2650/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:07 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:08.182820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:08.185052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:08.198808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.200200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.201494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.203377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.204173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.204847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.245206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.245710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.246158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.246921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lazy-loading 'fault' on Instance uuid 1c887c6f-b87b-4a74-8889-2291d9d6f2fd {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:12:08.313418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:08.313685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c887c6f-b87b-4a74-8889-2291d9d6f2fd", "name": "network-vif-deleted", "tag": "274a4b54-51b0-4f79-b4f8-c18c50b982a8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:08.323337 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ef2737ec-77c4-4c34-bbfa-84e0e3a74d2a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 200 len: 1305 microversion: 2.1 time: 0.158204 Sep 03 21:12:08.323939 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2414/5064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:08 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:08.336551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.338552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.339308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.369203 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] Creating event network-vif-deleted:274a4b54-51b0-4f79-b4f8-c18c50b982a8 for instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd on nch2-master-1 Sep 03 21:12:08.378932 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e5e6dac1-36ce-4343-aa2c-9324c2a21d81 req-73bca90f-dd31-4e54-b5cf-2d7a3d42cfb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069444 Sep 03 21:12:08.380140 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2651/5065] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:08.768616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:08.769486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:08.778535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.779045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.779487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.780704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:08.781808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:08.782499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:08.984391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:08.993363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0bc98a0a-e281-4a41-8d4e-e0f1d31e0922 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.228982 Sep 03 21:12:08.997765 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2415/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:08 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:09.348145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:09.349607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 1c887c6f-b87b-4a74-8889-2291d9d6f2fd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:09.359524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.360533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.361095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.362028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.363325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.363999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.389686 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd HTTP/1.1 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1c887c6f-b87b-4a74-8889-2291d9d6f2fd'} Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:09.391405 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 404 to user: Instance 1c887c6f-b87b-4a74-8889-2291d9d6f2fd could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:09.397473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c77dcaa1-eec6-4fc2-9932-433fb3c1069c tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd" status: 404 len: 111 microversion: 2.1 time: 0.049193 Sep 03 21:12:09.401601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:09.402119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:09.407428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2652/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:09 2022] GET /compute/v2.1/servers/1c887c6f-b87b-4a74-8889-2291d9d6f2fd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:09.419002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.419516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.419964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.420723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.421232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.421666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.473885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:09.571895 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bdbbca08-a5dc-4496-afbb-c2258f2d4e23 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 204 len: 0 microversion: 2.1 time: 0.173465 Sep 03 21:12:09.572619 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2416/5068] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:09 2022] DELETE /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:09.587171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:09.588190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:09.596575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.597328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.598317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.599768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:09.600936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:09.602108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:09.808543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:09.820780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-efa84eda-237c-4856-9267-f83cbbd8c8c5 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1507 microversion: 2.1 time: 0.243444 Sep 03 21:12:09.833239 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2653/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:09 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:10.020343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:10.021379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:10.030851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:10.031465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:10.032244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:10.033276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:10.034304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:10.035676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:10.059400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:10.222542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:10.231441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a543bb24-69a1-4131-afc7-bb7baeb5c624 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.215305 Sep 03 21:12:10.231991 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2417/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:10 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:10.457083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b1236a-38d7-4be3-bfda-bca4a8bca762", "name": "network-vif-plugged", "status": "completed", "tag": "aaa9084f-4382-4f8b-bf94-540fb06950d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:10.477669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:10.477849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:10.478257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:10.509148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] Creating event network-vif-plugged:aaa9084f-4382-4f8b-bf94-540fb06950d5 for instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 on nch2-master-1 Sep 03 21:12:10.516968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-48233eb8-96bb-473f-9ce7-b6e240404743 req-3c94a591-2a42-4dd9-8763-344b4a6f6504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063230 Sep 03 21:12:10.518295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2654/5071] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:10.846630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:10.847779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:10.855362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:10.856049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:10.856885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:10.858447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:10.859195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:10.859642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:11.018722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:11.027457 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bb4b2ac6-bfc2-403b-ab92-60d6e37a0c4f tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1507 microversion: 2.1 time: 0.184818 Sep 03 21:12:11.028326 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2418/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:10 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:11.373423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:11.374280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:11.377111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:11.378674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:11.386426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:11.386935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:11.387304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:11.388583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:11.389081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:11.390281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:11.550011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6", "name": "network-vif-deleted", "tag": "2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:11.564340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:11.565503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:11.566563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:11.583216 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] Creating event network-vif-deleted:2bc559a5-4ab6-4f5a-8f65-e2e6c55d607c for instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 on nch2-master-1 Sep 03 21:12:11.591550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-046349bc-d425-4409-b6a9-5d6f6d1b3c64 req-26bec181-b43a-4716-b083-3ddb01ad3acb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044726 Sep 03 21:12:11.593469 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2419/5073] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:11.747335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:11.765884 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f516d678-d28e-4b55-b1e9-294a82020310 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1374 microversion: 2.1 time: 0.396749 Sep 03 21:12:11.766486 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2655/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:11 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1374 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:12.053812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:12.055315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:12.069186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:12.070770 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:12.073866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:12.085755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:12.087070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:12.089707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:12.148645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:12.149103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:12.149552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:12.150014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lazy-loading 'fault' on Instance uuid 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:12:12.223143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:12.231708 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f0b1ab2-31d4-48d1-a577-a05f92de7acf tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 200 len: 1304 microversion: 2.1 time: 0.181916 Sep 03 21:12:12.232819 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2420/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:12 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:12.791788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:12.792411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:12.800211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:12.801145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:12.801949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:12.802932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:12.803599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:12.804238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.033210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:13.052309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-33ef3d58-65e5-477d-87c7-bd98b99c0e7e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1547 microversion: 2.1 time: 0.265353 Sep 03 21:12:13.055343 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2656/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:12 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:13.079478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:13.080826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:13.088666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.089618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.090372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.091534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.092297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.094048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.256874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:13.257816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:13.264710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.265685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.266318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.267247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.267717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.268151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.283590 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 HTTP/1.1 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6'} Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:13.285724 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. Sep 03 21:12:13.291853 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:13.295095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 404 to user: Instance 3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:13.296456 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9737ce1-8eb7-49b0-89e8-989237426334 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6" status: 404 len: 111 microversion: 2.1 time: 0.044592 Sep 03 21:12:13.301599 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2657/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:13 2022] GET /compute/v2.1/servers/3e9b842a-67e9-4cf2-ac0e-7ea30ff3c4d6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:12:13.307559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:13.308074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:13.316160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.316671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.317145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.317951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.318417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.318852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.393891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:13.431503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:13.524380 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb3c2fe9-a2a9-44f8-b602-a062d5195b62 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 204 len: 0 microversion: 2.1 time: 0.220948 Sep 03 21:12:13.526032 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2658/5078] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:13 2022] DELETE /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:13.536110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:13.537203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:13.544067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.545048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.546500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.548267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:13.549052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:13.549727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:13.613700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:13.625217 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-452b1e06-e9b5-47cc-8818-2659679dec1b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1547 microversion: 2.1 time: 0.550546 Sep 03 21:12:13.626895 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2421/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:13 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1547 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:13.721362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:13.730447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20edccc5-6756-4955-be55-ff0b66b34cee tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1495 microversion: 2.1 time: 0.199145 Sep 03 21:12:13.731332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2659/5080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:13 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1495 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:14.758410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:14.759179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:14.773769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:14.774288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:14.774755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:14.777971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:14.780240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:14.780882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:14.951241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:14.972110 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-733d389f-c7a8-4cb8-b48c-8a380648ddc6 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 200 len: 1453 microversion: 2.1 time: 0.217779 Sep 03 21:12:14.973084 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2422/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:14 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:15.099583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28ff0e1-77c3-49e5-ac31-a18852bb74d4", "name": "network-vif-deleted", "tag": "5ac4259c-37eb-45f0-ba45-443db52c6f1f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:15.117789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:15.118611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:15.119199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:15.151338 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] Creating event network-vif-deleted:5ac4259c-37eb-45f0-ba45-443db52c6f1f for instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 on nch1-master-1 Sep 03 21:12:15.163789 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a0bc880c-2f7f-404c-9239-0255a199f867 req-79b2127e-f578-44cb-b744-717239cb246a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067751 Sep 03 21:12:15.165002 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2660/5082] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:16.016584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:16.017241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: b28ff0e1-77c3-49e5-ac31-a18852bb74d4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:16.031363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.032242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.032867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.033659 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.037361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.037775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.077107 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 HTTP/1.1 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b28ff0e1-77c3-49e5-ac31-a18852bb74d4'} Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:16.080044 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. Sep 03 21:12:16.085357 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:16.088417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 404 to user: Instance b28ff0e1-77c3-49e5-ac31-a18852bb74d4 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:16.089354 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a1dadecf-27b6-4032-805f-9b2d57c6812b tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4" status: 404 len: 111 microversion: 2.1 time: 0.077680 Sep 03 21:12:16.090395 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2423/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:16 2022] GET /compute/v2.1/servers/b28ff0e1-77c3-49e5-ac31-a18852bb74d4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:16.098827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:16.099519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:16.106901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.107530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.109171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.109902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.110375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.110815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.158800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:16.284416 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e3257339-fbe1-4c4e-81e9-54a3f5b73135 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 204 len: 0 microversion: 2.1 time: 0.188947 Sep 03 21:12:16.286666 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2661/5084] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:16 2022] DELETE /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:16.298654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:16.300371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:16.309927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.310859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.311677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.312669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:16.314143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:16.314924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:16.659069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:16.668604 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa0fe6a6-6b64-4225-8286-a143e86ccfa9 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1676 microversion: 2.1 time: 0.377780 Sep 03 21:12:16.669831 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2424/5085] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:16 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1676 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:17.698052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:17.699727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:17.714749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:17.715449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:17.718377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:17.719384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:17.720497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:17.722500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:17.964936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:17.975861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9a13277-0737-4cd2-aaee-11e3d7eea98d tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1676 microversion: 2.1 time: 0.282137 Sep 03 21:12:17.991505 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2662/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:17 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:19.003233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:19.004003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:19.018388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:19.019226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:19.022018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:19.023065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:19.025189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:19.027137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:19.294670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:19.307595 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e82a4a6f-5fba-43a1-9abb-ae27002569b3 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1609 microversion: 2.1 time: 0.309087 Sep 03 21:12:19.314844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2425/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:18 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1609 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:19.412718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b25f89a-4721-4b18-838b-0ab9b15212d7", "name": "network-vif-deleted", "tag": "c8b84110-58d9-4be7-a5b8-d85909f50741"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:19.436457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:19.436982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:19.437664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:19.470432 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] Creating event network-vif-deleted:c8b84110-58d9-4be7-a5b8-d85909f50741 for instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 on nch1-master-1 Sep 03 21:12:19.478963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9926724e-a9ae-4789-a280-a272446959bb req-2071b22c-2bf1-4772-84f0-5081b54a5d89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069595 Sep 03 21:12:19.479592 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2663/5088] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:20.339648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:20.340268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:20.355497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:20.356599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:20.357355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:20.362656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:20.363961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:20.365239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:20.471071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:20.472840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:20.477550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:20.479349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lazy-loading 'fault' on Instance uuid 4b25f89a-4721-4b18-838b-0ab9b15212d7 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:12:20.583274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485394bc49e4380b152d32d09440281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8915b5da4f224da89e9699a7599350a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:20.595063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6ec67f8-68f2-4ad3-a685-21481c024da7 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 200 len: 1328 microversion: 2.1 time: 0.259328 Sep 03 21:12:20.595660 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2426/5089] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:20 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 1328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:21.621654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:21.622443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] [instance: 4b25f89a-4721-4b18-838b-0ab9b15212d7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:21.629613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:21.630377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:21.630898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:21.631855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:21.632526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:21.633751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:21.648585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] HTTP exception thrown: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Request method failure captured: Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 HTTP/1.1 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8EkV81YwQXWmoP38UMTemEeG3zZyPox-I76sXmAxOcKZ39Dt8xN58g3YDR2jq6V-3bs5QgkEeoCj66_aMan-Jb-KksR0pDNj7ziVDNV3TzWRrO29zo7CJ_6DCNPMia2655Cu1EqsqEr4tYhlmoEem7gDFxaDJ_y7YF45Nbm4XzpNLI Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8915b5da4f224da89e9699a7599350a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8915b5da4f224da89e9699a7599350a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 8915b5da4f224da89e9699a7599350a1 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-450301980 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d485394bc49e4380b152d32d09440281 Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-450301980-project Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4b25f89a-4721-4b18-838b-0ab9b15212d7'} Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:21.650666 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. Sep 03 21:12:21.657465 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:21.660049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Returning 404 to user: Instance 4b25f89a-4721-4b18-838b-0ab9b15212d7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:21.661149 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-983f1614-3515-4cfb-b298-3b44a817c7a0 tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7" status: 404 len: 111 microversion: 2.1 time: 0.046429 Sep 03 21:12:21.662207 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2664/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:21 2022] GET /compute/v2.1/servers/4b25f89a-4721-4b18-838b-0ab9b15212d7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:21.672046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cfec586b-05f2-416a-90cb-075bb2b73a8a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] Calling method '.version_select at 0x7fae662d4ca0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:21.712364 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cfec586b-05f2-416a-90cb-075bb2b73a8a tempest-ServerActionsTestJSON-450301980 tempest-ServerActionsTestJSON-450301980-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307655502" status: 202 len: 0 microversion: 2.1 time: 0.045203 Sep 03 21:12:21.713103 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2427/5091] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Sep 3 21:12:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307655502 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:12:28.644031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:28.645914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:28.646420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:28.646877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:28.647630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:28.648097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:28.648541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:28.677657 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bef097ed-6a89-4a35-8717-3831a1136417 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.316575 Sep 03 21:12:28.678267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2665/5092] 10.222.0.16 () {58 vars in 1185 bytes} [Sat Sep 3 21:12:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:28.859351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2083281703", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "1543ac74-714b-43fa-a3f3-781cb77316d0"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:28.986233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] validate_networks() for [('1543ac74-714b-43fa-a3f3-781cb77316d0', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:12:29.817427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:12:29.817915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:12:29.818407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:12:29.818848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:12:29.819276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:12:29.830454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:29.830946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:29.831812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:29.832571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:29.833251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:29.833520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:29.858489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Getting quotas for project d226984bcb6d4be48a4f884c26010afa. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:12:29.866767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Getting quotas for user c276bdddd15f4682a19ba89403a1aefc and project d226984bcb6d4be48a4f884c26010afa. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:12:29.882164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:12:29.884584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:12:29.938712 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-93b96fc6-be75-40b1-9e3d-5c09231ba4ed tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084961 Sep 03 21:12:29.941234 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2428/5093] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:12:29.955105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01b3e5b7-400f-438d-b023-58e7f2b190fe tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:29.957435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01b3e5b7-400f-438d-b023-58e7f2b190fe tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:30.084543 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01b3e5b7-400f-438d-b023-58e7f2b190fe tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1329 microversion: 2.1 time: 0.136583 Sep 03 21:12:30.086218 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2666/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:29 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:31.111552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:31.112275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:31.127356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:31.127853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:31.128297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:31.129834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:31.130474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:31.130912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:31.225698 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5fe8a6a4-5bfa-49d0-99d1-2ea2aa23b35e tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1416 microversion: 2.1 time: 0.118613 Sep 03 21:12:31.226294 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2429/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:31 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1416 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:32.252115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:32.252786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:32.276393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:32.276959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:32.277422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:32.278242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:32.278712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:32.279149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:32.574187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1d3b438-4aab-4091-8bb6-bc0077d3ded1 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1422 microversion: 2.1 time: 0.326260 Sep 03 21:12:32.576659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2667/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:32 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1422 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:33.606853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:33.608286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:33.621922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:33.622826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:33.631763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:33.633508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:33.637585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:33.641929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:34.007222 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b099af7-84cc-415c-be7c-c8c03f868ef0 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.406118 Sep 03 21:12:34.027043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2430/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:33 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:34.195862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4d80ca-046b-4366-bb2d-0da54fe34e75", "tag": "a4e31c72-4be6-4690-bac2-2fbe05b9f121"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:34.212187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:34.218749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:34.219236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:34.219686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:34.249528 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] Creating event network-changed:a4e31c72-4be6-4690-bac2-2fbe05b9f121 for instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 on nch1-master-1 Sep 03 21:12:34.257799 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b51d95ab-f5eb-46af-a15a-38dacb24becf req-26c600c5-02d7-42fd-8a2c-aa18efd28efc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065896 Sep 03 21:12:34.259087 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2668/5098] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:34.827527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:34.828752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:34.849070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:34.863573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:34.869408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:34.870574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:34.871441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:34.872372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:34.918111 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1537abda-53be-4ef4-b508-e61c5fa37c15 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b/ips" status: 200 len: 148 microversion: 2.1 time: 0.099444 Sep 03 21:12:34.919278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2431/5099] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:12:34 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b/ips => generated 148 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:35.037173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:35.038745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:35.057860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:35.059758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:35.062844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:35.063907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:35.065409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:35.066715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:35.440971 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac1b587d-7e63-49d8-be48-89bcd9d0febc tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.401845 Sep 03 21:12:35.440971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2669/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:35 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:36.460743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:36.461815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:36.468265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:36.475386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.475985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.479297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.480136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.482034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.485892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.550777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:36.551870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:36.566694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.574897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.576771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.578926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.580731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.586445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.629296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:36.751271 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-64a41ce1-3d84-42fe-aac8-ccb229709a13 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 204 len: 0 microversion: 2.1 time: 0.204211 Sep 03 21:12:36.753169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2670/5101] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:36 2022] DELETE /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:36.781201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:36.781942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:36.809406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.811515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.812517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.814205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:36.814858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:36.815505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:36.852299 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3738bf56-25fb-495c-975b-7bb61afe5baf tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.396094 Sep 03 21:12:36.854867 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2432/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:36 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:37.068611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:37.095412 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53093d58-c92d-4fe2-94d8-f157e9c28f23 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1679 microversion: 2.1 time: 0.332891 Sep 03 21:12:37.099348 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2671/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:36 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:37.877316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:37.878629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:37.887542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:37.888469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:37.889215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:37.890274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:37.891035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:37.892144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:37.959917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1368221211", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8148394f-67e5-4f0f-9f22-0a573b3f1df5"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:38.047799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] validate_networks() for [('8148394f-67e5-4f0f-9f22-0a573b3f1df5', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:12:38.115334 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1cee7fac-ba5e-4310-811b-f43e92fee281 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.242758 Sep 03 21:12:38.118333 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2672/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:37 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:38.138568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:38.139248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:38.148968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:38.149488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:38.151743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:38.155042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:38.155545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:38.155999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:38.660382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:38.681213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:12:38.681772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:12:38.682504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:12:38.683138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:12:38.683789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:12:38.708634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:38.709679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:38.710368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:38.713154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:38.714027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:38.715389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:38.772178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Getting quotas for project 77941b15bab7435fa20336fa6dd26d58. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:12:38.779545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Getting quotas for user be1f616143114ef2bc2036efb0d11eef and project 77941b15bab7435fa20336fa6dd26d58. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:12:38.824693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:12:38.828522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:12:38.902679 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1704748-f530-4663-ae67-4c84664e50df tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103461 Sep 03 21:12:38.905018 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2433/5105] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:12:38.931225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2cb44a0f-1598-4bf0-895b-912b7c394a29 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:38.931954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2cb44a0f-1598-4bf0-895b-912b7c394a29 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:39.110637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2cb44a0f-1598-4bf0-895b-912b7c394a29 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:39.139628 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2cb44a0f-1598-4bf0-895b-912b7c394a29 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1217 microversion: 2.1 time: 0.220950 Sep 03 21:12:39.143818 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2434/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:38 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:39.155466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:39.162918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:39.180615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:39.183378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:39.185841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:39.188985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:39.189743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:39.191222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:39.222701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:39.240307 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1aa531f3-b299-4e4c-85a9-a50ac34845c2 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1679 microversion: 2.1 time: 1.112191 Sep 03 21:12:39.257618 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2673/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:38 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1679 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:39.660107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4d80ca-046b-4366-bb2d-0da54fe34e75", "name": "network-vif-plugged", "status": "completed", "tag": "a4e31c72-4be6-4690-bac2-2fbe05b9f121"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:39.675247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:39.675816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:39.676513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:39.693628 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] Creating event network-vif-plugged:a4e31c72-4be6-4690-bac2-2fbe05b9f121 for instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 on nch1-master-1 Sep 03 21:12:39.701610 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-00fcb409-991e-4e97-a0af-59f9a15f7acc req-d6bd487c-9e81-4b2d-8d7b-35875eb8e164 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047370 Sep 03 21:12:39.703117 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2674/5108] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:12:39.908352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40ec0622-e07e-4ebf-b4be-09d4ad3ca697 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.759825 Sep 03 21:12:39.914203 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2435/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:39 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:40.169166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:40.170021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:40.174446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:40.179835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.180566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.181262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.182234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.182864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.183626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.263661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:40.264884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:40.271198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.271786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.272309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.273144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.273846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.275277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.282764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=86 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:40.356038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:40.366367 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-240190b1-1a2f-4ca0-98dc-9fe4bd40f827 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1612 microversion: 2.1 time: 0.106658 Sep 03 21:12:40.367429 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2436/5110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:40 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:40.402602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:40.414903 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c6fa26d-4524-4b36-a24c-9cf32300570f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1269 microversion: 2.1 time: 0.249911 Sep 03 21:12:40.416075 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2675/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:40 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1269 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:40.515321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21dbd3e-1f99-4e77-88d3-4a17eb88529b", "name": "network-vif-deleted", "tag": "36554336-777c-4315-8829-c6aae0bdd35a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:40.530370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.531137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.531785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.548148 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] Creating event network-vif-deleted:36554336-777c-4315-8829-c6aae0bdd35a for instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b on nch1-master-1 Sep 03 21:12:40.562613 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-40748127-2e9e-42ba-b9b2-fe7719651a04 req-6b0bb33b-2139-4864-9fc3-410966683215 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045108 Sep 03 21:12:40.564178 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2437/5112] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:40.945804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:40.946754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:40.960026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.960812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.961463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.963165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:40.965026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:40.965902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:40.973681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:41.314038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a481a566-6ba0-46d3-b35b-157cad49e5af tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1464 microversion: 2.1 time: 0.377644 Sep 03 21:12:41.315361 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2676/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:40 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:41.394000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:41.395282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:41.406083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.406839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.407296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.408037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.409378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.410162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.438191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:41.439977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:41.457272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.458317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.458962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.459927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.460570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.461940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.494524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.495876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.497337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.497843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lazy-loading 'fault' on Instance uuid a21dbd3e-1f99-4e77-88d3-4a17eb88529b {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:12:41.566156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e79edf1a33e45ddac92ba8cd8429d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15985a3823b5409c8a18e31048f82ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:41.577553 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d504dbc9-e69d-4763-a44d-17ab94b16cea tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 200 len: 1331 microversion: 2.1 time: 0.191573 Sep 03 21:12:41.578152 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2438/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:41 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:41.607126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:41.620190 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d68a6342-a7e3-4165-9e19-ab48b4268e60 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1269 microversion: 2.1 time: 0.185358 Sep 03 21:12:41.622803 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2677/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:41 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:41.822516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21dbd3e-1f99-4e77-88d3-4a17eb88529b", "name": "network-vif-unplugged", "status": "completed", "tag": "36554336-777c-4315-8829-c6aae0bdd35a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:41.837776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:41.842594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:41.844506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:41.871564 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] Creating event network-vif-unplugged:36554336-777c-4315-8829-c6aae0bdd35a for instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b on nch1-master-1 Sep 03 21:12:41.884728 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a6da819e-a0ac-41e1-92b3-6e9f23aa3c8b req-1a5986e0-1768-4422-8dc7-6c004c183e3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066093 Sep 03 21:12:41.885387 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2439/5116] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:42.339576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.340434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:42.349563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.350453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.352682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.353751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.354468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.355196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.602494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.604524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:42.614710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.615911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.616658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.617627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.618367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.619024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.649217 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b HTTP/1.1 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a21dbd3e-1f99-4e77-88d3-4a17eb88529b'} Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:42.657314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24a2ec72-83c1-423a-aeb9-bede7a510f5e tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 404 len: 111 microversion: 2.1 time: 0.061508 Sep 03 21:12:42.666048 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2440/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:42 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:42.673314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.673971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:42.682797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.683306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.685824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.687219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.688161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.688631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.802160 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-41f5e045-1559-4a24-abe6-faec00a05b7b tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1650 microversion: 2.1 time: 0.466491 Sep 03 21:12:42.809756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2678/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:42 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1650 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:42.821033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c96ae40-794c-469d-a554-ab22c3ad7cdd tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '.version_select at 0x7fae670340d0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.831420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:42.851923 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-794903b1-837f-4d1e-bc85-4176bdbe1b2e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1275 microversion: 2.1 time: 0.186916 Sep 03 21:12:42.858388 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2441/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:42 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:42.870159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.884419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:42.903130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c96ae40-794c-469d-a554-ab22c3ad7cdd tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141963223" status: 202 len: 0 microversion: 2.1 time: 0.091621 Sep 03 21:12:42.907908 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2679/5120] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:12:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141963223 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:12:42.909395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.912621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.914169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.915421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.916257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.917198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.960529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:42.961521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:42.993989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:42.995086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:42.997277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:42.999937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.001758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.002512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.045658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:43.163970 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1fe7ec2-0906-47aa-b0c5-8803d19884e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 204 len: 0 microversion: 2.1 time: 0.205185 Sep 03 21:12:43.168987 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2680/5121] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:42 2022] DELETE /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:12:43.178270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:43.179320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:43.190203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.191438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.192055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.193126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.194654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.195993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.435516 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17b08a18-a1e1-4f4e-b6c9-00e5bd2b30eb tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1650 microversion: 2.1 time: 0.573793 Sep 03 21:12:43.441104 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2442/5122] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:42 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1650 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:43.480661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:43.481368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:43.501143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.501651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.502259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.503084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.503582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.503706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:43.504023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.530985 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4d1bf273-d06c-4e93-b05c-88892db6c4be tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1553 microversion: 2.1 time: 0.353191 Sep 03 21:12:43.545808 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2681/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:43 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:43.843059 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a58553b4-ed66-4530-b6bd-f665f66ecf87 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1650 microversion: 2.1 time: 0.367537 Sep 03 21:12:43.844941 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2443/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:43 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1650 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:43.883819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:43.884465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:43.919148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.919675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.920181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:43.921430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:43.922096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:43.922979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:44.072047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1218767328", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "1543ac74-714b-43fa-a3f3-781cb77316d0"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:44.209786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] validate_networks() for [('1543ac74-714b-43fa-a3f3-781cb77316d0', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:12:44.783058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:44.796643 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93ee46a7-391a-4798-a621-caa070f6d8e7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.917207 Sep 03 21:12:44.800186 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2682/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:43 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:44.814042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:44.816067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:44.831969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:44.832737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:44.833603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:44.834598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:44.835435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:44.837000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.039012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:12:45.040119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:12:45.041154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:12:45.041833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:12:45.042614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:12:45.064837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.065772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.073599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.075661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.077316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.078878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.146936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Getting quotas for project d226984bcb6d4be48a4f884c26010afa. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:12:45.155458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Getting quotas for user c276bdddd15f4682a19ba89403a1aefc and project d226984bcb6d4be48a4f884c26010afa. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:12:45.201135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:12:45.210419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:12:45.222851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:45.237901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1e866c3-70be-4758-8cae-fbce80fbf22f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1553 microversion: 2.1 time: 0.433208 Sep 03 21:12:45.238897 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2683/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:44 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:45.354984 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c4a465b0-4988-4d3a-9218-77227179b534 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287512 Sep 03 21:12:45.356289 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2444/5127] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:12:45.367580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec3d761e-654f-46c0-8b36-959d7c69ce07 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:45.368547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec3d761e-654f-46c0-8b36-959d7c69ce07 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:45.502753 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec3d761e-654f-46c0-8b36-959d7c69ce07 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1329 microversion: 2.1 time: 0.138829 Sep 03 21:12:45.505037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2684/5128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:45 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:45.634860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:45.635372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:45.649199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.649771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.651104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.651905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.658996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.659801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.682764 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b HTTP/1.1 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a21dbd3e-1f99-4e77-88d3-4a17eb88529b'} Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:45.686300 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:45.690690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-540e83bb-868e-4089-8ab3-05e8555ac8ba tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 404 len: 111 microversion: 2.1 time: 0.060092 Sep 03 21:12:45.692035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2445/5129] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:45 2022] DELETE /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:45.709809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:45.712187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: a21dbd3e-1f99-4e77-88d3-4a17eb88529b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:45.732146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.733694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.733858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.734779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.735440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.736042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.739125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b1236a-38d7-4be3-bfda-bca4a8bca762", "name": "network-vif-deleted", "tag": "aaa9084f-4382-4f8b-bf94-540fb06950d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:45.755879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b HTTP/1.1 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a21dbd3e-1f99-4e77-88d3-4a17eb88529b'} Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:45.765699 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance a21dbd3e-1f99-4e77-88d3-4a17eb88529b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b747f961-ccd8-4662-baee-d22d8d0e07a8 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b" status: 404 len: 111 microversion: 2.1 time: 0.072765 Sep 03 21:12:45.772511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2685/5130] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:45 2022] GET /compute/v2.1/servers/a21dbd3e-1f99-4e77-88d3-4a17eb88529b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:12:45.774808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.774808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.774808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.777259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d415823-f8cc-4338-8580-3816dc87e8c4", "tag": "f95861db-3e5a-4a02-b4d3-e3723d4951ee"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:45.791071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.791682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.792445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.805931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] Creating event network-changed:f95861db-3e5a-4a02-b4d3-e3723d4951ee for instance 6d415823-f8cc-4338-8580-3816dc87e8c4 on nch1-master-1 Sep 03 21:12:45.811660 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5ed043b6-d809-4567-9fcb-5aba65b2c171 req-59d0900f-a873-4ae6-871e-2af8d715973b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041649 Sep 03 21:12:45.812506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2686/5131] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:45.813431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] Creating event network-vif-deleted:aaa9084f-4382-4f8b-bf94-540fb06950d5 for instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 on nch2-master-1 Sep 03 21:12:45.820311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:45.825589 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-16e97a01-2672-4fed-9e4c-15e260f594d1 req-4cf964f5-e33a-47ad-b6b0-149e027a14ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099597 Sep 03 21:12:45.826426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:45.828050 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2446/5132] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:45.842979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.843497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.843884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:45.847069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:45.848699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:45.848699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.115026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.116173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.128205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.128711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.129255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.130164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.131613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.135119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.168330 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 HTTP/1.1 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4ee883ce-5f55-41a9-a07f-7543a98ff3c7'} Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:46.170118 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:46.175294 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c668ea4-b719-45be-ba86-0db57a8d0eaf tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 404 len: 111 microversion: 2.1 time: 0.060939 Sep 03 21:12:46.189277 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2447/5133] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:46 2022] DELETE /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:46.195667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.196306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: 4ee883ce-5f55-41a9-a07f-7543a98ff3c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.217835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.218399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.218866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.219709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.220498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.220858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.255634 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 HTTP/1.1 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4ee883ce-5f55-41a9-a07f-7543a98ff3c7'} Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.262086 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance 4ee883ce-5f55-41a9-a07f-7543a98ff3c7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-305df68f-4814-41a5-b3dd-6d1f59a47b38 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7" status: 404 len: 111 microversion: 2.1 time: 0.075865 Sep 03 21:12:46.269467 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2448/5134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:46 2022] GET /compute/v2.1/servers/4ee883ce-5f55-41a9-a07f-7543a98ff3c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:46.274437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.274631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:46.275091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.294466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.296166 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c8678cef-f281-4be8-8efd-291ee868306e tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.478246 Sep 03 21:12:46.296879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.297703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.298723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.301205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.302220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.315893 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2687/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:45 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:46.386326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.395423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.396000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.396485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lazy-loading 'fault' on Instance uuid 31b1236a-38d7-4be3-bfda-bca4a8bca762 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:12:46.468389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:46.486038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-062e55ae-fa44-41e4-9209-455c878756b5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 200 len: 1339 microversion: 2.1 time: 0.216033 Sep 03 21:12:46.486959 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2449/5136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:46 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:46.529316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.529981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.542130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.543761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.545215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.547199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.547954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.548700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.580184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.581086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.587630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.588448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.589016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.589968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.590662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.591440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.608343 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc HTTP/1.1 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ea9e946d-fd59-407d-8add-99b3eee0b8dc'} Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:46.610132 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5e8c3927-4f43-48a8-814a-ec7dbde31cbe tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 404 len: 111 microversion: 2.1 time: 0.037190 Sep 03 21:12:46.615222 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2450/5137] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:46 2022] DELETE /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:12:46.620525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:46.621196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] [instance: ea9e946d-fd59-407d-8add-99b3eee0b8dc] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:46.628141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.628999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.629709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.630661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:46.631374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:46.631886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:46.648755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] HTTP exception thrown: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Request method failure captured: Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc HTTP/1.1 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8IxpNO2oEKlP21Mkoa6gnnB_Nt4KE-w6sTSy6yugeb9n_UdPP0rAUDFRtkxZ5I7bemOECXhOjSVsAnEu-cXZuaPoNd3519ARcf-wRgPZyv4vLplgPMYrtJwpOxhhc9LTZgpkQxOlcL1BgW5wLT2proozmjuEI85VoFSKazmGK3EFsw Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15985a3823b5409c8a18e31048f82ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 15985a3823b5409c8a18e31048f82ff7 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-66898911 Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 3e79edf1a33e45ddac92ba8cd8429d9b Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-AttachVolumeNegativeTest-66898911-project Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ea9e946d-fd59-407d-8add-99b3eee0b8dc'} Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:46.650450 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] Returning 404 to user: Instance ea9e946d-fd59-407d-8add-99b3eee0b8dc could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c644c4fa-b695-4553-b9f4-e1889dd348f4 tempest-AttachVolumeNegativeTest-66898911 tempest-AttachVolumeNegativeTest-66898911-project] 10.222.0.16 "GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc" status: 404 len: 111 microversion: 2.1 time: 0.036175 Sep 03 21:12:46.657567 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2451/5138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:46 2022] GET /compute/v2.1/servers/ea9e946d-fd59-407d-8add-99b3eee0b8dc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:46.681381 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6576822b-ccb9-4793-8528-fb00c3579082 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1416 microversion: 2.1 time: 0.157145 Sep 03 21:12:46.682898 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2688/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:46 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:47.323728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:47.324360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:47.333935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.334844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.335502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.337642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.338671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.339314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.512054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:47.512739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 31b1236a-38d7-4be3-bfda-bca4a8bca762] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:47.519749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.520222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.520831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.521644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.522104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.523150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.541218 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] HTTP exception thrown: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Request method failure captured: Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 HTTP/1.1 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8LTlqg61KM9dWJ1OZJvrqHJetJYCfV-hyZ_KdHzviqIlfcrnbUuQ8MjRe1Q_VJv-JPQ98HcKOCYHsbyyXGOUlc_AraYhh_C0Um1-antoq1YqRcanR4ACaVgzz1_idgcxuY1zBo2z6-1nrNaDylw1HSJzauU_xwV0eTFRHsrrKpoUb4 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 9f792275f53f445ea72b6de441314a49 Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '31b1236a-38d7-4be3-bfda-bca4a8bca762'} Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:47.544882 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Returning 404 to user: Instance 31b1236a-38d7-4be3-bfda-bca4a8bca762 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9dd92913-d509-49ac-940a-63eb7ad1c639 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762" status: 404 len: 111 microversion: 2.1 time: 0.036963 Sep 03 21:12:47.551086 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2689/5140] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:47 2022] GET /compute/v2.1/servers/31b1236a-38d7-4be3-bfda-bca4a8bca762 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:47.710001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:47.710710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:47.724058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.724568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.725055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.725834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:47.726308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:47.728714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:47.807155 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-16ff7906-30a4-45a6-9512-79058a0892d5 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1422 microversion: 2.1 time: 0.101839 Sep 03 21:12:47.807747 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2690/5141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:47 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:47.943314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:47.952370 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3fd0aca1-f53f-4866-86b9-36208d56f446 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.633085 Sep 03 21:12:47.952972 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2452/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:47 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:48.380404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68ce189e-507c-4d30-b744-2555dc094901 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '.version_select at 0x7fae66fe4a60>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:48.422261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68ce189e-507c-4d30-b744-2555dc094901 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1646815947" status: 202 len: 0 microversion: 2.1 time: 0.045822 Sep 03 21:12:48.423604 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2691/5143] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 3 21:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1646815947 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:12:48.830885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:48.832450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:48.851964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:48.853457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:48.854196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:48.855153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:48.856216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:48.860048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:48.976948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:48.978635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:48.997459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:48.998437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:48.999097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:49.000838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:49.002931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:49.003575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:49.343747 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b498b087-4c53-4161-bcfb-b64b54d3e58c tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.516552 Sep 03 21:12:49.344347 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2453/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:48 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:49.577162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:49.592736 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01de11e3-1878-4d86-a9e4-8b7ee7c17f08 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.619699 Sep 03 21:12:49.605481 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2692/5145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:48 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:50.368120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:50.368913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:50.380366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:50.384514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:50.385315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:50.389699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:50.390484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:50.392011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:50.620526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:50.621952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:50.636232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:50.638942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:50.639660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:50.641052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:50.641787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:50.643040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:51.372615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4ceed3ba-58c5-4b0d-aec2-cfa9eda5ba06 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 1.004465 Sep 03 21:12:51.385736 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2454/5146] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:50 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:51.395908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f11ffb3-4103-4221-8732-5cc81ef1679f", "tag": "8c710f8f-c2dc-484b-8bb1-88c1445a054c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:51.497776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:51.501447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:51.502802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:51.540384 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] Creating event network-changed:8c710f8f-c2dc-484b-8bb1-88c1445a054c for instance 2f11ffb3-4103-4221-8732-5cc81ef1679f on nch2-master-1 Sep 03 21:12:51.549070 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f3514f53-ce56-4eb8-9bd6-7d684331b941 req-013eac73-85e4-4ca0-9e14-fc4a7a15d7e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160449 Sep 03 21:12:51.554166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2455/5147] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:51.684671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:51.701338 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a2340f1-6d74-4a5a-b1e3-27b5baeb02c4 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 1.084674 Sep 03 21:12:51.703837 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2693/5148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:50 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:52.404476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:52.405233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:52.414769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:52.415747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:52.416520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:52.417944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:52.419488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:52.429949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:52.733907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:52.735132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:52.746608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:52.750075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:52.750598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:52.751348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:52.751982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:52.752598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:52.926864 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d6c86df-56e6-4aef-b2d3-e896affda433 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.527493 Sep 03 21:12:52.929111 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2456/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:52 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:53.034750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:53.046920 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-25a79135-7f32-4c04-b253-12286861eb86 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.318285 Sep 03 21:12:53.048434 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2694/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:52 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:53.241968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:53.242645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:53.250285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc9eaca-b629-4481-9ad7-209f07da003c", "tag": "03794b01-96d5-45df-9cae-05c6153c885a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:53.261882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.262781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.264514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.265621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.266421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.267146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.270697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.271421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.272273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.286731 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] Creating event network-changed:03794b01-96d5-45df-9cae-05c6153c885a for instance 6cc9eaca-b629-4481-9ad7-209f07da003c on nch2-master-1 Sep 03 21:12:53.293168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-98cdd7bc-0643-4b99-bc66-8b925b6b660a req-b2911970-d091-445b-9647-8e713499b6e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046962 Sep 03 21:12:53.294362 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2695/5151] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:53.330401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:53.404812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:53.470650 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-28500939-3ebc-47c2-bd5d-882506a4399b tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 204 len: 0 microversion: 2.1 time: 0.232397 Sep 03 21:12:53.472513 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2457/5152] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:53 2022] DELETE /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:53.481559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:53.491127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:53.503770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.507099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.509494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.510493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.512041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.513486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.786361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:53.790123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:53.812811 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8d94d1c7-8f09-4ee6-99fa-e8dc0ca353d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1670 microversion: 2.1 time: 0.335801 Sep 03 21:12:53.814164 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2696/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:53 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:53.952438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:53.953441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:53.973776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.978542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.981617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:53.983748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:53.984422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:53.985115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:54.072490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:54.073434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:54.103191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:54.107186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:54.113933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:54.114735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:54.120021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:54.120559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:54.277508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7cf9b944-98f7-4e78-8e4a-8c5e09712034 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.330006 Sep 03 21:12:54.281659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2458/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:53 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:54.377249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:54.393799 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-218e9f03-c869-495f-87d8-40c602f730f7 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.325195 Sep 03 21:12:54.395194 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2697/5155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:54 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:54.463114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d415823-f8cc-4338-8580-3816dc87e8c4", "name": "network-vif-plugged", "status": "completed", "tag": "f95861db-3e5a-4a02-b4d3-e3723d4951ee"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:54.475881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:54.476831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:54.478447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:54.496264 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] Creating event network-vif-plugged:f95861db-3e5a-4a02-b4d3-e3723d4951ee for instance 6d415823-f8cc-4338-8580-3816dc87e8c4 on nch1-master-1 Sep 03 21:12:54.502614 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-edce856b-ec82-4598-bcdf-4430849e3ac9 req-1352f34c-29e5-491f-9cdc-eed7afb495c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043949 Sep 03 21:12:54.504040 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2459/5156] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:54.841165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:54.842971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:54.851963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:54.853987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:54.854834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:54.855923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:54.856388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:54.857150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:55.286214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:55.305217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:55.306515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=20 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:55.324916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:55.327592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e288d304-545c-4fdd-9d78-5974f5406dd0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1670 microversion: 2.1 time: 0.486756 Sep 03 21:12:55.327907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:55.331319 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2698/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:54 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1670 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:55.339467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:55.341125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:55.342405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:55.346515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:55.347296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:55.348001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:55.434231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:55.435446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:55.494083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:55.499226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:55.505583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:55.508815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:55.511320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:55.512857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:55.513598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:55.933915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:55.949819 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8946024-6e0b-4d9f-949a-cc5f0ffbc1d0 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1317 microversion: 2.1 time: 0.532397 Sep 03 21:12:55.956629 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2699/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:55 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:56.255453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b470fe2f-522c-4e88-ac72-9be7b12d7ef2 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.952615 Sep 03 21:12:56.256093 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2460/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:55 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:56.304154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc9eaca-b629-4481-9ad7-209f07da003c", "name": "network-vif-deleted", "tag": "03794b01-96d5-45df-9cae-05c6153c885a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:56.319377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:56.319876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:56.320410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:56.338472 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] Creating event network-vif-deleted:03794b01-96d5-45df-9cae-05c6153c885a for instance 6cc9eaca-b629-4481-9ad7-209f07da003c on nch2-master-1 Sep 03 21:12:56.350827 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f5f466ec-d293-467c-a308-b83b77339670 req-a26f90d2-6328-4e5f-8837-430501a12047 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051959 Sep 03 21:12:56.353147 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2700/5160] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:56.361080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:56.362014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:56.367317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:56.373814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:56.374933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:56.375554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:56.376682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:56.377449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:56.378138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:56.471792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:56.483417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-45805834-f42c-46c5-b3d9-b9d73f4e798a tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 200 len: 1334 microversion: 2.1 time: 0.128213 Sep 03 21:12:56.484994 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2461/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:56 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:56.981702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:56.982725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:56.999900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.001856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.004508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.005677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.007733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.008511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.155443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e7b887a-3228-48f3-803d-cd957d866137 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Action: 'create', calling method: .version_select at 0x7fae6698aaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-843060740", "metadata": {"Type": "work"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:57.339506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:57.349121 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-673717d9-44d1-445a-95cb-b479b6d6fcf5 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1507 microversion: 2.1 time: 0.372716 Sep 03 21:12:57.368604 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2462/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:56 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:57.374795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.375768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.383499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.384202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.384654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.385405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.386045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.387042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.643305 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e7b887a-3228-48f3-803d-cd957d866137 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.731812 Sep 03 21:12:57.653626 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2701/5163] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Sep 3 21:12:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 734 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 03 21:12:57.653626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.653626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.673896 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3a2a10a2-104f-46fe-a094-eb3ab92c8f6f tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.303989 Sep 03 21:12:57.674730 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2463/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:57.682108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.682842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.683549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.684172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.685162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.685668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.686078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.688496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 6cc9eaca-b629-4481-9ad7-209f07da003c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.699233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.700076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.700739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.701798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.702631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.703224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.718887 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2a0dc551-1ca3-4579-a9bf-dae001d9e371 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips" status: 200 len: 110 microversion: 2.1 time: 0.073134 Sep 03 21:12:57.719882 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2702/5165] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips => generated 110 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:57.721614 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] HTTP exception thrown: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Request method failure captured: Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c HTTP/1.1 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8LTlqg61KM9dWJ1OZJvrqHJetJYCfV-hyZ_KdHzviqIlfcrnbUuQ8MjRe1Q_VJv-JPQ98HcKOCYHsbyyXGOUlc_AraYhh_C0Um1-antoq1YqRcanR4ACaVgzz1_idgcxuY1zBo2z6-1nrNaDylw1HSJzauU_xwV0eTFRHsrrKpoUb4 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9f792275f53f445ea72b6de441314a49 Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6cc9eaca-b629-4481-9ad7-209f07da003c'} Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:57.723367 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Returning 404 to user: Instance 6cc9eaca-b629-4481-9ad7-209f07da003c could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:57.729669 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-203cef26-a84b-426f-aaf4-f8a2033b418c tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c" status: 404 len: 111 microversion: 2.1 time: 0.049024 Sep 03 21:12:57.731321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2464/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/servers/6cc9eaca-b629-4481-9ad7-209f07da003c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:57.737347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.737858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.751622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3517e15a-9bb5-469c-bccd-2ff6fb20a472 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Calling method '.version_select at 0x7fae66936310>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.754340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.755217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.756484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.757879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.758742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.759494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.788232 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ff11bf3-bb8d-464f-981b-7ef97d04e6a2 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips" status: 200 len: 110 microversion: 2.1 time: 0.055519 Sep 03 21:12:57.795150 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2465/5167] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips => generated 110 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:57.802938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.803603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.811592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.812218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.812815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.813924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.814392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.814828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.824250 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3517e15a-9bb5-469c-bccd-2ff6fb20a472 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f" status: 200 len: 342 microversion: 2.1 time: 0.103192 Sep 03 21:12:57.824860 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2703/5168] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f => generated 342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:57.846190 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a863940a-06a2-4c73-bc78-dac491c2ae87 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips/tempest-ServerAddressesTestJSON-1083407184-network" status: 200 len: 95 microversion: 2.1 time: 0.049001 Sep 03 21:12:57.847422 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2466/5169] 10.222.0.16 () {58 vars in 1401 bytes} [Sat Sep 3 21:12:57 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4/ips/tempest-ServerAddressesTestJSON-1083407184-network => generated 95 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 21:12:57.860033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:57.860813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:57.869963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.870588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.871162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.872099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:57.873322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:57.879858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:57.910013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:12:57.968136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4b1820ad-0431-4bb8-adce-70642f1c9fb0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '.version_select at 0x7fae6647f3a0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:58.013337 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4b1820ad-0431-4bb8-adce-70642f1c9fb0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1736549631" status: 202 len: 0 microversion: 2.1 time: 0.048964 Sep 03 21:12:58.014477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2467/5170] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Sep 3 21:12:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1736549631 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:12:58.024085 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1807673-ba60-44a6-8e07-1d22a3da08dc tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 204 len: 0 microversion: 2.1 time: 0.168011 Sep 03 21:12:58.024690 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2704/5171] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:12:57 2022] DELETE /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:58.032851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:58.033506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:58.041183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:58.041687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:58.042297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:58.043012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:58.043647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:58.043880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:58.321635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:58.338908 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5592fe6e-4792-4f68-9a78-18ff320f92f9 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1513 microversion: 2.1 time: 0.304821 Sep 03 21:12:58.339646 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2468/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:58 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:12:58.700008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:58.701492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:58.712115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:58.713925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:58.715998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:58.718353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:58.720060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:58.722927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:58.754202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f11ffb3-4103-4221-8732-5cc81ef1679f", "name": "network-vif-plugged", "status": "completed", "tag": "8c710f8f-c2dc-484b-8bb1-88c1445a054c"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:12:58.767511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:58.767991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:58.768430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:58.792365 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] Creating event network-vif-plugged:8c710f8f-c2dc-484b-8bb1-88c1445a054c for instance 2f11ffb3-4103-4221-8732-5cc81ef1679f on nch2-master-1 Sep 03 21:12:58.797549 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-193711e1-a2bf-46af-82a3-20a96fa0d686 req-0433e3f4-c295-4a47-9f0c-f465fb1abf4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047193 Sep 03 21:12:58.798153 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2469/5173] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:12:58.839277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fcfad73c-d5e5-420c-973e-7ed347ebd04d tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Calling method '.version_select at 0x7fae66405040>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:58.898605 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fcfad73c-d5e5-420c-973e-7ed347ebd04d tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f" status: 200 len: 342 microversion: 2.1 time: 0.063457 Sep 03 21:12:58.907060 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2470/5174] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:12:58 2022] GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f => generated 342 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:12:58.921160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c24fce88-e8de-4137-8644-41ab42445cb5 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Calling method '.version_select at 0x7fae6634f790>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:59.083933 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c24fce88-e8de-4137-8644-41ab42445cb5 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f" status: 202 len: 0 microversion: 2.1 time: 0.167245 Sep 03 21:12:59.084794 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2471/5175] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:12:58 2022] DELETE /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:12:59.093843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e406c53-ff2b-4595-bf1f-620e9e4602e4 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Calling method '.version_select at 0x7fae665d9280>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:59.127035 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb0b51eb-e9a8-48a6-afaf-4512d358c87d tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1464 microversion: 2.1 time: 0.431148 Sep 03 21:12:59.128298 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2705/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:58 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1464 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:59.142315 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-8e406c53-ff2b-4595-bf1f-620e9e4602e4 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] HTTP exception thrown: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e406c53-ff2b-4595-bf1f-620e9e4602e4 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Request method failure captured: Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f HTTP/1.1 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8NYieEhARjAIMe9trTXIJB520qMfr2xC8cFfVgxqN67aDGUHaT_YPCGo47isd8ShAQ0TDuUpd3bfN7uX1AClsR-MTo9-Ox8wRcWJ9dLOdEk06Y5YMDJq1XTBIyCd0c62p4HjNiwFVmcxcJt2cAysmNvGUO7iT6faeZ8pv9w01opiBw Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9cc6c8498d994cbdbdd965a848504ee9 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-VolumesGetTestJSON-1417456213 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9cc6c8498d994cbdbdd965a848504ee9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9cc6c8498d994cbdbdd965a848504ee9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9cc6c8498d994cbdbdd965a848504ee9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9cc6c8498d994cbdbdd965a848504ee9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-VolumesGetTestJSON-1417456213 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9cc6c8498d994cbdbdd965a848504ee9 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-VolumesGetTestJSON-1417456213 Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-VolumesGetTestJSON-1417456213-project Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 85e7703452424a6bacf85a0aee78444c Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-VolumesGetTestJSON-1417456213-project Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: method: Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: exception: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '71daf534-66b3-4647-8017-69ab038feb6f'} Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. (HTTP 404) (Request-ID: req-c9674af1-96e7-4d47-8845-8cd9ed369f74) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 21:12:59.147210 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. Sep 03 21:12:59.152763 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:12:59.157316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8e406c53-ff2b-4595-bf1f-620e9e4602e4 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] Returning 404 to user: Volume 71daf534-66b3-4647-8017-69ab038feb6f could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:12:59.158204 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8e406c53-ff2b-4595-bf1f-620e9e4602e4 tempest-VolumesGetTestJSON-1417456213 tempest-VolumesGetTestJSON-1417456213-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f" status: 404 len: 109 microversion: 2.1 time: 0.068467 Sep 03 21:12:59.161681 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2472/5177] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:12:59 2022] GET /compute/v2.1/os-volumes/71daf534-66b3-4647-8017-69ab038feb6f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:12:59.365804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:12:59.366631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:12:59.379021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:59.379815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:59.380592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:59.381895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:12:59.382505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:12:59.383101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:12:59.766227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:12:59.776760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-45837a56-3720-4c94-9b1c-430ef12929e1 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1513 microversion: 2.1 time: 0.416226 Sep 03 21:12:59.798112 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2706/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:12:59 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:00.162796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:00.163929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:00.178830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.181613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.182074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.182821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.183288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.185905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.368448 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-308cf445-ae8e-4347-adfd-797fb122ce33 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1649 microversion: 2.1 time: 0.219843 Sep 03 21:13:00.386275 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2473/5179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:00 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1649 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:00.395572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:00.396389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:00.405836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.406757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.407390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.408299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.408966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.409562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.812259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:00.813665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:00.820152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.820937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.822195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.823113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.824062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.824741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.892543 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-51d4d772-a8cb-4868-8d59-1983520cf011 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1649 microversion: 2.1 time: 0.500587 Sep 03 21:13:00.897631 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2707/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:00 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1649 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:00.920577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:00.921519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:00.924394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:00.941070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.943495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.944155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:00.945316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:00.947542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:00.948475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:01.287997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:01.302845 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e7cd29de-90e4-4a3f-8a90-450aa8204020 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1513 microversion: 2.1 time: 0.500863 Sep 03 21:13:01.312605 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2474/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:00 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:01.334888 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b32acf8-5bbd-41b2-acb9-80c0d70d7be3 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1649 microversion: 2.1 time: 0.420067 Sep 03 21:13:01.341067 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2708/5182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:00 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1649 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:01.361261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:01.362219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:01.371540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:01.372398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:01.373633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:01.374621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:01.375314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:01.376219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:01.438319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:13:01.464382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d415823-f8cc-4338-8580-3816dc87e8c4", "name": "network-vif-deleted", "tag": "f95861db-3e5a-4a02-b4d3-e3723d4951ee"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:01.497120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:01.502449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:01.503159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:01.534168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] Creating event network-vif-deleted:f95861db-3e5a-4a02-b4d3-e3723d4951ee for instance 6d415823-f8cc-4338-8580-3816dc87e8c4 on nch1-master-1 Sep 03 21:13:01.556650 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b552fa6a-508b-480a-b8b7-6f1807fb64fa req-1ad74a9e-587d-47b4-b2db-35626611677c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099249 Sep 03 21:13:01.557956 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2709/5183] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:13:01.786270 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89720556-8c81-44a6-b6bb-572b868ad4fa tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 204 len: 0 microversion: 2.1 time: 0.425612 Sep 03 21:13:01.787874 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2475/5184] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:13:01 2022] DELETE /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:01.797796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:01.798530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:01.811822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:01.815126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:01.817448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:01.818277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:01.818775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:01.821019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:02.166246 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d6e46904-22d0-4407-92ba-ab6b9f7d4974 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1655 microversion: 2.1 time: 0.370881 Sep 03 21:13:02.169711 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2710/5185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:01 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1655 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:02.341451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:02.342324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:02.350795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:02.351938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:02.352649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:02.354734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:02.355236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:02.355685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:02.451111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:02.456100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:02.456573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:02.457089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lazy-loading 'fault' on Instance uuid 6d415823-f8cc-4338-8580-3816dc87e8c4 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:13:02.564794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1f616143114ef2bc2036efb0d11eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77941b15bab7435fa20336fa6dd26d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:02.573535 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51fcfa34-492f-4f81-a649-37fb7f79da0f tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 200 len: 1307 microversion: 2.1 time: 0.236969 Sep 03 21:13:02.577989 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2476/5186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:02 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 1307 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:03.198436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:03.199797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:03.215038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:03.215611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:03.217671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:03.219219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:03.225001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:03.226713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:03.601038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af8f5613-6f34-42ce-a14f-6517172ba422 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1655 microversion: 2.1 time: 0.406181 Sep 03 21:13:03.605113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:03.605113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] [instance: 6d415823-f8cc-4338-8580-3816dc87e8c4] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:03.613694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:03.614841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:03.616181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:03.618141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:03.619034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:03.619825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:03.636332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2711/5187] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:03 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1655 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:03.637893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] HTTP exception thrown: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Request method failure captured: Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 HTTP/1.1 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8NF5RaVrLeRh8FYso5L7vdBs68KhUX91Kgp7Pf4kojSLhPv4xVeuZidyeypETLIrhsUHQzVlkRTkYj0zD0JWlRCQWIvA8Gaj3pPxEbdSDMjLiVzAgD-lb2h59pLHWK9sN8dnmUfLN7q0AMwHLn5pQcmvD9M3qeG6BTbJzKdUqD29po Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 77941b15bab7435fa20336fa6dd26d58 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerAddressesTestJSON-1641276056 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77941b15bab7435fa20336fa6dd26d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77941b15bab7435fa20336fa6dd26d58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77941b15bab7435fa20336fa6dd26d58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77941b15bab7435fa20336fa6dd26d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerAddressesTestJSON-1641276056 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 77941b15bab7435fa20336fa6dd26d58 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1641276056 Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerAddressesTestJSON-1641276056-project Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: be1f616143114ef2bc2036efb0d11eef Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerAddressesTestJSON-1641276056-project Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '6d415823-f8cc-4338-8580-3816dc87e8c4'} Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:03.641006 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. Sep 03 21:13:03.647665 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:03.649684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] Returning 404 to user: Instance 6d415823-f8cc-4338-8580-3816dc87e8c4 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:13:03.651026 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac719704-9faf-41b6-bc05-55af15dd74f3 tempest-ServerAddressesTestJSON-1641276056 tempest-ServerAddressesTestJSON-1641276056-project] 10.222.0.16 "GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4" status: 404 len: 111 microversion: 2.1 time: 0.055771 Sep 03 21:13:03.652341 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2477/5188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:03 2022] GET /compute/v2.1/servers/6d415823-f8cc-4338-8580-3816dc87e8c4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:13:04.205050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f11ffb3-4103-4221-8732-5cc81ef1679f", "name": "network-vif-deleted", "tag": "8c710f8f-c2dc-484b-8bb1-88c1445a054c"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:04.228742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:04.231529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:04.232876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:04.256801 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] Creating event network-vif-deleted:8c710f8f-c2dc-484b-8bb1-88c1445a054c for instance 2f11ffb3-4103-4221-8732-5cc81ef1679f on nch2-master-1 Sep 03 21:13:04.263324 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8c4eae87-3d23-4d97-bf75-139300d8f593 req-60ea0786-cc5a-422d-9a81-aee5748889e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062711 Sep 03 21:13:04.264725 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2712/5189] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:04.659010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:04.659759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:04.676497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:04.677756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:04.678486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:04.680258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:04.683002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:04.684166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:04.769527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:04.773622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:04.774344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:04.775790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lazy-loading 'fault' on Instance uuid 2f11ffb3-4103-4221-8732-5cc81ef1679f {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:13:05.143771 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5b3c00ef-be0f-418b-96bf-2ad79bca29d8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 200 len: 1454 microversion: 2.1 time: 0.490223 Sep 03 21:13:05.147034 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2478/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:04 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 1454 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:06.168761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:06.170069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 2f11ffb3-4103-4221-8732-5cc81ef1679f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:06.188975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.189707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.190386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.191319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.192091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.192695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.223165 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] HTTP exception thrown: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Request method failure captured: Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f HTTP/1.1 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8M83eO_UAEDfY7_PzglKy2Smty6DPeFE_MDPHCsNsGQWVF1MZg5WC-9p-NbrDJ5yLxuNv_swXkJGrF_8ExtooX-sKhY6vs-2adR5Gkzo-3Tx7oevhwT9T76P6I-fSsZXvwEpwUbxTyPWZF9NhAn3xoeTrTr36-BDalINUy86ZfPHs4 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: d226984bcb6d4be48a4f884c26010afa Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestServerMultinode-138717495 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestServerMultinode-138717495 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: d226984bcb6d4be48a4f884c26010afa Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestServerMultinode-138717495 Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestServerMultinode-138717495-project-admin Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: c276bdddd15f4682a19ba89403a1aefc Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestServerMultinode-138717495-project-admin Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2f11ffb3-4103-4221-8732-5cc81ef1679f'} Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:06.228448 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. Sep 03 21:13:06.233717 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:13:06.235702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Returning 404 to user: Instance 2f11ffb3-4103-4221-8732-5cc81ef1679f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:13:06.239130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-df6384d0-9d05-49ed-8bf1-654ccd2b4624 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f" status: 404 len: 111 microversion: 2.1 time: 0.073398 Sep 03 21:13:06.240253 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2713/5191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:06 2022] GET /compute/v2.1/servers/2f11ffb3-4103-4221-8732-5cc81ef1679f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:13:06.253710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:06.254318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:06.265866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.266363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.271080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.272005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.272500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.272960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.318385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:06.343352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:13:06.457651 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e06114d3-ee03-447d-b487-0b33324c4b64 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 204 len: 0 microversion: 2.1 time: 0.212416 Sep 03 21:13:06.458997 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2479/5192] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:13:06 2022] DELETE /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:06.471008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:06.471697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:06.480762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.481486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.482562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.483561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:06.484197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:06.484751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:06.855038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-96259fa3-28f7-423e-92a1-9322184b8fd8 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1656 microversion: 2.1 time: 0.389850 Sep 03 21:13:06.862366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2714/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:06 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1656 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:07.890769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:07.892839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:07.902771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:07.903278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:07.903755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:07.904477 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:07.904970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:07.905422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:08.114180 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7bda28c1-8404-49bd-9196-54207abb8a76 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1656 microversion: 2.1 time: 0.226364 Sep 03 21:13:08.116205 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2480/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:07 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1656 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:09.142536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:09.148219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:09.175501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:09.176887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:09.177571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:09.178500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:09.179144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:09.179759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:09.592968 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13d6df82-ef52-4976-81ee-a431d6ec8d63 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1656 microversion: 2.1 time: 0.454645 Sep 03 21:13:09.603531 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2715/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:09 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1656 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:10.045467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4d80ca-046b-4366-bb2d-0da54fe34e75", "name": "network-vif-deleted", "tag": "a4e31c72-4be6-4690-bac2-2fbe05b9f121"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:10.071181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:10.084053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:10.085634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:10.129711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] Creating event network-vif-deleted:a4e31c72-4be6-4690-bac2-2fbe05b9f121 for instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 on nch1-master-1 Sep 03 21:13:10.139842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-eecf6f71-e956-43bb-8a05-a34c8297667a req-3dfabff2-4202-44d4-a1f0-0a9e4aed72a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098698 Sep 03 21:13:10.141328 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2481/5196] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:10.622549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:10.623327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:10.635908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:10.637309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:10.639530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:10.640499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:10.641274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:10.641928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:10.736189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:10.736890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:10.737603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:10.738444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lazy-loading 'fault' on Instance uuid 9e4d80ca-046b-4366-bb2d-0da54fe34e75 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:13:10.742305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.893734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab260a3e-0549-4a3f-bd22-7382932dc870 tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 200 len: 1454 microversion: 2.1 time: 0.278425 Sep 03 21:13:10.898116 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2716/5197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:10 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 1454 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:11.920701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:11.921601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] [instance: 9e4d80ca-046b-4366-bb2d-0da54fe34e75] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:11.938421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:11.938921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:11.939566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:11.940468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:11.941126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:11.941761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:11.973625 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] HTTP exception thrown: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Request method failure captured: Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 HTTP/1.1 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8M83eO_UAEDfY7_PzglKy2Smty6DPeFE_MDPHCsNsGQWVF1MZg5WC-9p-NbrDJ5yLxuNv_swXkJGrF_8ExtooX-sKhY6vs-2adR5Gkzo-3Tx7oevhwT9T76P6I-fSsZXvwEpwUbxTyPWZF9NhAn3xoeTrTr36-BDalINUy86ZfPHs4 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: d226984bcb6d4be48a4f884c26010afa Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestServerMultinode-138717495 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d226984bcb6d4be48a4f884c26010afa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestServerMultinode-138717495 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: d226984bcb6d4be48a4f884c26010afa Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestServerMultinode-138717495 Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestServerMultinode-138717495-project-admin Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: c276bdddd15f4682a19ba89403a1aefc Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestServerMultinode-138717495-project-admin Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '9e4d80ca-046b-4366-bb2d-0da54fe34e75'} Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:11.979849 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. Sep 03 21:13:11.985833 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:11.999499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] Returning 404 to user: Instance 9e4d80ca-046b-4366-bb2d-0da54fe34e75 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:13:12.000802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-52eb9030-b8af-43dc-ac4c-01e62ba2e0ca tempest-TestServerMultinode-138717495 tempest-TestServerMultinode-138717495-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75" status: 404 len: 111 microversion: 2.1 time: 0.084838 Sep 03 21:13:12.001843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2482/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:11 2022] GET /compute/v2.1/servers/9e4d80ca-046b-4366-bb2d-0da54fe34e75 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:13:21.885943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-147fbac0-5b54-483c-8597-950cd69f14d1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: .version_select at 0x7fae66963550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-253440261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNa7nPnMI+IlOEtv0eVCHxtewZo1L6Km3hgC/ojN9T9k61eebceGEMnxKMOL4hQIOfyy0V/mVY7Gp9bjc++1Xa58HU+sO2wTxeYy36ydfcdy8rcI9Xq6CQldPrm9gGI6jg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:21.893453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=19 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.928413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.979944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-147fbac0-5b54-483c-8597-950cd69f14d1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:13:22.010218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-147fbac0-5b54-483c-8597-950cd69f14d1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:13:22.056840 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-147fbac0-5b54-483c-8597-950cd69f14d1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.174831 Sep 03 21:13:22.066395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2717/5199] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:13:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:25.100244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-363687516", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "3ac342d3-4172-44d2-ac03-be1b7f782f7a"}], "key_name": "tempest-TestNetworkBasicOps-253440261", "security_groups": [{"name": "tempest-secgroup-smoke-759811766"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:25.118328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:25.119639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:25.644244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] validate_networks() for [('3ac342d3-4172-44d2-ac03-be1b7f782f7a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:13:27.906360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:13:27.909164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:13:27.910211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:13:27.910984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:13:27.912207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:13:27.947172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:27.948633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:27.949390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:27.950996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:27.952280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:27.952998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:27.988047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:13:28.009012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Getting quotas for user 9f792275f53f445ea72b6de441314a49 and project d389730e46ff4f35bf0fec366e2be537. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:13:28.036046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:13:28.040105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:13:28.253623 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d7e9b9a-1d00-42cc-b500-f63b7bd0babc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.164601 Sep 03 21:13:28.257573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2483/5200] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:13:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 3170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:13:28.265685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9a13b08-f2c1-4b2f-b6f3-ca30811bf5f1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:28.269870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f9a13b08-f2c1-4b2f-b6f3-ca30811bf5f1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:28.779981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f9a13b08-f2c1-4b2f-b6f3-ca30811bf5f1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:28.817097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9a13b08-f2c1-4b2f-b6f3-ca30811bf5f1 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1247 microversion: 2.1 time: 0.550377 Sep 03 21:13:28.836586 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2718/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:28 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1247 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:29.035467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Action: 'create', calling method: .version_select at 0x7fae662fe790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:29.061879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Getting quotas for project d09f639e121545c3bc4a91bb3e761f71. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:13:29.071760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Getting quotas for user 079a84f13e1443519dd360c46b296815 and project d09f639e121545c3bc4a91bb3e761f71. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:13:29.197870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Getting quotas for project d09f639e121545c3bc4a91bb3e761f71. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:13:29.211938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Getting quotas for user 079a84f13e1443519dd360c46b296815 and project d09f639e121545c3bc4a91bb3e761f71. Resources: {'server_groups'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:13:29.257809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-696a9992-1f7e-4ae5-9938-b47ae1813444 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.518412 Sep 03 21:13:29.259646 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2484/5202] 10.222.0.16 () {62 vars in 1214 bytes} [Sat Sep 3 21:13:28 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:13:29.272707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-569af542-a606-4e2e-9378-de963d3dec27 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:29.315696 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-569af542-a606-4e2e-9378-de963d3dec27 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.035468 Sep 03 21:13:29.328094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d64f51d6-b5e1-472e-a2bf-b5651c2c2d59 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:29.334060 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2719/5203] 10.222.0.16 () {60 vars in 1193 bytes} [Sat Sep 3 21:13:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:13:29.338982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d64f51d6-b5e1-472e-a2bf-b5651c2c2d59 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c" status: 200 len: 235 microversion: 2.64 time: 0.015370 Sep 03 21:13:29.361783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1bca1dd7-5461-418b-95ea-f14e84574891 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:29.365379 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2485/5204] 10.222.0.16 () {60 vars in 1304 bytes} [Sat Sep 3 21:13:29 2022] GET /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c => generated 235 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:13:29.440062 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1bca1dd7-5461-418b-95ea-f14e84574891 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c" status: 204 len: 0 microversion: 2.64 time: 0.093329 Sep 03 21:13:29.441455 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2720/5205] 10.222.0.16 () {60 vars in 1307 bytes} [Sat Sep 3 21:13:29 2022] DELETE /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 21:13:29.457502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fedc5083-4a98-43e4-bff6-dbb8700d8e77 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:29.466647 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-fedc5083-4a98-43e4-bff6-dbb8700d8e77 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] HTTP exception thrown: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fedc5083-4a98-43e4-bff6-dbb8700d8e77 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Request method failure captured: Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c HTTP/1.1 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8N4UWDuw3cjh7Fu2RUkpXZgrvLbDeaLFsFh4e6OmsNQB9mMD0vG6bsTTRqWnuG_p3m-Uz4s8tq2R9ec9H_xwMf2-NVKsXOV4l0CDWpy5KL9nKVXBS-nokS1XzhHDJlCJeRj7VTBz4Rdilrq2zCxme94p70twZG10ogrz4Lq7WSC_fI Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Openstack-Nova-Api-Version: 2.64 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: d09f639e121545c3bc4a91bb3e761f71 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerGroup264TestJSON-1640850502 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d09f639e121545c3bc4a91bb3e761f71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d09f639e121545c3bc4a91bb3e761f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d09f639e121545c3bc4a91bb3e761f71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d09f639e121545c3bc4a91bb3e761f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerGroup264TestJSON-1640850502 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: d09f639e121545c3bc4a91bb3e761f71 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1640850502 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerGroup264TestJSON-1640850502-project Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 079a84f13e1443519dd360c46b296815 Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerGroup264TestJSON-1640850502-project Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '303d4cd0-eb1e-4fba-8026-ac71e80f2f2c'} Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:29.472196 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. Sep 03 21:13:29.478251 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:13:29.484361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fedc5083-4a98-43e4-bff6-dbb8700d8e77 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] Returning 404 to user: Instance group 303d4cd0-eb1e-4fba-8026-ac71e80f2f2c could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:13:29.486757 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fedc5083-4a98-43e4-bff6-dbb8700d8e77 tempest-ServerGroup264TestJSON-1640850502 tempest-ServerGroup264TestJSON-1640850502-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c" status: 404 len: 117 microversion: 2.64 time: 0.038747 Sep 03 21:13:29.492019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2486/5206] 10.222.0.16 () {60 vars in 1307 bytes} [Sat Sep 3 21:13:29 2022] DELETE /compute/v2.1/os-server-groups/303d4cd0-eb1e-4fba-8026-ac71e80f2f2c => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:13:29.844549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:29.845856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:29.863025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:29.863869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:29.864669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:29.866296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:29.866953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:29.868151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:30.116398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:30.128924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e40420b1-ae0a-4d34-b4b9-3054cdb90125 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1243 microversion: 2.1 time: 0.289076 Sep 03 21:13:30.140225 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2721/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:29 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1243 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:31.168588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:31.170523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:31.183395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:31.188976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:31.189712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:31.190683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:31.192491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:31.198903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:31.412545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:31.422928 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d17b3b39-0b91-480f-bd62-3f6873e360e5 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1305 microversion: 2.1 time: 0.258841 Sep 03 21:13:31.437829 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2487/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:31 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:32.448369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:32.449514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:32.473253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:32.475633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:32.476389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:32.478791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:32.481006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:32.482288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:32.668629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:32.683142 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e83eca89-bb1e-435e-91b3-e12f25371b5f tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1305 microversion: 2.1 time: 0.237311 Sep 03 21:13:32.685708 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2722/5209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:32 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:33.717405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:33.721402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:33.764033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:33.764540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:33.766152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:33.767971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:33.769166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:33.770040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:34.057169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:34.068051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0694402e-d230-4a1e-bccc-aecdff56a8ea tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1305 microversion: 2.1 time: 0.365003 Sep 03 21:13:34.072038 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2488/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:33 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1305 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:35.091862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:35.092473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:35.105478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:35.111858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:35.113745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:35.114823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:35.116630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:35.139003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:36.064502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:36.105659 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0aaa1cc3-6eb1-4f0a-85ab-0f7b7b969490 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 1.016943 Sep 03 21:13:36.109458 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2723/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:35 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:36.718171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728", "tag": "8a98cd44-3665-4a75-b369-5dbd97c22f93"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:36.753940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:36.753940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:36.753940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:36.784945 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] Creating event network-changed:8a98cd44-3665-4a75-b369-5dbd97c22f93 for instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 on nch1-master-1 Sep 03 21:13:36.796326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-17ca92a2-e5d1-4cf1-a8c9-4f72d0f7525f req-df78ca31-82ae-47e6-9ba5-172d531d92ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081674 Sep 03 21:13:36.799563 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2489/5212] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:37.141620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:37.142472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:37.153455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:37.158746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:37.159425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:37.165898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:37.167586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:37.170226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:37.442807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:37.450960 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-16e8ea9d-044d-4364-9363-579bb938dd4e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.314154 Sep 03 21:13:37.451553 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2724/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:37 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:38.483865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:38.485662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:38.495681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.510376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:38.513055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:38.514166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:38.515853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:38.518296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:38.518924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:38.819892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:38.829727 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6a49fe9f-4431-4500-90b8-e5c786179b20 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.354206 Sep 03 21:13:38.831138 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2490/5214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:38 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:39.859866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:39.860656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:39.870862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:39.889400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:39.891722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:39.894601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:39.896798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:39.900428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:39.901234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:40.462173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:40.485124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-96f441c4-3419-447f-9fc9-8754336bece7 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.629453 Sep 03 21:13:40.487576 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2725/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:39 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:41.511695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:41.514542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:41.518763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=14 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:41.541045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:41.543045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:41.545985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:41.548267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:41.549055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:41.551346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:41.888058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:41.901985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-521d4700-3ea9-4e58-85c0-6b64187737c6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.394945 Sep 03 21:13:41.912961 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2491/5216] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:41 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:42.928957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:42.930830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:42.939157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:42.940208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:42.941223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:42.942292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:42.942994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:42.943714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:43.419980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:43.429267 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e05f74f2-d6dd-476e-a388-cda00cb7d708 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.504878 Sep 03 21:13:43.429972 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2726/5217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:42 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:43.941902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728", "name": "network-vif-plugged", "status": "completed", "tag": "8a98cd44-3665-4a75-b369-5dbd97c22f93"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:43.959629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:43.960129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:43.960581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:43.986530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] Creating event network-vif-plugged:8a98cd44-3665-4a75-b369-5dbd97c22f93 for instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 on nch1-master-1 Sep 03 21:13:43.992172 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4376d2b6-3c4e-437c-8d7e-16026231948b req-e8364276-034d-4fcf-9b71-c815795fddbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053897 Sep 03 21:13:43.993246 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2492/5218] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:44.457051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:44.457686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:44.467287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:44.467838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:44.468295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:44.469084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:44.469556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:44.470076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:44.960423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:44.970582 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-577133ef-5cd1-4229-852b-ebb8288487af tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1372 microversion: 2.1 time: 0.518168 Sep 03 21:13:44.973326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2727/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:44 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1372 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:45.999080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:45.999817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:46.016777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:46.016777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:46.017247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:46.027689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:46.029249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:46.031000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:46.298322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:46.318017 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e76910bc-61d6-42ce-8f8a-3965452ec4bd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1542 microversion: 2.1 time: 0.324214 Sep 03 21:13:46.322729 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2493/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:45 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1542 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:46.343955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:46.345723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:46.376233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:46.377993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:46.379278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:46.381451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:46.383271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:46.383723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:47.349929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:47.363521 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8273e4c9-23b2-4303-a3f0-21997573b055 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1542 microversion: 2.1 time: 1.023978 Sep 03 21:13:47.380311 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2728/5221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:46 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1542 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:48.149158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1545621525", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:48.978510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] validate_networks() for [('463eec63-3506-4a17-a53f-17e056f6416a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:13:50.272722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:13:50.273955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:13:50.274620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:13:50.275695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:13:50.276290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:13:50.298054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:50.298560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:50.299012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:50.302371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:50.302855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:50.303325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:50.366246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Getting quotas for project 42698a69a75f4d6583e8dd7df3926aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:13:50.375559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Getting quotas for user ec4d4dfdda4f4f86a6cffadc35d9e68e and project 42698a69a75f4d6583e8dd7df3926aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:13:50.412173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:13:50.415721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:13:50.508243 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8f186104-964b-4088-87d1-3dda7ce3113c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.928814 Sep 03 21:13:50.508931 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2494/5222] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:13:50.521001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f78395ce-89a6-4b63-ad53-5afd6e2d3acf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:50.523801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f78395ce-89a6-4b63-ad53-5afd6e2d3acf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:51.096048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f78395ce-89a6-4b63-ad53-5afd6e2d3acf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:51.106866 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f78395ce-89a6-4b63-ad53-5afd6e2d3acf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1217 microversion: 2.1 time: 0.588042 Sep 03 21:13:51.109625 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2729/5223] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:50 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1217 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:51.571130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728", "tag": "8a98cd44-3665-4a75-b369-5dbd97c22f93"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:51.611839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:51.613927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:51.615209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:51.670440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] Creating event network-changed:8a98cd44-3665-4a75-b369-5dbd97c22f93 for instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 on nch1-master-1 Sep 03 21:13:51.691961 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-edda7882-78c4-431f-811f-99f6e724354d req-08789f98-4bfc-48eb-82cf-7b0c557ea054 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123500 Sep 03 21:13:51.694531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2495/5224] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:52.140889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:52.141557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:52.151441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.154327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:52.154830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:52.156132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:52.157075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:52.158684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:52.159108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:52.165416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=49 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.661493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:52.674374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b27d83a5-1a8f-423c-a47b-998799e78f9f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1269 microversion: 2.1 time: 0.537955 Sep 03 21:13:52.678363 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2730/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:52 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1269 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:53.708324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:53.709096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:53.724705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:53.725604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:53.726211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:53.726964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:53.728602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:53.729084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:53.892434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:53.901749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ca9b038d-c58a-45b9-8ef9-7b18419d4d67 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1275 microversion: 2.1 time: 0.197738 Sep 03 21:13:53.903462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2496/5226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:53 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:54.929336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:54.929949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:54.942774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:54.948743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:54.949233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:54.950510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:54.951029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:54.951465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:55.278324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:55.290441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0f3f0075-6067-46ba-a23d-8bdb3bcfa0b1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.365081 Sep 03 21:13:55.291582 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2731/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:54 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:56.061503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:13:56.077679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.080499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:56.081282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:56.081946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:56.087510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=47 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.097534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] Creating event network-changed:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch2-master-1 Sep 03 21:13:56.102692 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-051e4734-e4dd-40d6-b7c3-a67b078ad119 req-14664f26-19b8-46ea-b5c7-0645eb00ec4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044979 Sep 03 21:13:56.103701 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2497/5228] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:13:56.321257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:56.322082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:56.329150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:56.329831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:56.330280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:56.330998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:56.331604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:56.332178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:56.851727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:56.863620 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63c51794-e0a3-4979-a222-28af44162773 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.546187 Sep 03 21:13:56.864322 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2732/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:56 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:57.890819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:57.892729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:57.905996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:57.907126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:57.912089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:57.914023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:57.915572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:57.919755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:58.221884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:58.231534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f2950f9-4d45-45cf-bbe1-0331f9b58c00 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.347370 Sep 03 21:13:58.232162 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2498/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:57 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:59.259057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:13:59.259696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:13:59.279005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:59.279444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:59.279899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:59.280677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:13:59.281115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:13:59.281549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:13:59.466282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:13:59.475180 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-663f978e-f1a0-46d5-8a86-ba0e01b60ff3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.223118 Sep 03 21:13:59.475783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2733/5231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:13:59 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:00.500688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:00.501680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:00.509260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:00.511189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:00.514164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:00.518283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:00.519777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:00.520734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:00.521960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:00.522742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:00.897127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:00.914388 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a226daf0-738d-4988-9478-be9fb8178444 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.418103 Sep 03 21:14:00.915575 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2499/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:00 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:01.938991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:01.940266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:01.947006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:01.948799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:01.949546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:01.950273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:01.951182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:01.952144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:01.952783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:02.224605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:02.233256 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-52f34dbb-0a39-4fa0-86be-46e175a857e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.299197 Sep 03 21:14:02.252934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2734/5233] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:01 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:02.981482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "name": "network-vif-plugged", "status": "completed", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:03.000014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:03.000534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:03.000976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:03.018861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] Creating event network-vif-plugged:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch2-master-1 Sep 03 21:14:03.026540 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bb689726-ae20-4aa8-9a00-c1687f1f77e6 req-5584c3fa-b4bc-4e68-a142-80577897e54e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049420 Sep 03 21:14:03.028628 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2500/5234] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:14:03.266957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:03.268300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:03.282060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:03.284671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:03.285932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:03.288333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:03.290908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:03.292089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:03.531406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:03.539636 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3d0fb8f7-0aa8-49c1-8d76-5e76358ed15c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1317 microversion: 2.1 time: 0.277798 Sep 03 21:14:03.540459 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2735/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:03 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:04.565366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:04.566223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:04.582024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:04.582724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:04.583734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:04.585060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:04.586448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:04.587218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:05.234023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:05.246146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8ce794c8-1f68-413e-87af-1a8cbb6e8544 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.686356 Sep 03 21:14:05.248019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2501/5236] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:04 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:05.389418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1973020872", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:05.470487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] validate_networks() for [('463eec63-3506-4a17-a53f-17e056f6416a', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:14:06.073272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:14:06.074998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:14:06.075690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:14:06.076350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:14:06.077014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:14:06.086772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:06.087487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:06.088164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:06.089214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:06.089797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:06.090436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:06.154282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Getting quotas for project 42698a69a75f4d6583e8dd7df3926aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:14:06.178275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Getting quotas for user ec4d4dfdda4f4f86a6cffadc35d9e68e and project 42698a69a75f4d6583e8dd7df3926aa6. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:14:06.197026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:14:06.199756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:14:06.250912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-940b0624-cf8c-4bc4-b0b5-6e70406d2d30 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865542 Sep 03 21:14:06.258071 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2736/5237] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:14:06.263977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b04657d-35dd-4e33-a3d3-f8f2831c44da tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:06.265011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b04657d-35dd-4e33-a3d3-f8f2831c44da tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:06.384557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b04657d-35dd-4e33-a3d3-f8f2831c44da tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:06.401326 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b04657d-35dd-4e33-a3d3-f8f2831c44da tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1217 microversion: 2.1 time: 0.136667 Sep 03 21:14:06.402060 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2502/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:06 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:07.432863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:07.435005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:07.451315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:07.451825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:07.452282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:07.453029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:07.453492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:07.453945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:07.528288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:07.542520 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cda9cd4e-033b-4875-887c-a9ba4dd0bb68 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1269 microversion: 2.1 time: 0.120564 Sep 03 21:14:07.543370 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2737/5239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:07 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:08.569112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:08.571781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:08.586273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:08.588243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:08.589037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:08.590581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:08.593505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:08.593970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:08.741478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:08.754038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae04ff36-5f6b-4bbe-842b-a703369790b5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1275 microversion: 2.1 time: 0.188148 Sep 03 21:14:08.755185 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2503/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:08 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:09.777890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:09.778507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:09.792811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:09.799035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:09.800056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:09.803269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:09.804035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:09.806075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:10.091614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:10.108826 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-286a1be2-77e4-4d34-9a85-7f52f805ae21 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.331020 Sep 03 21:14:10.108826 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2738/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:09 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:10.232939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4696eb57-f738-4d81-b1fc-b8018eaa655b", "tag": "736aac43-6447-4561-9839-d9c478b906de"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:10.263234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:10.263738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:10.264189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:10.284021 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] Creating event network-changed:736aac43-6447-4561-9839-d9c478b906de for instance 4696eb57-f738-4d81-b1fc-b8018eaa655b on nch1-master-1 Sep 03 21:14:10.296171 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9be96b01-2c24-4849-afc4-0a85dddbb5ba req-f7ba4d35-6b58-43e8-a6bc-7fcfb09c901b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068742 Sep 03 21:14:10.297232 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2504/5242] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:14:11.132547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:11.133568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:11.151993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:11.158967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:11.159526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:11.160642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:11.161395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:11.161825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:11.328745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:11.342329 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61f38f46-132b-4e47-a282-58a070a3f459 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.213984 Sep 03 21:14:11.343169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2739/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:11 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:12.367599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:12.368301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:12.385787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:12.386294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:12.387558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:12.388440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:12.389313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:12.390173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:12.673960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:12.683243 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af8031c7-b642-45f3-92d9-2d16d2e047c1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.321088 Sep 03 21:14:12.685057 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2505/5244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:12 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:13.712052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:13.713233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:13.721026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:13.721604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:13.722124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:13.722906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:13.723588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:13.724089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:14.034621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:14.042989 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d749f63-3056-4b83-9382-004c470d3e62 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.335273 Sep 03 21:14:14.059511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2740/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:13 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:15.069708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:15.071014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:15.081202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:15.081921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:15.082835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:15.083687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:15.084266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:15.084921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:15.316850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:15.330127 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5eb87855-5139-4fde-98b2-0ec6c3570765 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.265602 Sep 03 21:14:15.331736 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2506/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:15 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:16.354757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:16.356212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:16.367950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.369027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.371881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:16.372526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:16.375282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:16.376215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:16.377247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:16.378489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:16.547248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:16.567485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dcdf1b1a-69ff-4d8c-bc7b-858726d683b2 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.217972 Sep 03 21:14:16.568984 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2741/5247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:16 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:17.594034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:17.595111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:17.598188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.606126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:17.606637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:17.607106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:17.607990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:17.608342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:17.608782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:17.770102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:17.779492 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-acb77ca0-c8f1-4b5f-b0fa-22c8da9ce2af tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.191913 Sep 03 21:14:17.780877 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2507/5248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:17 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:18.432995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696eb57-f738-4d81-b1fc-b8018eaa655b", "name": "network-vif-plugged", "status": "completed", "tag": "736aac43-6447-4561-9839-d9c478b906de"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:18.451394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:18.452408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:18.453278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:18.478741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] Creating event network-vif-plugged:736aac43-6447-4561-9839-d9c478b906de for instance 4696eb57-f738-4d81-b1fc-b8018eaa655b on nch1-master-1 Sep 03 21:14:18.486009 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d54f14e8-e9fa-4f3f-9c17-08c5ceb276b9 req-257a732a-2d18-400c-b4a2-5d34481db63b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060739 Sep 03 21:14:18.487082 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2742/5249] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:14:18.810772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:18.811676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:18.827914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:18.829738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:18.831501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:18.833801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:18.836854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:18.837535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:19.133549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:19.147985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e13b5ba-9a6c-4c47-9a4a-c98a4436c70a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.344893 Sep 03 21:14:19.149867 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2508/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:18 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:20.175929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:20.184362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:20.196974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:20.197669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:20.198493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:20.200442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:20.201165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:20.202574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:20.471426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:20.508790 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d7c2d80f-e3fc-4605-80aa-fa6e5eda84e9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1317 microversion: 2.1 time: 0.340588 Sep 03 21:14:20.513179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2743/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:20 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:21.541142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:21.541142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:21.553945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:21.554656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:21.555105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:21.556000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:21.556464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:21.557079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:21.907329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:21.917215 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aec0b02f-fee9-4b26-9af8-8ed2ac0e081a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1506 microversion: 2.1 time: 0.384140 Sep 03 21:14:21.946149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2509/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:21 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:21.966470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:21.967023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:21.989248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:21.989760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:21.990211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:21.990948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:21.991427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:21.991856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:22.039389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:14:22.164500 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f261d17f-5a93-4e31-b6ab-0be330b60191 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 204 len: 0 microversion: 2.1 time: 0.203342 Sep 03 21:14:22.166914 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2744/5253] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:14:21 2022] DELETE /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:22.176028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:22.176660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:22.191106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:22.192451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:22.193175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:22.194055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:22.194512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:22.195117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:22.448276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:22.458170 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5937d15d-d6da-4435-9528-231e4d2abae7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1512 microversion: 2.1 time: 0.286393 Sep 03 21:14:22.459447 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2510/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:22 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:23.303527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:23.305948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:23.314910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.327058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:23.327577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:23.328030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:23.328767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:23.329267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:23.329709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:23.388120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.457645 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c32331a5-03b5-4607-907f-c327438ea924 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728/action" status: 200 len: 24566 microversion: 2.1 time: 0.158676 Sep 03 21:14:23.458669 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2745/5255] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:23 2022] POST /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728/action => generated 24566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:14:23.485233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:23.486575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:23.494302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:23.495136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:23.495733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:23.497170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:23.499878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:23.500525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:23.923847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:23.936763 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-908ea5a5-bbdd-49d0-820c-5fd0fe9570f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1512 microversion: 2.1 time: 0.456338 Sep 03 21:14:23.941068 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2511/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:23 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:24.970321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:24.971666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:24.984329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:24.988870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:24.990022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:24.992261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:24.994202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:24.995673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:25.146163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696eb57-f738-4d81-b1fc-b8018eaa655b", "name": "network-vif-deleted", "tag": "736aac43-6447-4561-9839-d9c478b906de"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:25.158851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:25.160580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:25.161245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:25.179068 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] Creating event network-vif-deleted:736aac43-6447-4561-9839-d9c478b906de for instance 4696eb57-f738-4d81-b1fc-b8018eaa655b on nch1-master-1 Sep 03 21:14:25.196787 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-aec41740-8fb4-4249-9770-0c1bf160da07 req-4d2ada8f-0ec4-486c-b802-09251b910d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053699 Sep 03 21:14:25.198656 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2512/5257] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:14:25.206486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:25.221985 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1520cf73-1b03-4975-bc01-875d0cb8c174 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 200 len: 1470 microversion: 2.1 time: 0.253233 Sep 03 21:14:25.222910 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2746/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:24 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:26.248764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:26.249533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:26.256433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=34 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.258148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:26.258630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:26.259251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:26.263012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:26.264116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:26.264577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:26.290153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=74 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.296275 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b HTTP/1.1 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4696eb57-f738-4d81-b1fc-b8018eaa655b'} Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:26.298035 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:26.301522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e2f05f0-6e96-4505-8911-c0b02f48620b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 404 len: 111 microversion: 2.1 time: 0.058720 Sep 03 21:14:26.306914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2513/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:26 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:26.314134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:26.314794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:26.325410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:26.325921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:26.327559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:26.328321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:26.328795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:26.329435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:26.922367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:26.930731 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2764674c-a975-44db-b893-5a9fcbe0267c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.623919 Sep 03 21:14:26.936965 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2747/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:26 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:27.081017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40997c4d-fa5b-4145-b1d8-e1363186a7ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40997c4d-fa5b-4145-b1d8-e1363186a7ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 163 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": 12345, "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 12345 Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:27.085032 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 03 21:14:27.088259 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:27.090555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40997c4d-fa5b-4145-b1d8-e1363186a7ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:27.094242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40997c4d-fa5b-4145-b1d8-e1363186a7ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017169 Sep 03 21:14:27.095623 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2514/5261] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:27.103650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:27.104361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:27.113691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:27.114557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:27.116072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:27.118542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:27.119220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:27.119866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:27.386186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:27.400434 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-998c8ed5-b239-4495-a8f3-38364d00e7c4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.300567 Sep 03 21:14:27.405400 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2748/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:27 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:27.427546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:27.429511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:27.438903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:27.439565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:27.440019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:27.440730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:27.441366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:27.442169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:27.668803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:27.689186 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0557b9b9-2d91-4e0c-934a-d897bf851225 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.268154 Sep 03 21:14:27.690012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2515/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:27 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:29.247107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:29.247741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:29.260564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:29.261253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:29.263839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:29.264917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:29.267213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:29.267957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:29.546071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:29.554192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afe1eef0-e12d-4078-81ae-631736954c26 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.311545 Sep 03 21:14:29.554852 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2749/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:29.585144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:29.585950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:29.594682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:29.595291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:29.595979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:29.596983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:29.597787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:29.598412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:29.940491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:29.951106 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64b55713-7e79-45b9-ac77-3a55c7a25c2f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.370302 Sep 03 21:14:29.951826 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2516/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:31.416654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:31.418685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:31.426125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:31.426926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:31.427579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:31.428541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:31.429133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:31.429778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:31.745510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:31.755328 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3fbd1ee6-965b-4e7e-815b-0708eb90b392 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.342500 Sep 03 21:14:31.757069 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2750/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:31 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:31.781303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:31.781932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:31.788500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:31.789341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:31.789962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:31.790828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:31.791486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:31.792101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:31.955566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:31.967036 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d64173ea-8dbe-42ad-b58f-877435e5d021 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.190749 Sep 03 21:14:31.968980 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2517/5267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:31 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:32.031611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5a56df9-5eac-4848-9295-3ee5dc70ece3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2050256360", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5a56df9-5eac-4848-9295-3ee5dc70ece3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 492 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2050256360", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2050256360', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.036659 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e5a56df9-5eac-4848-9295-3ee5dc70ece3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:32.039892 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e5a56df9-5eac-4848-9295-3ee5dc70ece3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011039 Sep 03 21:14:32.042000 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2751/5268] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:32 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:32.048011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:32.048629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:32.054657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:32.055156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:32.055592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:32.056688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:32.057573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:32.058602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:32.285509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:32.295834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b95f44f-6b32-4b18-a0eb-f4e5988e6c58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.251409 Sep 03 21:14:32.296914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2518/5269] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:32 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:32.318917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:32.319780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:32.327268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:32.328014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:32.328678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:32.329610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:32.330359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:32.330979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:32.900580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:32.909381 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f942f583-c159-4194-ae21-00a8331ba89d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.594378 Sep 03 21:14:32.910045 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2752/5270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:32 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:32.975819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9b76fab-cd50-4971-8610-061ba9a978fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9b76fab-cd50-4971-8610-061ba9a978fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 416 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.980087 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9b76fab-cd50-4971-8610-061ba9a978fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9b76fab-cd50-4971-8610-061ba9a978fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010693 Sep 03 21:14:32.984515 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2519/5271] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:14:32.993197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:32.993933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:33.000594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.001143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.001642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.002372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.003018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.003452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.210475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:33.221476 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8704a5e1-5d1e-45e9-87a6-b7c545cae438 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.234156 Sep 03 21:14:33.237667 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2753/5272] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:32 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:33.248658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:33.249328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:33.256861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.257702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.258246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.259081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.259560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.260079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.472359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:33.482054 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4fa8f1c5-7748-4c96-bf51-ddd4fafac408 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.238661 Sep 03 21:14:33.483707 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2520/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:33 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:33.551971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b66dcc0-7b92-4bc7-9722-3dc280741e4a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1861141965", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": -1, "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:33.568072 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6b66dcc0-7b92-4bc7-9722-3dc280741e4a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Flavor -1 could not be found. Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b66dcc0-7b92-4bc7-9722-3dc280741e4a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 206 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1861141965", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": -1, "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: exception: Flavor -1 could not be found. Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1861141965', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': -1, 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:33.570378 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 03 21:14:33.573928 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:33.577502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6b66dcc0-7b92-4bc7-9722-3dc280741e4a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:33.578511 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6b66dcc0-7b92-4bc7-9722-3dc280741e4a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032013 Sep 03 21:14:33.579221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2754/5274] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:33 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 21:14:33.588737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:33.591090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:33.601625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.602505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.603515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.604498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.605880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.608297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.774700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:33.783252 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee255a83-bfaf-4279-be5c-d0f06b02271d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.199540 Sep 03 21:14:33.784150 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2521/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:33 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:33.809309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:33.809932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:33.816050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.816544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.817033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:33.817747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:33.818210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:33.818641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.113148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:34.143498 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-744d7ee5-8558-4301-a592-2592a02846cd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.339923 Sep 03 21:14:34.144096 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2755/5276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:33 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:34.220491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef5ebae6-09d3-4712-94ff-d2484c18aa09 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1694815379", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef5ebae6-09d3-4712-94ff-d2484c18aa09 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 173 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1694815379", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1694815379', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi -1 Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:34.225339 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ef5ebae6-09d3-4712-94ff-d2484c18aa09 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:34.231851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ef5ebae6-09d3-4712-94ff-d2484c18aa09 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.011693 Sep 03 21:14:34.237716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:34.238355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:34.245626 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2522/5277] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:34.249717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.250420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.251034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.252284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.252961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.253554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.539794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:34.553757 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b015e5ab-f9c0-4809-b3bc-a3422966efc4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.320488 Sep 03 21:14:34.554778 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2756/5278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:34 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:34.580583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:34.581607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:34.596861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.597660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.598178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.598979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.599515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.600046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.812649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:34.821211 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8702280d-713d-4f8c-92d6-f0fee53a3b98 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.245112 Sep 03 21:14:34.822102 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2523/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:34 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:34.898052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ca60453-22ad-4ddd-987c-79b24377c6a3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1020729589", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:34.904316 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4ca60453-22ad-4ddd-987c-79b24377c6a3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ca60453-22ad-4ddd-987c-79b24377c6a3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 216 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1020729589", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1020729589', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:34.905934 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ca60453-22ad-4ddd-987c-79b24377c6a3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4ca60453-22ad-4ddd-987c-79b24377c6a3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.014025 Sep 03 21:14:34.909278 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2757/5280] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:34.916583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:34.917451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:34.924973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.925725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.926261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:34.927038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:34.927753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:34.928198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:35.087985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:35.101777 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa3d0741-45be-4598-8a09-80d10b4125b9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.189357 Sep 03 21:14:35.102466 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2524/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:34 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:35.141442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:35.142606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:35.170231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:35.171943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:35.172924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:35.173964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:35.174889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:35.176433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:35.430762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:35.440637 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-839c6a62-8e16-42f5-a523-92e2deeaf4cc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.314608 Sep 03 21:14:35.441498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2758/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:35 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:35.572187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893127754", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-key-1960949953", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:35.638056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] validate_networks() for [('463eec63-3506-4a17-a53f-17e056f6416a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:14:35.956875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Invalid key_name provided. Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 247 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893127754", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-key-1960949953", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid key_name provided. Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1893127754', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'key_name': 'tempest-key-1960949953', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1960949953 not found for user ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:35.958942 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid key_name provided. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-30c5dca7-d422-4641-9058-9aeca038c6de tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.392900 Sep 03 21:14:35.966250 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2525/5283] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:35 2022] POST /compute/v2.1/servers => generated 70 bytes in 394 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 03 21:14:35.972764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:35.974115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:35.989660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:35.990185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:35.990840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:35.991649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:35.994347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:35.995888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:36.269331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:36.279248 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5f4fd24-5f52-47f4-ac7a-c29ea865073c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.312444 Sep 03 21:14:36.286636 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2759/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:35 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:36.314671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:36.315291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:36.324186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:36.324863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:36.325505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:36.326530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:36.327223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:36.328132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:36.493694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:36.507038 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5be5096c-ef81-4dfe-872d-29f35660e3c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.195606 Sep 03 21:14:36.509421 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2526/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:36 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:36.677847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1563415512", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:36.831416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.security_group_api [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Neutron security group does_not_exist not found {{(pid=140520) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 03 21:14:36.832232 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 258 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1563415512", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1563415512', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 03 21:14:36.870877 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:36.874996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:36.878655 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9d0cbc29-0101-49fa-afdc-799235baef3a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.201792 Sep 03 21:14:36.882429 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2760/5286] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:36 2022] POST /compute/v2.1/servers => generated 106 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:36.889265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:36.890829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:36.898408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:36.899112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:36.899696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:36.900978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:36.901574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:36.903055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.227454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:37.237189 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a186442a-610c-4428-a996-b8ca6fecb250 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.353588 Sep 03 21:14:37.237897 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2527/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:36 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:37.261972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:37.262891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:37.273218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.273882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.274436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.275288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.275860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.276481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.422103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:37.441356 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84fdc107-1652-4e00-a898-108a2b6d13e8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.183714 Sep 03 21:14:37.456926 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2761/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:37 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:37.479185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:37.481836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: d8f4f299-5819-4528-89a9-cca5d523a0ac] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:37.504762 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/d8f4f299-5819-4528-89a9-cca5d523a0ac HTTP/1.1 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd8f4f299-5819-4528-89a9-cca5d523a0ac'} Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:37.508692 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. Sep 03 21:14:37.512773 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:37.515580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance d8f4f299-5819-4528-89a9-cca5d523a0ac could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:37.519441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2627acff-d111-490d-b62f-5d35b0f3c2a1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8f4f299-5819-4528-89a9-cca5d523a0ac" status: 404 len: 111 microversion: 2.1 time: 0.045679 Sep 03 21:14:37.524155 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2528/5289] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:14:37 2022] DELETE /compute/v2.1/servers/d8f4f299-5819-4528-89a9-cca5d523a0ac => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:37.533893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:37.535333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:37.544477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.545427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.545975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.547752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.548538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.549204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.782206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:37.790377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98bcd05f-e189-4d44-9ccc-43f9f382c360 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.264592 Sep 03 21:14:37.801534 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2762/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:37 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:37.829087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:37.830044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:37.838077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.838864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.839473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:37.840929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:37.841581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:37.842109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:38.118824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:38.130340 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ada6ebce-89ac-4ee9-b799-1b674c139c07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.317950 Sep 03 21:14:38.132813 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2529/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:37 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:38.157608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:38.158386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 21:14:38.159086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 9223372036854775808 could not be found. Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9223372036854775808'} Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:38.161029 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:38.165160 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:38.165160 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:38.165160 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:38.165160 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 03 21:14:38.165160 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:38.166263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:38.167295 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-559791d1-90ab-4d73-9350-ed0625a9764e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014642 Sep 03 21:14:38.177888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:38.179450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:38.185652 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2763/5292] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Sep 3 21:14:38 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:14:38.187717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:38.188391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:38.189105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:38.191350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:38.192006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:38.192455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:38.428160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:38.440713 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4e411f2-1169-4bd2-b605-50224e07bba1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.267509 Sep 03 21:14:38.442584 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2530/5293] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:38 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:38.467162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:38.467959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:38.496330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:38.497357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:38.497777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:38.508840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:38.508840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:38.508840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:39.109215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:39.126204 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a2dda184-7815-477f-8e57-de7cc9adc638 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.663875 Sep 03 21:14:39.141499 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2764/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:38 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:39.151846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:39.153329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Failed to fetch instance by id -1 {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 03 21:14:39.154359 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance -1 could not be found. Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance -1 could not be found. Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '-1'} Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:39.157808 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:39.162362 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:39.162362 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:39.162362 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 03 21:14:39.162362 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.163835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:39.166299 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-669a0369-b64e-4d0c-952e-703d1bfccf58 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.019102 Sep 03 21:14:39.173895 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2531/5295] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Sep 3 21:14:39 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:14:39.180758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:39.182011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:39.194372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:39.196909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:39.199362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:39.200522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:39.201289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:39.202358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:39.568560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:39.592967 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55c48f46-a2d7-4a0f-8389-5d621e1ebfb5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.417424 Sep 03 21:14:39.595168 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2765/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:39 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:39.619483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:39.620414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:39.629953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:39.630771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:39.631438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:39.632388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:39.633075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:39.633740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:39.919968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:39.946755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f168f9e1-9978-4da3-9ffb-e8fd7693a1a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.329889 Sep 03 21:14:39.949373 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2532/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:39 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:39.970496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:39.971324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: ec65bd37-b560-4fac-926f-608675daa6ac] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:39.978734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/ec65bd37-b560-4fac-926f-608675daa6ac/action HTTP/1.1 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 19 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: {"forceDelete": {}} Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'ec65bd37-b560-4fac-926f-608675daa6ac', 'body': {'forceDelete': {}}} Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:39.988425 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:39.993374 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:39.993374 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:39.993374 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. Sep 03 21:14:39.993374 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:39.994596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance ec65bd37-b560-4fac-926f-608675daa6ac could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:39.996285 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6f0fed0c-758f-419b-af2c-356d7afbbfc9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/ec65bd37-b560-4fac-926f-608675daa6ac/action" status: 404 len: 111 microversion: 2.1 time: 0.029185 Sep 03 21:14:39.997338 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2766/5298] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:39 2022] POST /compute/v2.1/servers/ec65bd37-b560-4fac-926f-608675daa6ac/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:40.006727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:40.007588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:40.015421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.021727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.022193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.022995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.023665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.024839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.352135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:40.365496 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9dc0f76e-9752-4947-9852-dc00341e4964 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.362494 Sep 03 21:14:40.366097 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2533/5299] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:40 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:40.395767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:40.396399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:40.404318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.405080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.405684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.406590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.407223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.407660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.696129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:40.716034 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4367743e-9589-4eac-a299-73ddfbecdb89 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.324274 Sep 03 21:14:40.728975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2767/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:40 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:40.740430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:40.743318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 408984bf-d073-48ac-aefa-ee08af708d65] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:40.750302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/408984bf-d073-48ac-aefa-ee08af708d65/action HTTP/1.1 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 39 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: {"os-getConsoleOutput": {"length": 10}} Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '408984bf-d073-48ac-aefa-ee08af708d65', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:40.760001 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. Sep 03 21:14:40.764117 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:40.767788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 408984bf-d073-48ac-aefa-ee08af708d65 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:40.768685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e00410dc-5e66-42e3-a246-c55d1af9a2e4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/408984bf-d073-48ac-aefa-ee08af708d65/action" status: 404 len: 111 microversion: 2.1 time: 0.032442 Sep 03 21:14:40.769481 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2534/5301] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:40 2022] POST /compute/v2.1/servers/408984bf-d073-48ac-aefa-ee08af708d65/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:40.779261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:40.779895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:40.786472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.787191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.787642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.788365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:40.788833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:40.789293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:40.794069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:41.155648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:41.164940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9f0c719d-f7c8-425a-8290-5c885ca90788 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.390856 Sep 03 21:14:41.176969 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2768/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:40 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:41.197388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:41.198012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:41.206019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.206506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.207187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:41.208078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.208718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.209368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:41.454192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:41.464878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d397375-504e-42b1-8c12-ee191bd58cfe tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.271559 Sep 03 21:14:41.466259 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2535/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:41 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:41.493538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:41.494553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 5104adcf-8a14-4e55-bc72-181428bb1e94] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:41.502071 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/5104adcf-8a14-4e55-bc72-181428bb1e94 HTTP/1.1 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '5104adcf-8a14-4e55-bc72-181428bb1e94'} Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:41.503976 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:41.507625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:41.507625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:41.507625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:41.507625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. Sep 03 21:14:41.507625 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:41.509303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 5104adcf-8a14-4e55-bc72-181428bb1e94 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:41.510385 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0185701-2d19-4f04-898d-3ef39d713903 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/5104adcf-8a14-4e55-bc72-181428bb1e94" status: 404 len: 111 microversion: 2.1 time: 0.021754 Sep 03 21:14:41.511964 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2769/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:41 2022] GET /compute/v2.1/servers/5104adcf-8a14-4e55-bc72-181428bb1e94 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:41.521008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:41.521640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:41.528014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.528520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.529138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:41.529927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.530334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.530772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:41.783213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:41.791575 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4e89446a-96be-406a-825a-ccf19dce79c3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.275311 Sep 03 21:14:41.808927 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2536/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:41 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:41.817314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:41.817932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:41.825661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.826426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.827040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:41.827762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:41.828225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:41.828659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:42.112009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:42.134914 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6097e22e-24b5-4c29-9c7d-75663c1efa43 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.320177 Sep 03 21:14:42.137941 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2770/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:41 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:42.277900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-167198d1-0bc7-4122-a105-16d8956c9717 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721313036", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-167198d1-0bc7-4122-a105-16d8956c9717 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 238 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721313036", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1721313036', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.306478 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-167198d1-0bc7-4122-a105-16d8956c9717 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:42.310238 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-167198d1-0bc7-4122-a105-16d8956c9717 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034685 Sep 03 21:14:42.312635 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2537/5307] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:42.320757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:42.321444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:42.330552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:42.330910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:42.331356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:42.332081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:42.332554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:42.332994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:42.596231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:42.605719 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1a01f0a1-1cd6-4324-bb28-54322f237568 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.291379 Sep 03 21:14:42.606611 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2771/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:42 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:42.630281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:42.630912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:42.639421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:42.640335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:42.640850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:42.641768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:42.642303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:42.642967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:42.659256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.117081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:43.147738 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b9246e23-ec59-408b-b57f-105a7356ca8f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.521916 Sep 03 21:14:43.148852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2538/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:42 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:43.235071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-605dadb6-1389-45b3-8301-5f6c9311008c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1675039986", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-605dadb6-1389-45b3-8301-5f6c9311008c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 235 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1675039986", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1675039986', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.240600 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-605dadb6-1389-45b3-8301-5f6c9311008c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-605dadb6-1389-45b3-8301-5f6c9311008c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011963 Sep 03 21:14:43.244326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2772/5310] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 21:14:43.251807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:43.252472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:43.258905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.259396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.259838 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:43.260597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.261123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.261552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:43.620479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:43.629534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c9a37b05-89e7-4fcc-887c-2d86004f6fe9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.381365 Sep 03 21:14:43.630540 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2539/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:43 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:43.655386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:43.656008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:43.679026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.679525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.680159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:43.681113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.681741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.682177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:43.865810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:43.874323 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8af1d990-3d85-4cc7-bf29-f6e7eb8fc350 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.223795 Sep 03 21:14:43.874919 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2773/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:43 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:43.901063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:43.903179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 312ac658-e8b0-4906-b7fa-a844c6437b06] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:43.911599 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/312ac658-e8b0-4906-b7fa-a844c6437b06/action HTTP/1.1 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 13 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: {"pause": {}} Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '312ac658-e8b0-4906-b7fa-a844c6437b06', 'body': {'pause': {}}} Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:43.920025 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 312ac658-e8b0-4906-b7fa-a844c6437b06 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:43.924043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2e8c9d43-a9fe-484d-a6f4-993a9473d9ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/312ac658-e8b0-4906-b7fa-a844c6437b06/action" status: 404 len: 111 microversion: 2.1 time: 0.030307 Sep 03 21:14:43.927732 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2540/5313] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:43 2022] POST /compute/v2.1/servers/312ac658-e8b0-4906-b7fa-a844c6437b06/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:43.932561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:43.933366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:43.939852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.940435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.940915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:43.941649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:43.942309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:43.942753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.127181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:44.138584 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-856df06b-dd64-4176-845a-4aac4c619e7c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.209808 Sep 03 21:14:44.139177 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2774/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:43 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:44.161181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:44.161801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:44.168797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.169328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.169781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.170489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.170947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.171585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.494710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:44.504083 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a9b084c0-6bf5-400a-8ce5-f296e9e773a5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.346614 Sep 03 21:14:44.505397 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2541/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:44 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:44.528110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:44.528802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:44.536757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.537361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.537865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.538806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.539331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.540198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.637485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4db8c40d-faba-47a5-9fdf-8c71630f5ddd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.113735 Sep 03 21:14:44.638988 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2775/5316] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:44 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:14:44.647779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:44.649017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:44.665212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.666911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.668288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.669527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:44.670234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:44.670887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:44.938092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:44.955178 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ca85a358-ffd1-4e5d-a6ac-066c1622972a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1510 microversion: 2.1 time: 0.312312 Sep 03 21:14:44.956217 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2542/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:44 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:45.983556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:45.987957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:45.999569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.000346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.001039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.002412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.003238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.003689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.374030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:46.383766 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ddd513c6-c6d8-43f5-a709-cdc98087d663 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1490 microversion: 2.1 time: 0.407975 Sep 03 21:14:46.384362 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2776/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:45 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1490 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:46.415852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:46.416920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:46.427628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.428126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.428564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.429296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.429755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.430216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.458800 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'pause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state paused Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 13 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: {"pause": {}} Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'pause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state paused Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'pause': {}}} Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state paused. Cannot pause while the instance is in this state. Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state paused Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:46.460385 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state paused Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'pause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state paused {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee236bce-d3e9-42ef-870c-b2a9a8b2f735 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 143 microversion: 2.1 time: 0.058172 Sep 03 21:14:46.463878 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2543/5319] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:46 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 143 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 03 21:14:46.473583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:46.474396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:46.481560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.482197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.482869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.483760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.484341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.484781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.560604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a00b0f7f-dd35-4087-974f-b3912a32a92a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.091718 Sep 03 21:14:46.561809 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2777/5320] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:46 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:14:46.571029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:46.572470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:46.580966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.583254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.584021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.586972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:46.588249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:46.589174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:46.758147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:46.768590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e4d25560-a058-4a3c-a080-775ad4e311ec tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1497 microversion: 2.1 time: 0.201236 Sep 03 21:14:46.769422 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2544/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:46 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:47.794355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:47.795280 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:47.803402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:47.804172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:47.804612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:47.805668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:47.806275 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:47.806883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.134697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:48.145799 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f6f6ff73-57b4-479e-917c-d250a3d93fb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.356346 Sep 03 21:14:48.146615 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2778/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:47 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:48.172389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:48.173089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:48.182228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.183828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.184420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.186081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.186778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.187357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.410289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:48.426137 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4884c7c-3a81-4822-bbd1-f90899deb85a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.258844 Sep 03 21:14:48.426618 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2545/5323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:48 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:48.449780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:48.455935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:48.465958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.467644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.468112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.468869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.469377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.469815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.506119 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action HTTP/1.1 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 28 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: {"reboot": {"type": "SOFT"}} Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4696eb57-f738-4d81-b1fc-b8018eaa655b', 'body': {'reboot': {'type': 'SOFT'}}} Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:48.509134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:48.513637 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:48.522788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:48.523740 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e8963e6-8d8a-4d0d-a827-c45842ea0977 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action" status: 404 len: 111 microversion: 2.1 time: 0.078340 Sep 03 21:14:48.529861 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2779/5324] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:48 2022] POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:14:48.545234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:48.546939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:48.562114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.564209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.565178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.567146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.568878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.570334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.892363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:48.904960 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3526f572-4528-4a04-81a5-1b19d22f1dc5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.372531 Sep 03 21:14:48.905927 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2546/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:48 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:48.929872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:48.931199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:48.940150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.940653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.941284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:48.942012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:48.942471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:48.942905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.219496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:49.229996 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ca63b66-a247-4d31-a918-8ccfa3710c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.303799 Sep 03 21:14:49.230934 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2780/5326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:48 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:49.258450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:49.265653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:49.273345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/8bb5d097-64fb-4836-bbec-3e8cbb9ce48a/action HTTP/1.1 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 28 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: {"reboot": {"type": "SOFT"}} Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '8bb5d097-64fb-4836-bbec-3e8cbb9ce48a', 'body': {'reboot': {'type': 'SOFT'}}} Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. Sep 03 21:14:49.275076 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. Sep 03 21:14:49.279085 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.289537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 8bb5d097-64fb-4836-bbec-3e8cbb9ce48a could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:49.291339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4976f811-b577-462c-9a60-ba90880e8bbb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/8bb5d097-64fb-4836-bbec-3e8cbb9ce48a/action" status: 404 len: 111 microversion: 2.1 time: 0.037220 Sep 03 21:14:49.292083 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2547/5327] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:49 2022] POST /compute/v2.1/servers/8bb5d097-64fb-4836-bbec-3e8cbb9ce48a/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:49.300798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:49.301453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:49.308555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.309095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.309546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.310485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.311140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.311737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.471696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:49.483264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b815b236-ad58-41a1-b444-af1bb00f1628 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.186018 Sep 03 21:14:49.483902 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2781/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:49 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:49.508517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:49.509283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:49.517930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.518423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.519187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.520101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.520570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.521069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.861562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:49.870422 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f2560c43-5155-4b20-b4d1-533f2344be6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.365778 Sep 03 21:14:49.881533 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2548/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:49 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:49.893895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:49.896991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:49.903908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.904427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.904875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.905846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.906533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.907171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.922184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action HTTP/1.1 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 65 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4696eb57-f738-4d81-b1fc-b8018eaa655b', 'body': {'rebuild': {'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790'}}} Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 03 21:14:49.923876 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:14:49.928135 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:49.930145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:49.931763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9478a8ec-b70c-40de-8d9d-9cfebb3df8bc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action" status: 404 len: 111 microversion: 2.1 time: 0.042072 Sep 03 21:14:49.936822 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2782/5330] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:49 2022] POST /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:49.942731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:49.943757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:49.950669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.951521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.951859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:49.952756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:49.953471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:49.954181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.195044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:50.205324 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0898ea7-dec4-4c4b-9742-fe59c85f881b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.267255 Sep 03 21:14:50.205973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2549/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:49 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:50.233426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:50.234324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:50.241343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.251391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.253139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.254230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.259801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.260791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.498169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:50.506523 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ed6b861-c992-4523-83ce-586789feaf3c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.277885 Sep 03 21:14:50.507081 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2783/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:50 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:50.534355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:50.537281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:50.543143 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7/action HTTP/1.1 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 65 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7', 'body': {'rebuild': {'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790'}}} Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 03 21:14:50.544804 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. Sep 03 21:14:50.548217 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:50.550614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:50.551736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2ef5757c-1e1b-43b8-bd28-5f2efa3d3549 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7/action" status: 404 len: 111 microversion: 2.1 time: 0.026682 Sep 03 21:14:50.552542 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2550/5333] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:50 2022] POST /compute/v2.1/servers/b0c3a4e3-9c10-47ca-bd11-de92fe4f08e7/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:50.561607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:50.562313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:50.569370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.570136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.570776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.571716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.572371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.573023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.807184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:50.829654 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf532a66-ac5c-4c4c-80aa-20582e0c9900 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.272586 Sep 03 21:14:50.830250 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2784/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:50 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:50.856668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:50.858001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:50.873126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.873627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.874232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:50.875131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:50.875743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:50.876312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:51.153163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:51.164502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a958d9f0-1734-4a50-bfcf-b984717e4ffb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.312047 Sep 03 21:14:51.165106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2551/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:50 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:51.189956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:51.191189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4a56ca16-46c4-430f-82f5-72718b6944c3] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:51.199479 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/4a56ca16-46c4-430f-82f5-72718b6944c3/action HTTP/1.1 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 15 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: {"restore": {}} Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4a56ca16-46c4-430f-82f5-72718b6944c3', 'body': {'restore': {}}} Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:51.206144 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4a56ca16-46c4-430f-82f5-72718b6944c3 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:51.210145 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ac86068-fd82-4198-ab1a-4d6ac7711342 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/4a56ca16-46c4-430f-82f5-72718b6944c3/action" status: 404 len: 111 microversion: 2.1 time: 0.023385 Sep 03 21:14:51.217655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:51.218246 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2785/5336] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:51 2022] POST /compute/v2.1/servers/4a56ca16-46c4-430f-82f5-72718b6944c3/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:51.218845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:51.226570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:51.227348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:51.227828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:51.228879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:51.229535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:51.230511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:51.650895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:51.662387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-936fed45-2226-447c-b150-291ef6802b90 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.448908 Sep 03 21:14:51.682094 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2552/5337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:51 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:51.700676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:51.700676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:51.721599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:51.722270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:51.722991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:51.723748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:51.724214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:51.724653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.009575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:52.023805 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-db697ca2-0088-4500-aba7-873c418c4fd3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.335652 Sep 03 21:14:52.025619 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2786/5338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:51 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:52.051028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:52.051967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:52.063640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.064233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.064680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.065981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.066990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.067645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.101392 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'restore' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 15 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: {"restore": {}} Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'restore' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'restore': {}}} Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state active. Cannot restore while the instance is in this state. Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.103961 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:52.109059 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:52.109059 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:52.109059 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:52.109059 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:52.109059 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.112070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'restore' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:52.113611 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0ec6c45-7996-464c-bc93-5240c71fdb73 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 145 microversion: 2.1 time: 0.069409 Sep 03 21:14:52.114448 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2553/5339] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:52 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 145 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:14:52.141019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:52.141660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:52.151056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.152345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.152795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.153549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.154065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.154441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.165241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:52.496482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:52.505516 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-049feb74-6a5a-4021-8b04-7c0adcd26c40 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.375502 Sep 03 21:14:52.506142 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2787/5340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:52 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:52.529443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:52.530066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:52.537647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.538458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.539204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.539969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.540445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.540870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.766022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:52.775519 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5ad797b-7408-4cf8-98c1-e848fbba8adb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.249912 Sep 03 21:14:52.776861 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2554/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:52 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:52.802724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:52.803269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 244dc1eb-ea64-4a08-8669-fe1fc7822ffe] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:52.810225 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/244dc1eb-ea64-4a08-8669-fe1fc7822ffe/action HTTP/1.1 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 14 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: {"resume": {}} Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '244dc1eb-ea64-4a08-8669-fe1fc7822ffe', 'body': {'resume': {}}} Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:52.823771 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:52.827316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:52.827316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:52.827316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. Sep 03 21:14:52.827316 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:52.829118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 244dc1eb-ea64-4a08-8669-fe1fc7822ffe could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:52.830220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82994ac6-65bb-42ce-9469-bbd1f259b655 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/244dc1eb-ea64-4a08-8669-fe1fc7822ffe/action" status: 404 len: 111 microversion: 2.1 time: 0.031528 Sep 03 21:14:52.831779 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2788/5342] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:52 2022] POST /compute/v2.1/servers/244dc1eb-ea64-4a08-8669-fe1fc7822ffe/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:52.840259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:52.841251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:52.850804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.851565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.852233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:52.853290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:52.854234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:52.855418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.102564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:53.130240 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cb0f692e-f56a-4517-8757-2de6eaca4d5d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.294053 Sep 03 21:14:53.131008 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2555/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:52 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:53.154980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:53.155929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:53.164694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.165242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.169714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.170486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.171563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.172008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.403989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:53.421417 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b17381b-0eff-41f4-95a0-298339a84cd7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.268934 Sep 03 21:14:53.424268 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2789/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:53 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:53.446217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:53.447078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:53.457132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.457132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.457132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.458440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.459088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.459983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.496517 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'resume' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 14 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: {"resume": {}} Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'resume' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'resume': {}}} Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state active. Cannot resume while the instance is in this state. Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:53.498743 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'resume' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-883831f7-e77e-4606-ae69-0038d9ad7cf9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 144 microversion: 2.1 time: 0.058582 Sep 03 21:14:53.502261 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2556/5345] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:53 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 144 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:14:53.510819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:53.512315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:53.523133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=82 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:53.529288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.529797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.530383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.531265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.532084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.532535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.786707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:53.800218 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ec33a03-aec6-439c-ac88-a8071a8bce2b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.293291 Sep 03 21:14:53.801505 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2790/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:53 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:53.836467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:53.837969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:53.862792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.867147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.867747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:53.868614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:53.869246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:53.871203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:54.192656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:54.210891 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-75019196-61d3-42aa-864f-5d45bd2d2ce4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.381299 Sep 03 21:14:54.225454 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2557/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:53 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:54.295665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4e62cc1-92e5-4fdf-ab63-3d63c156058b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4e62cc1-92e5-4fdf-ab63-3d63c156058b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 160 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": "", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "463eec63-3506-4a17-a53f-17e056f6416a"}]}} Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'body': {'server': {'name': '', 'imageRef': 'bb6b1dcc-96d7-4d20-8933-997caa341790', 'flavorRef': '452', 'networks': [{'uuid': '463eec63-3506-4a17-a53f-17e056f6416a'}]}}} Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '' Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:14:54.299359 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:14:54.303583 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:14:54.305179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4e62cc1-92e5-4fdf-ab63-3d63c156058b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:54.306183 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4e62cc1-92e5-4fdf-ab63-3d63c156058b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015046 Sep 03 21:14:54.306938 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2791/5348] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:14:54 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:14:54.315889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:54.317062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:54.323563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:54.324257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:54.324708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:54.325620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:54.326239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:54.326845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:54.546336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:54.558069 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d66f4f3b-ca38-4142-864b-c4d77b1a195c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.246035 Sep 03 21:14:54.561200 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2558/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:54 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:54.585299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:54.585994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:54.595340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:54.596727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:54.597365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:54.598390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:54.599014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:54.599631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:54.934163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:54.965942 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-922e58da-1d94-4514-b68c-413ff0cf972f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.385801 Sep 03 21:14:54.982122 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2792/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:54 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:54.997462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:54.998022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: ae366793-2eed-4508-9dde-6d6b917daefd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:55.010780 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/ae366793-2eed-4508-9dde-6d6b917daefd/action HTTP/1.1 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 14 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: {"shelve": {}} Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ae366793-2eed-4508-9dde-6d6b917daefd', 'body': {'shelve': {}}} Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:14:55.021230 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance ae366793-2eed-4508-9dde-6d6b917daefd could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:14:55.025449 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a6613f1b-b3e2-4a22-a3e8-f7284122c020 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/ae366793-2eed-4508-9dde-6d6b917daefd/action" status: 404 len: 111 microversion: 2.1 time: 0.030890 Sep 03 21:14:55.034095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:55.034742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:55.042896 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2559/5351] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:54 2022] POST /compute/v2.1/servers/ae366793-2eed-4508-9dde-6d6b917daefd/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:14:55.046384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.046902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.050319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.053560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.054106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.054571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.373126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:55.384963 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a410791-f1ae-4766-a099-99f37f2d3bc6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.355946 Sep 03 21:14:55.387184 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2793/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:55 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:55.409433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:55.410435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:55.421537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.422079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.422529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.423259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.423738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.424164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.429555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:55.675004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:55.685788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-552ca894-0659-4dec-af78-302a6c469ca4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.280101 Sep 03 21:14:55.686846 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2560/5353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:55 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:14:55.708787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:14:55.709397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:55.716417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.718059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.718683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.719585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:55.720203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:55.720802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:55.753987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lazy-loading 'flavor' on Instance uuid a00689f0-a597-4d55-b8da-3e8f6385a329 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:14:56.032941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6adb4f5d-bb19-4b02-bdf2-8eaa4c06872f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.327734 Sep 03 21:14:56.034379 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2794/5354] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:14:55 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:14:56.047883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:56.048445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:56.063276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:56.064007 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:56.064564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:56.065732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:56.078960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:56.079679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:56.334555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:56.345303 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98e71070-6834-49e2-abf4-bf2b8d39263b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.304804 Sep 03 21:14:56.354989 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2561/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:56 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:57.383472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:57.388240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:57.408528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:57.409509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:57.411372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:57.413415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:57.415658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:57.418787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:57.804239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:57.815075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5cef0bd3-3df6-4bf8-a14f-67679c764ec3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.442086 Sep 03 21:14:57.816611 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2795/5356] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:57 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:58.843977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:14:58.845170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:14:58.851451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=90 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:58.869837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:58.873194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:58.873804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:58.878802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:14:58.880364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:14:58.881499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:14:59.075758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:14:59.083886 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e1bc3dea-0a7d-4827-88ba-12f5b397a7a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.246815 Sep 03 21:14:59.084470 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2562/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:14:58 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:00.108826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:00.109471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:00.116322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:00.116839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:00.117320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:00.118029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:00.118486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:00.118916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:00.258938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:00.267129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2744d0c8-e51b-4e8f-8b3b-11f11be82dce tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.162573 Sep 03 21:15:00.267638 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2796/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:00 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:01.290954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:01.292825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:01.301750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:01.302555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:01.303168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:01.304078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:01.304537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:01.305165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:01.505550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:01.513827 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0a2f9f4-c608-4f89-a3b2-c1e2ede159ee tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.227146 Sep 03 21:15:01.514404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2563/5359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:01 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:02.305527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:02.308922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:02.316212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:02.316711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:02.317189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:02.317909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:02.318373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:02.318805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:02.390829 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2cc3f5c7-9c1f-4073-badc-41f144b80642 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "POST /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728/action" status: 200 len: 32639 microversion: 2.1 time: 0.089043 Sep 03 21:15:02.391498 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2797/5360] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:15:02 2022] POST /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728/action => generated 32639 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:15:02.541283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:02.542536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:02.549181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:02.549675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:02.550116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:02.550819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:02.551277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:02.551701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:02.794003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:02.813737 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94f7a68a-a61f-4dfb-bd81-9d9433a2d426 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.279034 Sep 03 21:15:02.814679 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2564/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:02 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:03.734130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728", "tag": "8a98cd44-3665-4a75-b369-5dbd97c22f93"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:03.735956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:03.737297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:03.750417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:03.751153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:03.752254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:03.753358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:03.754111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:03.755060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:03.770061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:03.770602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:03.771035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:03.786506 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] Creating event network-changed:8a98cd44-3665-4a75-b369-5dbd97c22f93 for instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 on nch1-master-1 Sep 03 21:15:03.790342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:15:03.804324 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-f71a8178-0a07-41d4-a8bb-a550f425b29e req-7b2cf717-d460-4cf1-a45f-86d7c007ac9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073757 Sep 03 21:15:03.809305 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2565/5362] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:15:03.839800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:03.840933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:03.857181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:03.858671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:03.861699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:03.862531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:03.863125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:03.866839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:03.974524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83ef3ffc-f981-4b04-bb2f-1572692f669e tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 204 len: 0 microversion: 2.1 time: 0.246725 Sep 03 21:15:03.977678 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2798/5363] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:15:03 2022] DELETE /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:15:03.997165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:03.999690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:04.026443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:04.030359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:04.031069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:04.033175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:04.034732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:04.037574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:04.183164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:04.196202 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fdc4c275-c993-4c78-84ee-4181b0592d0c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.361374 Sep 03 21:15:04.207884 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2566/5364] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:03 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:15:04.363642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:04.372473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-05ac32fd-eea9-4dac-a8e8-db37ca3348d0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1666 microversion: 2.1 time: 0.386351 Sep 03 21:15:04.385773 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2799/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:03 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1666 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:05.229085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:05.231416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:05.240973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:05.241817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:05.242584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:05.243504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:05.244183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:05.244956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:05.395837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:05.397416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:05.404349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:05.404840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:05.405505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:05.406385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:05.406987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:05.407836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:05.500927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:05.509618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1f644cbf-7926-4450-84f9-6eaecee40de8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.289617 Sep 03 21:15:05.510197 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2567/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:05 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:05.657869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:05.669466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92f89b49-5c66-45cc-86e6-67f8a76279fd tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1666 microversion: 2.1 time: 0.277541 Sep 03 21:15:05.685287 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2800/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:05 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1666 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:15:06.535754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:06.537004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:06.555173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.555938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.556758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.561054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.561941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.562603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.773937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:06.783118 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-552d808d-d90a-4e3d-9efa-d2a91eacfd72 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.253142 Sep 03 21:15:06.784202 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2568/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:06 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:06.789298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:06.790366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:06.797182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.797928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.798587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.799545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.800531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.801243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.811130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728", "name": "network-vif-deleted", "tag": "8a98cd44-3665-4a75-b369-5dbd97c22f93"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:06.831273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.831866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.832284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.859764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:06.860514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:06.861204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:06.862103 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] Creating event network-vif-deleted:8a98cd44-3665-4a75-b369-5dbd97c22f93 for instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 on nch1-master-1 Sep 03 21:15:06.862915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lazy-loading 'fault' on Instance uuid 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:15:06.867308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-18eb49bd-d621-4a8d-b00c-a29a5f32dd07 req-7b5974ca-e7c0-4a11-8b9c-3e50dce984e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317956 Sep 03 21:15:06.868420 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2801/5369] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:15:06.927846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f792275f53f445ea72b6de441314a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd389730e46ff4f35bf0fec366e2be537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:06.939797 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77594388-180e-432e-ad56-55b724c105cc tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 200 len: 1337 microversion: 2.1 time: 0.153926 Sep 03 21:15:06.941277 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2569/5370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:06 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 1337 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:07.810981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:07.811685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:07.819281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:07.819970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:07.820753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:07.822042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:07.823786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:07.824384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:07.967585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:07.968822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] [instance: 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:07.987102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:07.987759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:07.988405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:07.989314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:07.989779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:07.990211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:08.009781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] HTTP exception thrown: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Request method failure captured: Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 HTTP/1.1 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8LTlqg61KM9dWJ1OZJvrqHJetJYCfV-hyZ_KdHzviqIlfcrnbUuQ8MjRe1Q_VJv-JPQ98HcKOCYHsbyyXGOUlc_AraYhh_C0Um1-antoq1YqRcanR4ACaVgzz1_idgcxuY1zBo2z6-1nrNaDylw1HSJzauU_xwV0eTFRHsrrKpoUb4 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d389730e46ff4f35bf0fec366e2be537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkBasicOps-341930598 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: d389730e46ff4f35bf0fec366e2be537 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkBasicOps-341930598 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 9f792275f53f445ea72b6de441314a49 Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkBasicOps-341930598-project Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728'} Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:15:08.012280 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Returning 404 to user: Instance 0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0ad22d1a-2d58-4b8b-940c-7406cbc1f3d6 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728" status: 404 len: 111 microversion: 2.1 time: 0.053629 Sep 03 21:15:08.015977 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2570/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:07 2022] GET /compute/v2.1/servers/0d6ca1b7-2b3e-4259-acf9-64ad5d4dd728 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:15:08.127814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:08.141345 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed8b1ec4-f816-4b11-a983-ed8916ed7c34 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.334831 Sep 03 21:15:08.157465 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2802/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:07 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:08.259532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1bdc79e9-e5fa-4106-b173-bba5f06feea0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] Calling method '.version_select at 0x7fae65c35d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:08.292052 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1bdc79e9-e5fa-4106-b173-bba5f06feea0 tempest-TestNetworkBasicOps-341930598 tempest-TestNetworkBasicOps-341930598-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-253440261" status: 202 len: 0 microversion: 2.1 time: 0.036488 Sep 03 21:15:08.296487 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2571/5373] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Sep 3 21:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-253440261 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:15:09.164649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:09.165436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:09.177732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:09.178355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:09.178814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:09.179533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:09.179999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:09.180437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:09.184968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:09.350339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:09.360164 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aaf9e1cc-7085-4eb5-956a-9f23a7669923 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.199904 Sep 03 21:15:09.361194 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2803/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:09 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:10.395614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:10.395614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:10.406943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:10.407457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:10.407906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:10.408782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:10.409299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:10.409739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:10.655261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:10.672468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32d20057-a955-46ea-ab1d-c0744abb1ae0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.282475 Sep 03 21:15:10.675835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2572/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:10 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:11.701322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:11.701941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:11.714756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:11.715256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:11.719034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:11.721696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:11.722254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:11.722694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:12.125491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:12.142455 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb4a5b7a-1762-4760-a8d0-d59a3a84c9fb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1532 microversion: 2.1 time: 0.445750 Sep 03 21:15:12.144342 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2804/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:11 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1532 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:13.168674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:13.170696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:13.185225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:13.191266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:13.192378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:13.193271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:13.196667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:13.197157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:13.503011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:13.515584 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd374fec-f9f9-489f-92fc-2ce4ceda6f80 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1532 microversion: 2.1 time: 0.349943 Sep 03 21:15:13.516612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2573/5377] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:13 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1532 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:14.541573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:14.542348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:14.555330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:14.555944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:14.556651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:14.557553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:14.558368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:14.559025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:14.907537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:14.920112 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f4eac6a8-e4d5-40cb-b759-9d607686de85 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.383851 Sep 03 21:15:14.922031 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2805/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:14 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:15.876673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "name": "network-vif-plugged", "status": "completed", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:15.898702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:15.899210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:15.899654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:15.929186 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] Creating event network-vif-plugged:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch2-master-1 Sep 03 21:15:15.946847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:15.947485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:15.954856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ebaaedcd-cc26-4966-946f-6dcf73c6fd09 req-4a9bdcab-7ee0-43ef-a46b-571232c35d9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356325 Sep 03 21:15:15.959795 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2574/5379] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:15:15.964623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:15.966508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:15.967749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:15.971061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:15.971768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:15.973240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:16.243496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:16.257335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85848d2b-c09d-4d6d-b5ad-29f92f5c96f5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.316265 Sep 03 21:15:16.273377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2806/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:15 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:15:17.286450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:17.287981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:17.302901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:17.303984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:17.306325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:17.310967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:17.312309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:17.315107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:17.743806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:17.754712 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11957cbe-43e3-494a-a34d-a056ebdb0ff6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.475743 Sep 03 21:15:17.757869 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2575/5381] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:17 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:18.779699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:18.780381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:18.801807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:18.802311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:18.802757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:18.803481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:18.803940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:18.804380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:19.369150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:19.383576 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a7f60f1-1496-4f9c-b71e-3b9b0193f05c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.607712 Sep 03 21:15:19.384138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2807/5382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:18 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:20.410682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:20.411840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:20.424612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:20.425242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:20.425689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:20.426412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:20.436928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:20.438636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:21.688675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:21.705989 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21fcf884-b116-419f-86cc-530f7a843e7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 1.299314 Sep 03 21:15:21.724873 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2576/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:20 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:22.735496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:22.736812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:22.746365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:22.747087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:22.747680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:22.748575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:22.749241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:22.749837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:23.732371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:23.743882 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5807f1a4-011f-4f51-a2dc-0382ea2bd0a4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 1.012616 Sep 03 21:15:23.758097 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2808/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:22 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:24.773769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:24.775045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:24.794149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:24.794752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:24.795450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:24.796390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:24.798319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:24.799194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:25.520989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:25.524578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=90 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:25.557876 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c68236ed-2078-429a-ae16-4d76868f6954 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.788828 Sep 03 21:15:25.573621 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2577/5385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:24 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:26.607900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:26.609568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:26.672159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:26.676535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:26.677970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:26.679146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:26.680535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:26.683217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:26.683707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:27.443714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:27.458791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1132c447-0002-4d45-82a8-41a57c470261 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.868375 Sep 03 21:15:27.460662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2809/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:26 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:28.485598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:28.486872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:28.496776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:28.497614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:28.498248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:28.499153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:28.499796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:28.500576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:28.770412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:28.782083 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce1a2bca-b22d-44cd-b716-0acaf4e39e07 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.300944 Sep 03 21:15:28.783141 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2578/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:28 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:29.808438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:29.811341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:29.823610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:29.826764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:29.828708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:29.830156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:29.834371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:29.835594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:30.247636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:30.261270 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7a163b6f-d145-4893-9f7c-5074787fd48d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.456707 Sep 03 21:15:30.265047 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2810/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:31.290363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:31.290731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:31.294431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:31.314995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:31.318135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:31.321002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:31.322871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:31.325978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:31.329428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:31.754860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:31.765289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-97caac35-60ac-4c90-a348-0817070e7232 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.480126 Sep 03 21:15:31.769838 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2579/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:31 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:32.797182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:32.797815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:32.833444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:32.833968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:32.834422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:32.835163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:32.835629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:32.836060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:33.170158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:33.181768 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b0bfe1c-7c90-4e44-bc49-29c5a6d3e11c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.388754 Sep 03 21:15:33.183452 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2811/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:32 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:34.210332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:34.211676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:34.220938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:34.221424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:34.221865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:34.222573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:34.223031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:34.223461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:34.615424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:34.625184 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e656c0fe-bb2a-4cbc-a4e2-fe8f70a1165d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1527 microversion: 2.1 time: 0.418747 Sep 03 21:15:34.626473 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2580/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:34 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1527 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:35.652674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:35.653866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:35.664840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:35.666712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:35.668838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:35.669902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:35.671128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:35.676993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:36.118368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:36.131040 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a41fc593-1ecd-491e-8e6d-d7258e903017 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1509 microversion: 2.1 time: 0.483178 Sep 03 21:15:36.152115 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2812/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:35 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:37.164620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:37.165644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:37.173004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:37.173869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:37.174517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:37.175418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:37.176072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:37.176685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:37.469653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:37.485543 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91fe0614-2d2a-48da-a0b0-c97210c32a2e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1509 microversion: 2.1 time: 0.325520 Sep 03 21:15:37.494183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2581/5393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:37 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:38.512550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:38.513307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:38.533862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:38.534377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:38.534869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:38.535573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:38.536043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:38.536489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:38.866908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:38.888311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5ea7c569-90e3-4a63-b526-f09614d96ede tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1512 microversion: 2.1 time: 0.380426 Sep 03 21:15:38.905909 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2813/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:38 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:38.914573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:38.915326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:38.940684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:38.941932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:38.943153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:38.945573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:38.946205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:38.948108 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.247988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:39.265856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7802b300-ff16-4783-af96-1eeeb301b1b7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1512 microversion: 2.1 time: 0.358391 Sep 03 21:15:39.267598 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2582/5395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:38 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:39.354229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:39.355192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:39.363424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.364242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.364864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.365834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.366449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.367044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.372438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=66 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:39.394704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lazy-loading 'flavor' on Instance uuid a00689f0-a597-4d55-b8da-3e8f6385a329 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:15:39.409962 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'shelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state shelved_offloaded Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 14 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: {"shelve": {}} Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'shelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state shelved_offloaded Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'shelve': {}}} Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:15:39.412178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state shelved_offloaded Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state shelved_offloaded Sep 03 21:15:39.417482 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:15:39.419141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'shelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state shelved_offloaded {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:15:39.420399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8296b8b3-1819-4806-8756-339a2d86becc tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 155 microversion: 2.1 time: 0.071080 Sep 03 21:15:39.422031 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2814/5396] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:15:39 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 155 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:15:39.430308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:39.430997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:39.438275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.439280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.439399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.440173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.440699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.441356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.503893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140519) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 21:15:39.605044 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f93bfea-e0b6-4092-8d93-e4f4ecc64e36 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.177808 Sep 03 21:15:39.606477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2583/5397] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:15:39 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:15:39.614945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:39.616345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:39.624425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.626149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.626735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.627781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.628514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.629103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.784913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "name": "network-vif-unplugged", "status": "completed", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:39.807136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:39.807845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:39.808608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:39.829489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_external_events [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] Unable to find a host for instance a00689f0-a597-4d55-b8da-3e8f6385a329. Dropping event network-vif-unplugged {{(pid=140519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 21:15:39.830665 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-baa1aee7-b23c-486e-a8f6-f7539d07f771 req-10292a63-7e14-4825-8364-ab747af38a5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052126 Sep 03 21:15:39.831725 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2584/5398] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 03 21:15:39.907371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:39.920969 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c437022-4e15-4013-9090-80e9d6a0ceb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1460 microversion: 2.1 time: 0.310316 Sep 03 21:15:39.936761 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2815/5399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:39 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1460 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:40.946759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:40.948115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:40.964604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:40.966984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:40.979916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:40.983881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:41.000983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:41.001562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:41.509008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:41.525511 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d0f25b4-05a0-4e04-946e-9bc93dcd35a0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1460 microversion: 2.1 time: 0.585481 Sep 03 21:15:41.533453 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2585/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:40 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1460 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:42.549818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:42.550648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:42.566071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:42.573755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:42.574456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:42.575381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:42.577458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:42.580084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:43.203903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:43.244136 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6256a55d-8200-494d-b5e6-17695289c7e0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.698824 Sep 03 21:15:43.249201 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2816/5401] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:42 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:44.278187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:44.278743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:44.288043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:44.288571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:44.289038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:44.289809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:44.290224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:44.290636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:44.387081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:15:44.407341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:44.408029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:44.408490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:44.435561 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] Creating event network-changed:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch1-master-1 Sep 03 21:15:44.448670 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f9cfc548-689c-46e9-be74-f6e65da758d3 req-5a72c0db-ddf5-4719-8458-7dc1c38208f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062256 Sep 03 21:15:44.450632 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2817/5402] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:15:45.353136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:45.372859 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-adef9ec7-32f6-42be-aef5-45dfda7bc352 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 1.099167 Sep 03 21:15:45.373617 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2586/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:44 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:46.398747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:46.401217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:46.433846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:46.435177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:46.436575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:46.440051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:46.441491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:46.445302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:46.982136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:46.990585 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-55e333ee-f093-4aaa-9046-202adafa76c9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.597251 Sep 03 21:15:46.996162 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2818/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:46 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:48.026051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:48.027865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:48.043490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:48.045481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:48.048357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:48.049591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:48.050611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:48.051991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:48.298607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:48.318201 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0ff26bc9-4ea6-4df0-ad98-e3eca11e232f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.295290 Sep 03 21:15:48.329946 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2587/5405] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:48 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:49.348106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:49.349364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:49.361569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:49.364670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:49.365339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:49.366246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:49.369487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:49.370129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:49.703878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:49.717665 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4103880b-225d-45a4-8204-549f04c0f3f9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.373883 Sep 03 21:15:49.725422 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2819/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:49 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:50.750343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:50.750936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:50.767115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:50.767613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:50.775401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:50.776315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:50.776781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:50.779454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:51.284606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:51.298486 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-833160da-af25-4910-aca0-8714ea6fbf71 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.551000 Sep 03 21:15:51.301740 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2588/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:50 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:52.328775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:52.329557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:52.345740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:52.346268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:52.346730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:52.347514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:52.347983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:52.349422 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:53.490507 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:53.504601 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70e02fed-9369-4218-b65c-5577cf0d0ae3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 1.180560 Sep 03 21:15:53.509885 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2820/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:52 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:54.538439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:54.539240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:54.553259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:54.553758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:54.554201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:54.554928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:54.555396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:54.555826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:55.226551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:55.235893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-31d0d977-6366-4ba2-b722-9eb5586fdb61 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.701873 Sep 03 21:15:55.236913 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2589/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:54 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:56.263972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:56.264606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:56.287752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:56.288277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:56.288735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:56.289503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:56.304138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:56.304724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:56.716233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:56.725374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1c22edbc-d6a8-4a0c-9403-25023cd95926 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.465761 Sep 03 21:15:56.731205 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2821/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:56 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:57.758174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:57.758946 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:57.778348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:57.780927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:57.781643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:57.784294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:57.785861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:57.786552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:57.789994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:58.677064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:15:58.688851 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fec8eced-ff33-4b86-8606-b5a5f37bcae5 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.936962 Sep 03 21:15:58.697693 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2590/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:57 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:15:59.724519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:15:59.731568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:15:59.762750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=26 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:59.778665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:59.790444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:59.794132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:15:59.801802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:15:59.806645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:15:59.811239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:00.381158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:00.392220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a8f860a-0669-4761-ad76-2958fd8b70ac tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.672149 Sep 03 21:16:00.394214 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2822/5412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:15:59 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:01.419368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:01.419982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:01.430546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:01.435254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:01.435769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:01.436203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:01.436960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:01.442721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:01.443475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:01.685014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:01.694081 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffe71753-3410-4fd4-9002-010c1f533ee9 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.279933 Sep 03 21:16:01.695362 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2591/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:01 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:02.726460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:02.727496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:02.739503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:02.740672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:02.741518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:02.755221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:02.755965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:02.757014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:03.063877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:03.078281 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81169fe6-5543-4c12-80f4-bc754e1942e3 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.362087 Sep 03 21:16:03.079183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2823/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:02 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:04.104445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:04.105844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:04.117014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:04.117960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:04.119261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:04.121002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:04.121985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:04.122616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:04.485818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:04.511565 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-952aea0d-8bdf-49ce-a7a4-444af0bc0594 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.398777 Sep 03 21:16:04.513889 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2592/5415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:04 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:04.893783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a41e4f45-ce2d-4362-b3ae-15ee4447ca9f tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] Action: 'create', calling method: .version_select at 0x7fae65c1f8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1589333612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBII6xps7V6xQxQY5mDDM0Z2uA61v4Qm0DXPBQYnNJEZWSMe96zP/f0JfT4DvctgKR9uTa8k4LBbzw5gWU46ndOfi4SHSfChscYde0oCmckY+XImu6/Q/uaB2miv9dkLVrg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:04.914659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a41e4f45-ce2d-4362-b3ae-15ee4447ca9f tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] Getting quotas for project 5b8d1a9501b84b76a9ef13d51243cef3. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:16:04.924818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-a41e4f45-ce2d-4362-b3ae-15ee4447ca9f tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] Getting quotas for user c91b7026d968442eb0db3fd4b5ddc542 and project 5b8d1a9501b84b76a9ef13d51243cef3. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:16:04.962106 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a41e4f45-ce2d-4362-b3ae-15ee4447ca9f tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.073783 Sep 03 21:16:04.963169 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2824/5416] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:16:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:05.540021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:05.541547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:05.551097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:05.552447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:05.553537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:05.554416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:05.555027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:05.555608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:06.217105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:06.226736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46ff0483-ae11-4922-9b1a-44b211e10393 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.691123 Sep 03 21:16:06.227531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2593/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:05 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:07.258172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:07.258808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:07.270823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:07.271722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:07.272417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:07.274183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:07.274859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:07.277515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:07.563509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:07.581456 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1689d523-18cf-4d00-85c2-56529e074fbd tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.329706 Sep 03 21:16:07.582626 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2825/5418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:07 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:08.608083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:08.608707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:08.621781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:08.622314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:08.622764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:08.623504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:08.623963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:08.628732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:08.872969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04b998cf-2cb9-4956-965f-a2f003be9fca tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] Calling method '.version_select at 0x7fae65bc28b0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:08.899485 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04b998cf-2cb9-4956-965f-a2f003be9fca tempest-TestVolumeBootPattern-809940440 tempest-TestVolumeBootPattern-809940440-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1589333612" status: 202 len: 0 microversion: 2.1 time: 0.031914 Sep 03 21:16:08.912480 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2826/5419] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Sep 3 21:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1589333612 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:16:08.991205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:09.000226 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e35cba17-247e-48fe-aa8c-af8002ccd317 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.397042 Sep 03 21:16:09.000826 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2594/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:08 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:10.026945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:10.027713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:10.044762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:10.050639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:10.054777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:10.055795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:10.057154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:10.059913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:10.069582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=62 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:10.523476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:10.534772 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13a6c464-8d74-4d01-8928-627d9189f4bf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.514863 Sep 03 21:16:10.535918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2827/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:10 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:10.794995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "name": "network-vif-plugged", "status": "completed", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:10.822949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:10.825529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:10.826227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:10.850036 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] Creating event network-vif-plugged:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch1-master-1 Sep 03 21:16:10.857969 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8abdcb5b-43b9-4b1d-8674-593395dd43ee req-cd8781d1-53d4-4b4b-b004-8e836bcac741 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068332 Sep 03 21:16:10.859818 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2595/5422] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:11.563791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:11.565987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:11.582159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:11.583235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:11.584417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:11.585563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:11.586975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:11.587876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:11.939050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:11.955925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-23b073dc-dbd2-47e1-8e62-d4469efeeef4 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.399930 Sep 03 21:16:11.981717 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2828/5423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:11 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:12.996851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:12.998444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:13.023312 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:13.025448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:13.026151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:13.028932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:13.030335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:13.031681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:13.337286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:13.360731 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-889b20df-e710-4b90-bb32-97ec7a834e1f tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1518 microversion: 2.1 time: 0.378572 Sep 03 21:16:13.367756 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2596/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:12 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1518 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:14.383828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:14.385348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:14.395761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:14.395761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:14.396306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:14.397427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:14.398217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:14.398737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:14.806090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:14.823141 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4b67ee9e-369d-4e29-98c2-114acdadf142 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.441555 Sep 03 21:16:14.824314 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2829/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:14 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:14.851410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:14.852124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:14.860171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:14.860670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:14.861352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:14.862086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:14.862554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:14.862994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:15.311599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:15.338751 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46cc202c-aa85-442f-bfcf-7c3c5c6598cf tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.488426 Sep 03 21:16:15.340596 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2597/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:14 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:15.373708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:15.380052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:15.380770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:15.387825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:15.388493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:15.409177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:15.412080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:15.413736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:15.414650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:15.806123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:15.839165 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea1770f7-319c-488b-9830-d71e59c00a1b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.464773 Sep 03 21:16:15.839796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2830/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:15 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:15.867621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4629dd15-4514-46dc-84d0-8d7c39ea80b6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:15.879943 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4629dd15-4514-46dc-84d0-8d7c39ea80b6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4629dd15-4514-46dc-84d0-8d7c39ea80b6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/8cc6f05e-d775-485d-846f-bdca4fb39341/action HTTP/1.1 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 15 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: {"os-stop": {}} Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '8cc6f05e-d775-485d-846f-bdca4fb39341', 'body': {'os-stop': {}}} Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:15.894246 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. Sep 03 21:16:15.898516 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:15.901237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4629dd15-4514-46dc-84d0-8d7c39ea80b6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 8cc6f05e-d775-485d-846f-bdca4fb39341 has no mapping to a cell. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:15.902604 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4629dd15-4514-46dc-84d0-8d7c39ea80b6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/8cc6f05e-d775-485d-846f-bdca4fb39341/action" status: 404 len: 117 microversion: 2.1 time: 0.038987 Sep 03 21:16:15.903968 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2598/5428] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:15 2022] POST /compute/v2.1/servers/8cc6f05e-d775-485d-846f-bdca4fb39341/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:16:15.928692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:15.929438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:15.940162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:15.941936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:15.942600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:15.943621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:15.948749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:15.952799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:16.492681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:16.507855 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b9d94be-ce16-4abe-9772-e014b585826d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.588100 Sep 03 21:16:16.509185 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2831/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:15 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:16.533767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:16.534448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:16.547788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:16.548217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:16.554001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:16.554852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:16.555364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:16.555848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:16.846152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:16.862176 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af8a8d7f-1a5a-4b9e-abd4-2751550958f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.332663 Sep 03 21:16:16.866018 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2599/5430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:16 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:16.898952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:16.900773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 97c74490-0712-484d-bd3b-4d8aac6b2e89] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:16.913161 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/97c74490-0712-484d-bd3b-4d8aac6b2e89/action HTTP/1.1 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 15 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: {"suspend": {}} Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '97c74490-0712-484d-bd3b-4d8aac6b2e89', 'body': {'suspend': {}}} Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:16.914816 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:16.919657 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:16.919657 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:16.919657 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. Sep 03 21:16:16.919657 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:16.920921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 97c74490-0712-484d-bd3b-4d8aac6b2e89 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:16.921836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88744541-ccb2-4abd-b11b-e4d3a342bcb0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/97c74490-0712-484d-bd3b-4d8aac6b2e89/action" status: 404 len: 111 microversion: 2.1 time: 0.028460 Sep 03 21:16:16.922620 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2832/5431] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:16 2022] POST /compute/v2.1/servers/97c74490-0712-484d-bd3b-4d8aac6b2e89/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:16:16.930742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:16.932482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:16.939419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:16.940338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:16.941010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:16.941892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:16.942508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:16.943129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:17.342073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:17.350034 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4129116b-fc0a-4dba-9a88-34e18baaf9f1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.423018 Sep 03 21:16:17.362106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2600/5432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:16 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:17.381601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:17.382658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:17.403036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:17.404142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:17.405498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:17.406967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:17.407744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:17.409127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:17.910462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:17.920341 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6776b64f-b8fa-477f-b485-e0abe8f6c9f7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.543715 Sep 03 21:16:17.921780 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2833/5433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:17 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:17.951596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:17.952758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:17.971684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:17.972183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:17.972624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:17.975536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:17.977546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:17.978189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:18.057698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lazy-loading 'flavor' on Instance uuid a00689f0-a597-4d55-b8da-3e8f6385a329 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:16:18.212453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f254fcb-d394-4490-876d-0100560756c7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.266188 Sep 03 21:16:18.215007 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2601/5434] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:17 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:16:18.227009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:18.227701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:18.246163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:18.246910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:18.247545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:18.248584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:18.249356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:18.249948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:18.895940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:18.910701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-696a46cc-149b-4267-849d-19155feed193 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1513 microversion: 2.1 time: 0.691135 Sep 03 21:16:18.912138 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2834/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:18 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1513 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:19.940096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:19.941530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:19.954912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:19.955775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:19.957143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:19.958698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:19.967745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:19.968515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.411895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:20.423205 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2009b5d-1041-4086-97a9-1698ad5be312 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1496 microversion: 2.1 time: 0.487356 Sep 03 21:16:20.438215 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2602/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:19 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1496 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:20.449145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:20.450338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:20.457273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.458035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.458685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.459585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.460242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.460872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.493922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lazy-loading 'flavor' on Instance uuid a00689f0-a597-4d55-b8da-3e8f6385a329 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:16:20.514539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'suspend' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state suspended Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 15 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: {"suspend": {}} Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'suspend' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state suspended Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'suspend': {}}} Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 03 21:16:20.516530 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state suspended Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state suspended Sep 03 21:16:20.520363 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:20.523140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'suspend' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state suspended {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:20.524199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6d12273f-44a9-4f75-b043-5483a287f958 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 148 microversion: 2.1 time: 0.079783 Sep 03 21:16:20.525887 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2835/5437] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:20 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 148 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:16:20.534554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:20.535122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:20.541738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.542332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.543424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.544141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.544811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.545431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.632475 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-424a8001-84b7-4c87-9774-ace41a93830c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 202 len: 0 microversion: 2.1 time: 0.102294 Sep 03 21:16:20.633346 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2603/5438] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:20 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:16:20.647469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:20.651486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:20.665309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.667161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.667838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:20.668926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:20.670985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:20.672136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:21.226502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:21.236189 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d519f5f9-7fb3-4b49-8d18-535a7b135b6d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1502 microversion: 2.1 time: 0.596227 Sep 03 21:16:21.237204 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2836/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:20 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1502 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:22.263368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:22.264087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:22.270998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:22.271693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:22.272435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:22.273179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:22.273645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:22.274082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:22.435272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:22.443518 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b99a6a19-67e6-48b2-b286-2513fca202e6 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1502 microversion: 2.1 time: 0.185953 Sep 03 21:16:22.458469 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2604/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:22 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:23.471141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:23.472636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:23.480287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:23.481169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:23.481717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:23.482903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:23.483478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:23.484187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:23.919598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:23.964908 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-281b31da-f76a-4240-a91d-32048333cd7e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1502 microversion: 2.1 time: 0.490038 Sep 03 21:16:23.967527 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2837/5441] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:23 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1502 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:24.991453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:24.992684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:25.000621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.001502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.002113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:25.003220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.003839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.004420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:25.411593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:25.416655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:25.424391 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ddbfb239-cad9-415a-b5ea-6705e49efb19 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.437071 Sep 03 21:16:25.434467 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2605/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:24 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:25.451983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:25.452630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:25.476156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.477993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.478912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:25.480593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.481444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.483305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:25.862486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:25.881711 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d30d43cb-79fb-4c40-96b0-9edb83623ced tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.433542 Sep 03 21:16:25.893466 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2838/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:25 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:25.912409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:25.913426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: d16fc6cc-da64-47ee-b1bc-5faca6a1ba44] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:25.937612 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/d16fc6cc-da64-47ee-b1bc-5faca6a1ba44/action HTTP/1.1 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 15 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: {"unpause": {}} Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd16fc6cc-da64-47ee-b1bc-5faca6a1ba44', 'body': {'unpause': {}}} Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:25.945871 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:25.950952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:25.950952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:25.950952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. Sep 03 21:16:25.950952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:25.952678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance d16fc6cc-da64-47ee-b1bc-5faca6a1ba44 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:25.958411 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11cf5e77-ca63-49a7-8e0f-9a4fe038de0b tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/d16fc6cc-da64-47ee-b1bc-5faca6a1ba44/action" status: 404 len: 111 microversion: 2.1 time: 0.049999 Sep 03 21:16:25.959274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2606/5444] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:25 2022] POST /compute/v2.1/servers/d16fc6cc-da64-47ee-b1bc-5faca6a1ba44/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:16:25.969820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:25.971028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:25.986753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.987746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.988494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:25.989622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:25.990645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:25.992411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.219322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:26.235626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-40721e5b-9d0d-4a38-8c3a-c63313a012eb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.271337 Sep 03 21:16:26.253063 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2839/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:25 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:26.276085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:26.277921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:26.318227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.318760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.319555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.320471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.321883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.322495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.816929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:26.829152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a4e8d43-da89-4de7-b108-52d6e867f8b8 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.561769 Sep 03 21:16:26.833429 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2607/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:26 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:26.859822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:26.861079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:26.868346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.869627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.870401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.871403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.872020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.872840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.920505 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'unpause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 15 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: {"unpause": {}} Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: exception: Cannot 'unpause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'unpause': {}}} Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state active. Cannot unpause while the instance is in this state. Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:26.922540 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:26.927189 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:26.927189 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:26.927189 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:26.927189 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:26.927189 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:26.928214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'unpause' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:26.929261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f1498224-6b66-4b57-b4d2-d2cc1c89ba8e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 145 microversion: 2.1 time: 0.073991 Sep 03 21:16:26.930356 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2840/5447] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:26 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:16:26.939505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:26.940132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:26.947317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.947932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.948389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:26.949170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:26.949643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:26.950079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:27.287542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:27.313865 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a097b679-2938-49c9-8e03-288764bb84f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.377690 Sep 03 21:16:27.315370 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2608/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:26 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:27.343282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:27.344159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:27.360886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:27.361443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:27.362155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:27.375271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:27.377129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:27.377853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:27.685408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:27.696020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0c7b71f-0a56-4686-b8a5-544eeb6ceb17 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.357330 Sep 03 21:16:27.697458 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2841/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:27 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:27.721967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:27.722490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:27.740031 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/0ba959e8-7ace-4dc8-99d5-1d386ff08bc1/action HTTP/1.1 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 18 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: {"unshelve": null} Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0ba959e8-7ace-4dc8-99d5-1d386ff08bc1', 'body': {'unshelve': None}} Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:27.741841 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 0ba959e8-7ace-4dc8-99d5-1d386ff08bc1 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f0eeb9ca-4204-4bd4-8fd8-30e25bbf329c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/0ba959e8-7ace-4dc8-99d5-1d386ff08bc1/action" status: 404 len: 111 microversion: 2.1 time: 0.025357 Sep 03 21:16:27.749490 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2609/5450] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:27 2022] POST /compute/v2.1/servers/0ba959e8-7ace-4dc8-99d5-1d386ff08bc1/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:16:27.752034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:27.752654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:27.771114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:27.771624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:27.772065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:27.772789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:27.773277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:27.773701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.106878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:28.138637 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d159003f-a234-4482-b398-d3ee903dbd3e tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.390192 Sep 03 21:16:28.141161 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2842/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:27 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:28.176803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:28.177471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:28.199084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.199601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.200053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.200800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.201301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.201739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.558902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:28.586161 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-869aa8c4-9c9a-4069-9052-4c60ad6ede5c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.412898 Sep 03 21:16:28.588369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2610/5452] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:28 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:28.619220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:28.620315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:28.628112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.629028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.629694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.630821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.631561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.632295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.665761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Cannot 'unshelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action HTTP/1.1 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 18 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: {"unshelve": null} Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: exception: Cannot 'unshelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'unshelve': None}} Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 in vm_state active. Cannot unshelve while the instance is in this state. Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 21:16:28.668214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active Sep 03 21:16:28.673457 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:28.675751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 409 to user: Cannot 'unshelve' instance a00689f0-a597-4d55-b8da-3e8f6385a329 while it is in vm_state active {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:28.678255 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-610a4da9-e38b-4a0e-894f-c79545a9f525 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action" status: 409 len: 146 microversion: 2.1 time: 0.063730 Sep 03 21:16:28.683587 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2611/5453] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:16:28 2022] POST /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329/action => generated 146 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 21:16:28.698653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:28.700259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:28.708668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.709480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.710094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:28.711107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:28.711742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:28.714703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.038914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:29.068124 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5876cf5c-2172-4efa-bd8f-b269ff733c56 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.379110 Sep 03 21:16:29.068786 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2612/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:28 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:29.100122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.101173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:29.109521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.110332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.111180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.112095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.112730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.113362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.127953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-489bea6e-b1ba-41d7-b598-aee484e78574 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-4271531", "availability_zone": "foo_zone"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.132596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.aggregate [None req-489bea6e-b1ba-41d7-b598-aee484e78574 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Generated uuid 531efb8b-4d0f-4266-9841-9137061d1158 for aggregate {{(pid=140520) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 03 21:16:29.194354 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-489bea6e-b1ba-41d7-b598-aee484e78574 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 206 microversion: 2.1 time: 0.707373 Sep 03 21:16:29.196270 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2843/5455] 10.222.0.16 () {60 vars in 1164 bytes} [Sat Sep 3 21:16:28 2022] POST /compute/v2.1/os-aggregates => generated 206 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:16:29.207972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e4d18ed-5a3a-4c7d-9637-f5c937de4532 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.265178 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e4d18ed-5a3a-4c7d-9637-f5c937de4532 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 316 microversion: 2.1 time: 0.061253 Sep 03 21:16:29.266784 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2844/5456] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 21:16:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 316 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:29.281106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.296673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.296673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.297139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.298034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.298689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.299697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.352321 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-044518e2-2d1f-4834-8913-88b2d657fc05 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077980 Sep 03 21:16:29.354009 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2845/5457] 10.222.0.16 () {58 vars in 1176 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:29.367525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a3fe598-a9da-47c6-b6e2-343b4b3234d8 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.378037 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a3fe598-a9da-47c6-b6e2-343b4b3234d8 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 295 microversion: 2.1 time: 0.015948 Sep 03 21:16:29.379270 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2846/5458] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/os-aggregates => generated 295 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:29.385967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:29.391868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-195109ca-206e-460c-bf20-91407b065708 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.397417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e58d725b-5c3f-436e-a181-9c77de27b67d tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.301521 Sep 03 21:16:29.398748 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2613/5459] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:29.406037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-195109ca-206e-460c-bf20-91407b065708 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.406823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-195109ca-206e-460c-bf20-91407b065708 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.408058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-195109ca-206e-460c-bf20-91407b065708 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.423028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1623097380_updated"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.426055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 0d60ac60-5d66-4164-b56d-03842ef7eade] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:29.433060 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/servers/0d60ac60-5d66-4164-b56d-03842ef7eade HTTP/1.1 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 81 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1623097380_updated"}} Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0d60ac60-5d66-4164-b56d-03842ef7eade', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1623097380_updated'}}} Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 03 21:16:29.434857 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.439544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 0d60ac60-5d66-4164-b56d-03842ef7eade could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:29.440793 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0c5e490-f53c-4d92-90d8-aee3ef28fc45 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "PUT /compute/v2.1/servers/0d60ac60-5d66-4164-b56d-03842ef7eade" status: 404 len: 111 microversion: 2.1 time: 0.021301 Sep 03 21:16:29.441822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2614/5460] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:16:29 2022] PUT /compute/v2.1/servers/0d60ac60-5d66-4164-b56d-03842ef7eade => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:16:29.450890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.451656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:29.460123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.461483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.462096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.463783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.464367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.464940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.629525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:29.639557 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd8b4174-f60b-4262-9de1-4181701d54cb tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.193601 Sep 03 21:16:29.641155 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2615/5461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:29.666133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.666827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:29.676832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.678342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.680129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.682896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.683598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.684203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.904680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-195109ca-206e-460c-bf20-91407b065708 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 307 microversion: 2.1 time: 0.517120 Sep 03 21:16:29.905321 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2847/5462] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 21:16:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 307 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:16:29.912137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:29.920012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-90b829d2-fdd9-485b-a125-10389dfca5cb tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.922432 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0239eec7-e230-46c8-ba00-0e70ce68b762 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.260329 Sep 03 21:16:29.933616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:29.934293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2616/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:29.938139 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-90b829d2-fdd9-485b-a125-10389dfca5cb tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 307 microversion: 2.1 time: 0.025257 Sep 03 21:16:29.939261 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2848/5464] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 307 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:29.951546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6df872-54cc-473e-9b45-5cca5b840358 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.956783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dcae3fb7-ae1d-45b6-93e9-2e8659f900a1 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1628847276", "availability_zone": "foo_zone"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6df872-54cc-473e-9b45-5cca5b840358 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: request: PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 HTTP/1.1 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 280 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.957009 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd6df872-54cc-473e-9b45-5cca5b840358 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:29.960208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd6df872-54cc-473e-9b45-5cca5b840358 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 400 len: 619 microversion: 2.1 time: 0.011338 Sep 03 21:16:29.963115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2617/5465] 10.222.0.16 () {60 vars in 1257 bytes} [Sat Sep 3 21:16:29 2022] PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:16:29.968475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:29.969173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:29.977933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.978507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.978965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:29.979942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:29.981115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:29.981564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.027270 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dcae3fb7-ae1d-45b6-93e9-2e8659f900a1 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.079853 Sep 03 21:16:30.028658 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2849/5466] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Sep 3 21:16:29 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:30.046613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-813dab87-3351-452d-a852-a4512136575a tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:30.098449 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-813dab87-3351-452d-a852-a4512136575a tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.056652 Sep 03 21:16:30.099687 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2850/5467] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 21:16:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:30.115537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ef0bcc64-bf66-4240-b721-ba122dc09ea2 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:30.132712 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ef0bcc64-bf66-4240-b721-ba122dc09ea2 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.021797 Sep 03 21:16:30.134601 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2851/5468] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Sep 3 21:16:30 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:30.154733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e6a67428-6f8b-4e9d-aec1-0a0bd27f6f45 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:30.167112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6a67428-6f8b-4e9d-aec1-0a0bd27f6f45 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:30.167645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6a67428-6f8b-4e9d-aec1-0a0bd27f6f45 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:30.168096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e6a67428-6f8b-4e9d-aec1-0a0bd27f6f45 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.189021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:30.197772 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-750ee551-b69f-4c7a-a974-90050db28ab1 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.234308 Sep 03 21:16:30.211850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2618/5469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:29 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:30.245881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:30.246804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:30.262242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:30.263475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:30.263918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.266966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:30.267595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:30.269141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.349861 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e6a67428-6f8b-4e9d-aec1-0a0bd27f6f45 tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.206262 Sep 03 21:16:30.351187 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2852/5470] 10.222.0.16 () {60 vars in 1194 bytes} [Sat Sep 3 21:16:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:30.363810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-87547270-2f9e-4c87-9db3-5a5cb82049af tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:30.393726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-87547270-2f9e-4c87-9db3-5a5cb82049af tempest-TestAggregatesBasicOps-569756754 tempest-TestAggregatesBasicOps-569756754-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.033681 Sep 03 21:16:30.394624 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2853/5471] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Sep 3 21:16:30 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 03 21:16:30.548601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:30.562905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a21c74f-818e-4a89-9d69-4c92eb33e322 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.330524 Sep 03 21:16:30.577753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2619/5472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:30 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:30.592314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9cf0b109-764b-4397-a466-00d36a49ca69 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9cf0b109-764b-4397-a466-00d36a49ca69 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: request: PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 HTTP/1.1 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 24 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: {"server": {"name": ""}} Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329', 'body': {'server': {'name': ''}}} Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '' Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:16:30.597221 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:30.602457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9cf0b109-764b-4397-a466-00d36a49ca69 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:30.611649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9cf0b109-764b-4397-a466-00d36a49ca69 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 400 len: 108 microversion: 2.1 time: 0.019220 Sep 03 21:16:30.611649 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2854/5473] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:16:30 2022] PUT /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:16:30.615918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:30.616639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:30.623416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:30.624759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:30.625256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.626501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:30.627022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:30.627814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:30.859215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:30.874961 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2903509e-1665-456b-b3e6-13bb43fa2c63 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1505 microversion: 2.1 time: 0.263649 Sep 03 21:16:30.876165 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2620/5474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:30 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:31.393758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:31.394338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:31.411501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.412320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.413461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.414427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.415039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.416249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.440258 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b HTTP/1.1 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4696eb57-f738-4d81-b1fc-b8018eaa655b'} Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:31.443801 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.449864 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.451639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:31.453004 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-223fb284-facf-4693-a1f3-537f11ce1d2c tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 404 len: 111 microversion: 2.1 time: 0.067527 Sep 03 21:16:31.454361 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2855/5475] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:16:31 2022] DELETE /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:16:31.462454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:31.463329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: 4696eb57-f738-4d81-b1fc-b8018eaa655b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:31.472463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.473249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.475469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.476663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.477876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.478486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.502633 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b HTTP/1.1 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '4696eb57-f738-4d81-b1fc-b8018eaa655b'} Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:31.506147 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. Sep 03 21:16:31.511315 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:31.513121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance 4696eb57-f738-4d81-b1fc-b8018eaa655b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:31.514355 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-453475d1-61cb-4a37-b8e7-b97133160d91 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b" status: 404 len: 111 microversion: 2.1 time: 0.056211 Sep 03 21:16:31.515522 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2621/5476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:31 2022] GET /compute/v2.1/servers/4696eb57-f738-4d81-b1fc-b8018eaa655b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:16:31.523446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:31.524119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:31.530682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.531170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.531805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.532732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.533253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.533900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.562657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:31.568073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:16:31.680023 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-29e233a7-fe1b-4b4c-9dd2-3ed800e24278 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 204 len: 0 microversion: 2.1 time: 0.160367 Sep 03 21:16:31.684584 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2856/5477] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:16:31 2022] DELETE /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:16:31.690009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:31.690407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:31.698414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=60 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:31.702646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.703390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.704101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.705163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:31.705815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:31.706473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:31.961244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:31.986833 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-434f2ad3-aea8-470a-98d8-36c23aa54c8a tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.301119 Sep 03 21:16:32.002549 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2622/5478] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:31 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:33.027181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:33.031177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:33.039839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:33.041153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:33.041811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:33.042728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:33.043526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:33.044449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:33.275478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:33.284121 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0370cd50-ce7f-4c04-8cd4-22bbbebb79f0 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.270856 Sep 03 21:16:33.284711 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2857/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:33 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:34.309662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:34.311053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:34.318912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:34.319598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:34.320207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:34.321570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:34.322233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:34.322829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:34.541215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4d4dfdda4f4f86a6cffadc35d9e68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42698a69a75f4d6583e8dd7df3926aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:34.556750 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2bd8fc31-6e9b-4009-a0e9-c075ca7131a7 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 200 len: 1511 microversion: 2.1 time: 0.251008 Sep 03 21:16:34.569950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2623/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:34 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:35.190984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00689f0-a597-4d55-b8da-3e8f6385a329", "name": "network-vif-deleted", "tag": "1bee4823-31d0-453b-ad8c-71411ea4187f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:35.216933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:35.217433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:35.217869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:35.249857 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] Creating event network-vif-deleted:1bee4823-31d0-453b-ad8c-71411ea4187f for instance a00689f0-a597-4d55-b8da-3e8f6385a329 on nch1-master-1 Sep 03 21:16:35.262224 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-288735da-5e46-4b57-a776-1bd593e042e9 req-b02b9e62-fb16-4fed-abdc-a300767a1cab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210083 Sep 03 21:16:35.264507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2858/5481] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:35.584215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:35.586596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] [instance: a00689f0-a597-4d55-b8da-3e8f6385a329] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:35.595437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:35.596332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:35.597186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:35.598480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:35.599185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:35.602606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:35.634809 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] HTTP exception thrown: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Request method failure captured: Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 HTTP/1.1 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8OLoQrUdRY4d8yJ30mOPsnDU8b6l20MviYIwpzf4DeLzAoOvTeXXK8q5wsFtFO--FsJ8ninaA6BXoMcZXjgvLn2pSJV1ZTqE2e4gc7b8Vq_9NLTMQsqCc-U4jvlKKAGLchaX51YaijN6GQ9bBfOyLVEdNDrnbjUIRoGPrtwvnYN4xA Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42698a69a75f4d6583e8dd7df3926aa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 42698a69a75f4d6583e8dd7df3926aa6 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-557566260 Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: ec4d4dfdda4f4f86a6cffadc35d9e68e Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-557566260-project Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a00689f0-a597-4d55-b8da-3e8f6385a329'} Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:16:35.637093 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. Sep 03 21:16:35.641065 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:16:35.643328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] Returning 404 to user: Instance a00689f0-a597-4d55-b8da-3e8f6385a329 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:16:35.645533 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba43c626-fd8a-4011-aec3-39428cbeca05 tempest-ServersNegativeTestJSON-557566260 tempest-ServersNegativeTestJSON-557566260-project] 10.222.0.16 "GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329" status: 404 len: 111 microversion: 2.1 time: 0.067902 Sep 03 21:16:35.646807 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2624/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:35 2022] GET /compute/v2.1/servers/a00689f0-a597-4d55-b8da-3e8f6385a329 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:16:43.796865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:44.145330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-49cbb29f-7829-49be-a5ab-0876b6ff17a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: .version_select at 0x7fae66fe4af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1831114313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERblmB0GYyaQmdFxexPCSmeukqycSAAuhCOWev7GxjHtd+/pr4Vod/8TJwbpPptpi5t3XdX7tTdOP2OwdD5qi6xMgaf/llnY7i96IBedcwUjCGpVgUW2NvvBDnBdADhdw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:44.164883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-49cbb29f-7829-49be-a5ab-0876b6ff17a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:16:44.172686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-49cbb29f-7829-49be-a5ab-0876b6ff17a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:16:44.217021 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-49cbb29f-7829-49be-a5ab-0876b6ff17a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.427982 Sep 03 21:16:44.217643 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2859/5483] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:16:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:16:52.197540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1349624836", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "e89d0296-aa6c-4671-85f9-5f3a552d598c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1831114313", "security_groups": [{"name": "tempest-secgroup-smoke-316417728"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:16:52.207994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=5 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:52.224519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=81 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:52.380719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] validate_networks() for [('e89d0296-aa6c-4671-85f9-5f3a552d598c', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:16:53.100193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:16:53.100769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:16:53.101542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:16:53.102104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:16:53.103251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:16:53.115666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:53.116627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:53.117548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:53.118705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:53.119460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:53.120412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:53.145945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:16:53.152413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:16:53.168682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:16:53.171121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:16:53.237250 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd02a08d-b6a9-4e0c-b205-9fc450dce6cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.043543 Sep 03 21:16:53.244461 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2625/5484] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:16:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:16:53.249921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e593c5ff-bccf-49da-ab80-4cb6965a5f78 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:53.250756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e593c5ff-bccf-49da-ab80-4cb6965a5f78 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:53.253860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:53.316059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e593c5ff-bccf-49da-ab80-4cb6965a5f78 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:53.324429 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e593c5ff-bccf-49da-ab80-4cb6965a5f78 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1267 microversion: 2.1 time: 0.078924 Sep 03 21:16:53.325029 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2860/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:53 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:16:54.348930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dc3e5898-c688-4c4f-8ae4-9a991de91128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:54.350060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dc3e5898-c688-4c4f-8ae4-9a991de91128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:54.427222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dc3e5898-c688-4c4f-8ae4-9a991de91128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:54.435526 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dc3e5898-c688-4c4f-8ae4-9a991de91128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1267 microversion: 2.1 time: 0.091596 Sep 03 21:16:54.449573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2626/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:54 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:55.464378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-675c6f69-6008-476f-a0b5-d842ec544907 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:55.469270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-675c6f69-6008-476f-a0b5-d842ec544907 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:55.575546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-675c6f69-6008-476f-a0b5-d842ec544907 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:55.585514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-675c6f69-6008-476f-a0b5-d842ec544907 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1267 microversion: 2.1 time: 0.124890 Sep 03 21:16:55.600927 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2861/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:55 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:56.608189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6540905-4614-4d6c-816d-576532e069ef tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:56.609103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6540905-4614-4d6c-816d-576532e069ef tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:56.681111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6540905-4614-4d6c-816d-576532e069ef tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:56.691876 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6540905-4614-4d6c-816d-576532e069ef tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1267 microversion: 2.1 time: 0.087123 Sep 03 21:16:56.709411 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2627/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:56 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:57.717398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:57.718016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:57.726800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:57.728148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:57.728784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:57.729929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:57.730547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:57.731137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:57.815820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:57.826373 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb0c7296-ed57-4e1c-9670-6b26690a4562 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1271 microversion: 2.1 time: 0.113056 Sep 03 21:16:57.827997 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2862/5489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:57 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:16:58.851051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:16:58.851993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:16:58.860177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:58.860756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:58.861231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:58.861979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:16:58.862436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:16:58.863084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:16:58.976018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:16:58.987698 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c420cd25-f6f3-4fe5-8e3a-fc08bfed41cb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1325 microversion: 2.1 time: 0.140453 Sep 03 21:16:58.988220 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2628/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:16:58 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1325 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:00.015662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:00.016287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:00.022843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:00.028227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:00.034645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:00.035135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:00.035887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:00.036395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:00.036780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:00.360831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:00.374492 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2bc2d1f7-a6f3-4fe9-a8cc-5d60da23387c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.363863 Sep 03 21:17:00.389800 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2863/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:00 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:00.720201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:00.757437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:00.757998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:00.758662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:00.778274 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] Creating event network-changed:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch2-master-1 Sep 03 21:17:00.784736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-61195d31-cb7e-480c-ae3e-0c80d4727267 req-8f51c137-5d52-4f72-992f-10448e618533 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067743 Sep 03 21:17:00.785773 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2629/5492] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:17:01.403368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:01.404037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:01.416506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:01.417049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:01.417487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:01.418203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:01.418653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:01.419689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:01.582386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:01.592557 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f9ddd2b-4241-4e53-9d46-f008e75b3e57 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.193564 Sep 03 21:17:01.594079 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2864/5493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:01 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:02.619992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:02.620709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:02.627276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:02.627788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:02.628237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:02.628989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:02.630419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:02.630419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:02.823492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:02.831244 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c691afbb-46da-46c1-bfa6-7c91759556d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.218316 Sep 03 21:17:02.831835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2630/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:02 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:03.855558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:03.856171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:03.863552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:03.863969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:03.864418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:03.865178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:03.865634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:03.866062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:04.079020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:04.093721 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c3a83886-2f3b-4b48-b677-a7080fef9644 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.242905 Sep 03 21:17:04.094433 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2865/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:03 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:05.118107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:05.118736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:05.121818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:05.127668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:05.128173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:05.128614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:05.129556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:05.130168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:05.130754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:05.328041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:05.337875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-db5a6966-900d-41ac-9ab2-22ae36ea489c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.223460 Sep 03 21:17:05.338889 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2631/5496] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:05 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:05.687784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "name": "network-vif-plugged", "status": "completed", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:05.698009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:05.702665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:05.703944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:05.704561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:05.724202 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] Creating event network-vif-plugged:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch2-master-1 Sep 03 21:17:05.731980 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e4e994f1-7294-4195-b2fb-9195545a0159 req-5fe1f847-9c59-49ac-a141-2fb6d7c8e7f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048188 Sep 03 21:17:05.732796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2866/5497] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:17:06.361780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:06.362427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:06.370794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:06.371287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:06.371730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:06.372532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:06.372878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:06.373325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:06.563475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:06.572166 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49a1bf73-0c01-4763-8237-e052e7ce571c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1392 microversion: 2.1 time: 0.214319 Sep 03 21:17:06.572741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2632/5498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:06 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:07.598261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:07.599245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:07.606123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:07.606769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:07.607447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:07.608524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:07.609081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:07.609588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:07.782601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:07.791017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d45bf711-8499-4363-9277-efe1d7b90c36 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1564 microversion: 2.1 time: 0.197859 Sep 03 21:17:07.791589 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2867/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:07 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:07.814778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:07.816003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:07.818338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:07.825000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:07.825503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:07.825954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:07.826668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:07.827131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:07.827567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:07.967699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:07.975651 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5efc355e-ef6c-4705-958e-12684a6f106f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1564 microversion: 2.1 time: 0.165639 Sep 03 21:17:07.976490 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2633/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:07 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:10.319857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:10.321613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:10.334679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:10.335341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:10.335798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:10.336582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:10.337289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:10.337994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:10.341222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:10.364548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:10.369598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:10.371664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:10.397622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] Creating event network-changed:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch2-master-1 Sep 03 21:17:10.407761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bd4f2d53-f9d3-4aca-97c8-17b1407fb34a req-075d03be-15c7-4f15-9061-a3b516ad36b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075900 Sep 03 21:17:10.409251 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2634/5501] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:17:10.585491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:10.600941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-852e8dc3-3d76-48ae-b15e-47625f3223c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1564 microversion: 2.1 time: 0.285409 Sep 03 21:17:10.601542 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2868/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:10 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1564 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:21.542987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:21.544168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=36 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:21.548646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:21.549459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:21.575362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:21.575809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:21.577068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:21.577831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:21.578305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:21.578739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:21.616694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:17:21.728427 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a575282e-90a9-4ab4-8672-1eca17f48fb8 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 204 len: 0 microversion: 2.1 time: 0.187807 Sep 03 21:17:21.729671 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2635/5503] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:17:21 2022] DELETE /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:17:21.738122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:21.738749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:21.742137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=11 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:21.742865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=38 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:21.757039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:21.759707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:21.760332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:21.761474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:21.761948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:21.765561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:21.947603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:21.967762 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58b0b16a-dc88-4b54-9648-6ef19c49f487 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1509 microversion: 2.1 time: 0.233603 Sep 03 21:17:21.968952 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2869/5504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:21 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:22.996847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:22.997609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:23.009290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:23.009992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:23.010601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:23.011483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:23.012101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:23.012768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:23.219702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:23.227611 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c4b5bfcb-c3ce-47c0-b49f-e9b9451bc581 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 200 len: 1509 microversion: 2.1 time: 0.236202 Sep 03 21:17:23.228405 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2636/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:22 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:23.503078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e93e45-2e21-4334-bd61-549f421cfd38", "name": "network-vif-deleted", "tag": "3f0a4b9a-1c92-46e5-b5e6-470595279881"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:23.526257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:23.526751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:23.527561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:23.540426 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] Creating event network-vif-deleted:3f0a4b9a-1c92-46e5-b5e6-470595279881 for instance e0e93e45-2e21-4334-bd61-549f421cfd38 on nch1-master-1 Sep 03 21:17:23.548462 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5fdcdc5e-affd-4536-929b-41ff9dcb2cfc req-55370814-4c21-421f-ac77-174c3cc3be12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048201 Sep 03 21:17:23.551175 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2870/5506] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:17:24.251608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:24.252332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e0e93e45-2e21-4334-bd61-549f421cfd38] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:24.271165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.272099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.272806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.274206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.274779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.275427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.290547 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 HTTP/1.1 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'e0e93e45-2e21-4334-bd61-549f421cfd38'} Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:17:24.292235 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. Sep 03 21:17:24.297002 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:17:24.298387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 404 to user: Instance e0e93e45-2e21-4334-bd61-549f421cfd38 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:17:24.299241 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1996f8b5-82f7-4b67-8762-2fd13e2b7d42 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38" status: 404 len: 111 microversion: 2.1 time: 0.051553 Sep 03 21:17:24.302709 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2637/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:24 2022] GET /compute/v2.1/servers/e0e93e45-2e21-4334-bd61-549f421cfd38 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:17:24.309996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:24.310597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:24.317642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.318146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.318590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.319298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.319753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.320876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.352292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:17:24.452159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-edc88762-d526-442b-881b-bce5bb3f51d1 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 204 len: 0 microversion: 2.1 time: 0.147560 Sep 03 21:17:24.456258 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2871/5508] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:17:24 2022] DELETE /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:17:24.463543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:24.464401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:24.470846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.473695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.474360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.475078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:24.475537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:24.475965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:24.784872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:24.794711 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46ebca64-57ec-4594-bcc3-3a1713ceeb0a tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1522 microversion: 2.1 time: 0.335817 Sep 03 21:17:24.810089 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2638/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:24 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:25.825579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:25.826836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:25.839989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:25.840784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:25.841423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:25.843528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:25.844374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:25.845018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:26.015876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db307623f73f4532a96342f551ba011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7715a4d463a44168bc78b9fa7a7718f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:26.032071 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5190a24e-4d1d-48fb-b0a9-3af280c548af tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 200 len: 1480 microversion: 2.1 time: 0.214171 Sep 03 21:17:26.032716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2872/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:25 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 1480 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:26.071715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8", "name": "network-vif-deleted", "tag": "1af5687c-5172-43ca-838f-d2a3c7563df1"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:26.098289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:26.098789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:26.099232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:26.158714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] Creating event network-vif-deleted:1af5687c-5172-43ca-838f-d2a3c7563df1 for instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 on nch2-master-1 Sep 03 21:17:26.201633 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4797341f-c92b-4b25-b311-8fcfef36dda2 req-108de3c1-d276-4df2-bec9-6d24893baaa6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135118 Sep 03 21:17:26.216618 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2639/5511] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:17:27.062656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:27.064438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] [instance: e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:27.102509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:27.110399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:27.111058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:27.112083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:27.112557 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:27.116128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:27.148308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] HTTP exception thrown: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Request method failure captured: Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 HTTP/1.1 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE789uH4X1RbnidhSWTKPPQZrL3aV66iLcYn4pK7VWbyo_yjbA_9hXfFOGkRW3Z-DmOy_p-WouIj2uyfbSiMCfJhHcfhf01sIvOweKptLx8yhr9X8oPV4B8vm08a1gw39fFmVeuu-VK2NZztU7nVsZvzzpkcx7wzxQDhNql7puwtivTE Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7715a4d463a44168bc78b9fa7a7718f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: a7715a4d463a44168bc78b9fa7a7718f Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1941320848 Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: db307623f73f4532a96342f551ba011c Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1941320848-project Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8'} Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:27.150953 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Returning 404 to user: Instance e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8" status: 404 len: 111 microversion: 2.1 time: 0.100216 Sep 03 21:17:27.156332 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2873/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:27 2022] GET /compute/v2.1/servers/e8a9ba29-6b8e-4a5d-a6da-c3f97e5718f8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:17:31.076381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:31.081315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:31.092785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:31.094324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:31.096045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:31.099393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:31.100928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:31.102512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:31.210900 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29e84afd-dd9e-4e8e-a8ba-65c30402a4e7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action" status: 200 len: 24565 microversion: 2.1 time: 0.136886 Sep 03 21:17:31.212017 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2640/5513] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:17:31 2022] POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action => generated 24565 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:17:38.497531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:38.499290 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4dd27f66-6dd7-4812-bc7d-4fb24dc1e746 tempest-ServerRescueNegativeTestJSON-1941320848 tempest-ServerRescueNegativeTestJSON-1941320848-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002168 Sep 03 21:17:38.500074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2874/5514] 10.222.0.16 () {56 vars in 886 bytes} [Sat Sep 3 21:17:38 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 03 21:17:42.188104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:42.189446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:42.201300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:42.202599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:42.212461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:42.213707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:42.214715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:42.216109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:42.217682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:42.218337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:42.571251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d78e4faa-d13d-4d61-8fad-a0abb38e6ffd tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1833 microversion: 2.1 time: 0.385250 Sep 03 21:17:42.585402 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2641/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:42 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1833 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:42.594647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:42.595354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:42.598384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:42.599298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:42.607029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:42.607532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:42.607981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:42.608702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:42.609219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:42.609658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:42.892604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:42.901820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe86417b-6d7f-486f-bfc7-03bd49869f7f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1682 microversion: 2.1 time: 0.311350 Sep 03 21:17:42.902525 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2875/5516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:42 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1682 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:43.008854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:43.011881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:43.025291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.026478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.027142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.027879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.028535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.029003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.098348 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ee03c581-861e-4d4c-997e-61f5ef27325c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action" status: 200 len: 32643 microversion: 2.1 time: 0.093103 Sep 03 21:17:43.100367 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2642/5517] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:17:43 2022] POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action => generated 32643 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:17:43.280761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:43.281373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:43.289710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.290216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.290666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.291383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.291843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.292503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.523756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01ba5e445af242a69db93175b6d44fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8013e1e6804708b2991d2dcd829154', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:43.524400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: c27501fa-c383-4755-a04f-5e699945c921] flavor_id is None. Assuming migration. {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 03 21:17:43.524858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: c27501fa-c383-4755-a04f-5e699945c921] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:17:43.699353 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0cda6200-fa2d-40e1-a91c-483897232695 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action" status: 202 len: 0 microversion: 2.1 time: 0.422395 Sep 03 21:17:43.701155 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2876/5518] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:17:43 2022] POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:17:43.718409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:43.718954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:43.729144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.729656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.730394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.731316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:43.731871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:43.732579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:43.853970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Action: 'create', calling method: .version_select at 0x7fae6683ab80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-381307313"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:17:43.999327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:44.011984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f75e76e3-9695-4e00-a061-3c0afcd44b6c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1691 microversion: 2.1 time: 0.299640 Sep 03 21:17:44.014044 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2877/5519] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:43 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1691 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:44.245629 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.546941 Sep 03 21:17:44.263215 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2643/5520] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Sep 3 21:17:43 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 565 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 03 21:17:44.264751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c9163a95-6347-407f-b795-c75f7d92b7ae tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Calling method '.version_select at 0x7fae65e0c040>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:44.331358 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c9163a95-6347-407f-b795-c75f7d92b7ae tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c" status: 200 len: 337 microversion: 2.1 time: 0.073575 Sep 03 21:17:44.332199 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2878/5521] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:17:44 2022] GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c => generated 337 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:17:45.040168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:45.040926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:45.048743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:45.049519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:45.049967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:45.050675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:45.051131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:45.051740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:45.187430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:45.195996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3776431-322c-40c0-a7ca-e48356b32385 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1691 microversion: 2.1 time: 0.161761 Sep 03 21:17:45.196581 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2644/5522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:45 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:45.347251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-972037e9-18dc-426d-a4a2-f319b76e1428 tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Calling method '.version_select at 0x7fae65b4de50>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:45.397720 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-972037e9-18dc-426d-a4a2-f319b76e1428 tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c" status: 200 len: 334 microversion: 2.1 time: 0.055650 Sep 03 21:17:45.405031 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2879/5523] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:17:45 2022] GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c => generated 334 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:17:45.421048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c0d3464-f8f4-4bf8-9ac5-dc61bed4affd tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Calling method '.version_select at 0x7fae660368b0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:45.555578 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c0d3464-f8f4-4bf8-9ac5-dc61bed4affd tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c" status: 202 len: 0 microversion: 2.1 time: 0.138518 Sep 03 21:17:45.556696 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2645/5524] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:17:45 2022] DELETE /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:17:45.564434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6fb13b69-b49b-4272-951a-5c01a35f183d tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Calling method '.version_select at 0x7fae65caec10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:45.594566 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-6fb13b69-b49b-4272-951a-5c01a35f183d tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] HTTP exception thrown: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6fb13b69-b49b-4272-951a-5c01a35f183d tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Request method failure captured: Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c HTTP/1.1 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8R3Sr9GZS1yh7xLCm3VNAn_pTxHSyQpGrd1AMC3aIu2mCLEhI2Rmtwzd3zN8XuaIyDUXKYLhCd_0tgP9xagDFi6kVhuKQfeE_zls6Q8pXQhuwIbuS0lXgzS0JcPoI1C-P4Q4HGh1ODksTzoLE5lda8Ynn37W1QOjs8xLZlHU50evBE Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: db906426fb8a437cb03072319b2d92db Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1878280041 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db906426fb8a437cb03072319b2d92db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_db906426fb8a437cb03072319b2d92db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/db906426fb8a437cb03072319b2d92db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/db906426fb8a437cb03072319b2d92db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1878280041 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: db906426fb8a437cb03072319b2d92db Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1878280041 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-VolumesSnapshotsTestJSON-1878280041-project Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 3aa7ddc203f848faaf8746e5b09a3c76 Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1878280041-project Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: method: Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: exception: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '4a5cc895-c092-4764-82ac-32253a13886c'} Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. (HTTP 404) (Request-ID: req-6a03ecd5-43c2-497a-ac0d-c008cbaef235) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 21:17:45.596526 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. Sep 03 21:17:45.600850 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:17:45.605700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6fb13b69-b49b-4272-951a-5c01a35f183d tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] Returning 404 to user: Volume 4a5cc895-c092-4764-82ac-32253a13886c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:17:45.606839 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6fb13b69-b49b-4272-951a-5c01a35f183d tempest-VolumesSnapshotsTestJSON-1878280041 tempest-VolumesSnapshotsTestJSON-1878280041-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c" status: 404 len: 109 microversion: 2.1 time: 0.046305 Sep 03 21:17:45.611872 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2880/5525] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Sep 3 21:17:45 2022] GET /compute/v2.1/os-volumes/4a5cc895-c092-4764-82ac-32253a13886c => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:17:46.220602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:46.221252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:46.228874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:46.229389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:46.230006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:46.230969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:46.231425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:46.231856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:46.509634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:46.519412 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48857a73-ce32-4623-a0e9-1efc2b2de2a6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.303507 Sep 03 21:17:46.533464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2646/5526] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:46 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:47.546644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:47.547268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:47.555925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:47.556729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:47.557960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:47.559057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:47.559611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:47.560249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:47.721989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:47.732587 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b409fc0-7a77-435b-afcd-f9d69223b854 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.191204 Sep 03 21:17:47.741376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2881/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:47 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:48.758930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:48.762984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:48.780692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:48.782826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:48.783376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:48.784297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:48.784623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:48.785097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:48.936876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:48.946220 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-75fe55dd-6186-41b6-8d60-f373967ac78c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.193154 Sep 03 21:17:48.946835 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2647/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:48 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:49.972805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:49.973490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:49.990946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:49.993233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:49.993694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:49.997105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:49.997754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:49.998890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:50.248667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:50.258558 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fe7cfffd-7f27-4e24-9d97-df7664de8be8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.291054 Sep 03 21:17:50.259327 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2882/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:49 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:51.283403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:51.285616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:51.299882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:51.300390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:51.300839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:51.303287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:51.303783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:51.304270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:51.504064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:51.513715 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15b2a60b-8a90-4b0e-8cd9-6ffd48dd26ab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.235222 Sep 03 21:17:51.516609 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2648/5530] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:51 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:17:52.542554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:52.543187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:52.549947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:52.550475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:52.550952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:52.551668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:52.552128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:52.552758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:52.754661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:52.768038 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3b1f3337-39a8-4fa4-a52c-626b88fce090 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.230115 Sep 03 21:17:52.769830 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2883/5531] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:52 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:53.795999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:53.797234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:53.804605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:53.805371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:53.806081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:53.806788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:53.807502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:53.808141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:53.968439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:53.980855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00a93975-7c76-4ca0-b5d5-d46f9626fe73 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.188922 Sep 03 21:17:53.981648 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2649/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:53 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:55.004854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:55.006353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:55.013820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:55.014437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:55.014877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:55.015759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:55.016379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:55.016807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:55.266779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:55.276266 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36bba609-c7b2-46f1-9f94-b9ffc4e39461 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.276170 Sep 03 21:17:55.276883 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2884/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:54 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:56.302682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:56.303305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:56.311729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:56.312705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:56.313396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:56.314548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:56.315209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:56.315837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:56.560103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:56.568969 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d03fd12-23f4-4931-9161-b9b398918a1a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.272567 Sep 03 21:17:56.570425 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2650/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:56 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:57.592886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:57.593632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:57.602046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:57.602556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:57.603056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:57.603786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:57.604250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:57.604686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:57.901353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:57.912194 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7091e1ab-f6d0-4495-bae9-0d20ca25add3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.323324 Sep 03 21:17:57.912775 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2885/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:57 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:17:58.936280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:17:58.936927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:17:58.945381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:58.945881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:58.946327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:58.947045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:17:58.947512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:17:58.947947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:17:59.160801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:17:59.201468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d3c20bdc-12bd-4029-9f2f-556d4727a116 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.259184 Sep 03 21:17:59.206766 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2651/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:17:58 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:00.229893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:00.231398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:00.240213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:00.241996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:00.243258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:00.244206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:00.244866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:00.245549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:00.589487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:00.597427 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-04bda462-6706-4fd2-9ba4-a016f9f5ba21 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.371624 Sep 03 21:18:00.598005 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2886/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:00 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:01.622883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:01.623536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:01.630818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:01.631431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:01.631978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:01.633355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:01.633931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:01.634484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:01.876236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:01.884833 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-84acfbd4-1fbd-4da1-a430-cdc62660d628 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1696 microversion: 2.1 time: 0.265714 Sep 03 21:18:01.885446 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2652/5538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:01 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:02.911415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:02.912037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:02.924151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:02.925151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:02.925748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:02.926615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:02.927547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:02.928082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:03.198107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:03.214392 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91d1d0d8-4c4d-4306-bd05-12368b18155c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1695 microversion: 2.1 time: 0.306964 Sep 03 21:18:03.232879 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2887/5539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:02 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1695 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:03.587070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "name": "network-vif-unplugged", "status": "completed", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:18:03.608877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:03.610941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:03.611740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:03.638765 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Creating event network-vif-unplugged:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch1-master-1 Sep 03 21:18:03.656695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] Instance c27501fa-c383-4755-a04f-5e699945c921 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:18:03.679639 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-889aa5bf-0d38-48f8-92f4-90ad289c3a8f req-6df20898-d5e1-4fd4-beaa-365a362486a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097219 Sep 03 21:18:03.680886 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2653/5540] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:18:04.242999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:04.245097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:04.273459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:04.274034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:04.275439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:04.280518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:04.281345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:04.282078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:04.520408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:04.535074 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93d2a117-1ef4-4446-8bcf-a056136ecf4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1695 microversion: 2.1 time: 0.295807 Sep 03 21:18:04.536034 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2888/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:04 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1695 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:05.560748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:05.562041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:05.569844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:05.570589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:05.571218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:05.572097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:05.572716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:05.573169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:05.853200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:05.862854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-08fe69f0-141c-42af-9475-e6fd03ecd6e8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1693 microversion: 2.1 time: 0.306561 Sep 03 21:18:05.863534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2654/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:05 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1693 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:06.026779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:18:06.045127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:06.045724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:06.046405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:06.060251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Creating event network-changed:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch1-master-1 Sep 03 21:18:06.067500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] Instance c27501fa-c383-4755-a04f-5e699945c921 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:18:06.078620 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e4bf4c7e-c517-4d94-9a34-c330faa36852 req-1a13374a-591d-4ec9-82f0-b6d3156bb023 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056411 Sep 03 21:18:06.079236 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2889/5543] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:18:06.888828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:06.889759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:06.897579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:06.898652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:06.899096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:06.899812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:06.900274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:06.900715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:07.183428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:07.193238 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46002488-5c95-4769-b335-faa44e19b325 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1693 microversion: 2.1 time: 0.308826 Sep 03 21:18:07.194394 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2655/5544] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:06 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1693 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:08.220716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:08.222980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:08.235881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:08.236397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:08.236847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:08.237589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:08.238072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:08.238491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:08.558188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:08.571398 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-479294db-79d8-4d5a-b221-624da06a4a4c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1693 microversion: 2.1 time: 0.355774 Sep 03 21:18:08.586849 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2890/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:08 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1693 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:09.598364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:09.599792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:09.608187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:09.608911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:09.609712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:09.610644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:09.611572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:09.612201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:09.945758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:09.964615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf713141-aef8-47d2-99c7-0969962b925d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1690 microversion: 2.1 time: 0.370712 Sep 03 21:18:09.965255 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2656/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:09 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1690 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:09.987849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:18:09.988395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:09.995357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:09.995859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:09.996306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:09.997059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:09.997502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:09.997938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:10.102419 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c3ad40e-9855-44b7-bbd5-b1fd4dae5802 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action" status: 204 len: 0 microversion: 2.1 time: 0.114542 Sep 03 21:18:10.103066 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2891/5547] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:18:09 2022] POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:18:10.125170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:10.125950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:10.140185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:10.140701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:10.141176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:10.146430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:10.147022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:10.147502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:10.426149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:10.436420 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f11a9ea-703a-47f3-ae38-cb63b801c0ad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1690 microversion: 2.1 time: 0.328370 Sep 03 21:18:10.437046 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2657/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:10 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1690 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:10.902080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "name": "network-vif-plugged", "status": "completed", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:18:10.916333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:10.916925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:10.917420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:10.923241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:18:10.934133 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Creating event network-vif-plugged:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch1-master-1 Sep 03 21:18:10.941663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] Instance c27501fa-c383-4755-a04f-5e699945c921 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:18:10.956227 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-21298040-1aa4-49bd-9da8-a8094f986255 req-ed169b01-32c6-433f-8e51-000785a99cfa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058795 Sep 03 21:18:10.957574 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2892/5549] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:18:11.462097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:11.463517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:11.476331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:11.477102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:11.478376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:11.479609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:11.480221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:11.481370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:11.665416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:11.674539 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f34876fa-9eb2-439d-b4d1-82e956f4c57e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1690 microversion: 2.1 time: 0.217929 Sep 03 21:18:11.682612 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2658/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:11 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:12.703449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:18:12.705183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:12.708737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=33 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:18:12.714246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:12.715059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:12.715721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:12.716510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:12.717402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:12.718059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:12.882846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:18:12.892416 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cb72da6-e428-4043-a4c2-5540dd979392 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1682 microversion: 2.1 time: 0.194652 Sep 03 21:18:12.897221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2893/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:18:12 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:18:45.151974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:18:45.155245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:18:45.177302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=32 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:18:45.178274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=92 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:18:45.186244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:45.187184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:45.187748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:45.196497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:18:45.197501 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:18:45.198071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:18:45.280514 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-64bd1b6b-d06f-48c4-934e-646939f68411 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action" status: 200 len: 24577 microversion: 2.1 time: 0.133281 Sep 03 21:18:45.281205 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2659/5552] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:18:45 2022] POST /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921/action => generated 24577 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:19:08.009506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:08.011495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:08.012864 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:19:08.013318 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:19:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-hypervisors (ip 10.222.0.16) !!! Sep 03 21:19:08.174518 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Calling method '.version_select at 0x7fae65b39ca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:08.175266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:08.176752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:08.177039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:08.177890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:08.179945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:08.188209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:08.188919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:08.192845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:08.193850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:08.194530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:08.195220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:08.195848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:08.196284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:08.205066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:08.205823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:08.206546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:08.220375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:08.221423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:08.222167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:08.232491 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00eab3fe-6edc-4e26-98a2-b802706a440c tempest-PortsAdminExtendedAttrsTestJSON-741039114 tempest-PortsAdminExtendedAttrsTestJSON-741039114-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.228764 Sep 03 21:19:08.237026 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2894/5553] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:19:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:19:08.605840 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c6ab9e8-9b82-48e4-9765-831c33c1c1e8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1833 microversion: 2.1 time: 0.435591 Sep 03 21:19:08.606929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2660/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:08 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1833 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:10.496648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:10.497639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:10.498487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:10.510980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:10.511810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:10.512616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:10.519678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:10.523920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:10.524373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:10.526685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] Creating event network-changed:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch1-master-1 Sep 03 21:19:10.531428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:10.531997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:10.532808 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e5aa09dd-62e0-4c2a-97e8-5ad0d45d44da req-66d0d348-2b79-4b9c-96aa-d8db18b71a49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040607 Sep 03 21:19:10.533669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2661/5555] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:19:10.534847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:10.599196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:19:10.776044 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e99fb0d1-ee98-4e60-8c08-8ac24e244c0b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 204 len: 0 microversion: 2.1 time: 0.286427 Sep 03 21:19:10.781065 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2895/5556] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:19:10 2022] DELETE /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:19:10.786450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:10.787881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:10.800918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:10.801455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:10.801892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:10.802644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:10.803721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:10.804156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:11.060049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:11.068869 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9fb31843-9115-4359-bdcc-00dccfbe3935 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1688 microversion: 2.1 time: 0.286118 Sep 03 21:19:11.078293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2662/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:10 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1688 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:12.108770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:12.109791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:12.142899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:12.153414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:12.154310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:12.155621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:12.156308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:12.157252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:12.473613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:12.482675 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d51b99b5-2122-4dc6-b463-3c4b7bf960ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1688 microversion: 2.1 time: 0.382978 Sep 03 21:19:12.483450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2896/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:12 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1688 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:13.508973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:13.510334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:13.529615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:13.530325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:13.534504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:13.535276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:13.535743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:13.536179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:13.710485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:13.720481 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56588989-215b-44ee-b9eb-94807e4bd83b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 200 len: 1503 microversion: 2.1 time: 0.215902 Sep 03 21:19:13.721222 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2663/5559] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:13 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:13.741741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27501fa-c383-4755-a04f-5e699945c921", "name": "network-vif-deleted", "tag": "5dfec393-760e-49a1-a1b9-173c9d18ab04"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:13.755894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:13.757075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:13.757814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:13.770181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] Creating event network-vif-deleted:5dfec393-760e-49a1-a1b9-173c9d18ab04 for instance c27501fa-c383-4755-a04f-5e699945c921 on nch1-master-1 Sep 03 21:19:13.776047 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f8487e5d-6097-41cb-a35c-b4d50b82d760 req-2fa2b314-a6d2-4e57-beff-8bdb163eb820 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040942 Sep 03 21:19:13.776777 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2897/5560] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:19:14.747509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:14.748140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: c27501fa-c383-4755-a04f-5e699945c921] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:14.755249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:14.756633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:14.757138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:14.758046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:14.758664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:14.759256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:14.775339 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] HTTP exception thrown: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Request method failure captured: Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 HTTP/1.1 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8Q61xsrwJZH_CmX1y-Jt7jA04duaIwPytdJnkJoYu5DG2AHZVSOereuWcBL1xi7yFc9BdQ8CuHkUO0j2Wyegu-gQ5hyf1y0n6VmE4AvTu52e5sWJ1976KyvCihpFzAG4aOpTDrWz2dtbGccttFrIVf6Um160RrF-pWfUx875wZdeMc Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: b5c96be8fbe1436bb3e84340ceda1917 Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c27501fa-c383-4755-a04f-5e699945c921'} Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:19:14.777244 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. Sep 03 21:19:14.782292 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:19:14.783738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Returning 404 to user: Instance c27501fa-c383-4755-a04f-5e699945c921 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:19:14.784837 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-838b990d-9274-4ace-8385-b9a58d95678b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921" status: 404 len: 111 microversion: 2.1 time: 0.041199 Sep 03 21:19:14.785929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2664/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:14 2022] GET /compute/v2.1/servers/c27501fa-c383-4755-a04f-5e699945c921 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:19:19.684430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f007862-d5af-4a4f-9d8b-5a2a5908e56d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '.version_select at 0x7fae65c1dca0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:19.735397 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f007862-d5af-4a4f-9d8b-5a2a5908e56d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1831114313" status: 202 len: 0 microversion: 2.1 time: 0.056541 Sep 03 21:19:19.739916 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2898/5562] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Sep 3 21:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1831114313 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:19:19.774610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4d54efa-5ec8-4c6e-b51b-5cd528aa63f8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: .version_select at 0x7fae66036820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-682917983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm4ATbDYhf9t/Zvfp9lZnqEj00kBWxRhAfxOEOOm5PLvco6i6nIuluIprF0WVW9qO5YvZm5auA6VcyqA/7iZmRey0cDnx3NO2SUa8a2MYen1/52mpzAdeh3ou+avGwDLg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:19.799237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f4d54efa-5ec8-4c6e-b51b-5cd528aa63f8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:19:19.812302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-f4d54efa-5ec8-4c6e-b51b-5cd528aa63f8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:19:19.852079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4d54efa-5ec8-4c6e-b51b-5cd528aa63f8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.084141 Sep 03 21:19:19.863144 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2665/5563] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:19:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:19:33.123524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1011875964", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "1e973d1e-bae6-4ebe-b02a-2ceb6fdad7a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-682917983", "security_groups": [{"name": "tempest-secgroup-smoke-1935210225"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:33.187807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:33.189536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:33.471607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] validate_networks() for [('1e973d1e-bae6-4ebe-b02a-2ceb6fdad7a7', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:19:34.409373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:19:34.415419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:19:34.415986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:19:34.416416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:19:34.416850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:19:34.459022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:34.461002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:34.461479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:34.463449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:34.464725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:34.465492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:34.526211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:19:34.539323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:19:34.559058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:19:34.561894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:19:34.664506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-80f2ac01-c047-4260-8f69-62289070d686 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.545941 Sep 03 21:19:34.665840 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2899/5564] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:19:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:19:34.675046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=22 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:34.676951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:34.679218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:34.684401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-910dd2ce-5809-45b6-a753-4db1874cf3a9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:34.685357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-910dd2ce-5809-45b6-a753-4db1874cf3a9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:34.915405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-910dd2ce-5809-45b6-a753-4db1874cf3a9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:34.932136 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-910dd2ce-5809-45b6-a753-4db1874cf3a9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1266 microversion: 2.1 time: 0.258457 Sep 03 21:19:34.952303 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2666/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:34 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:35.956705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:35.957372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:35.971245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:35.971971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:35.972157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:35.972877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:35.973503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:35.973836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:36.428113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:36.442640 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92d83f3a-57a6-4cfd-ad78-6160e9964ed0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1326 microversion: 2.1 time: 0.490612 Sep 03 21:19:36.444756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2900/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:35 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1326 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:37.478293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:37.492562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:37.512622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:37.513509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:37.514146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:37.525327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:37.526400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:37.527055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:37.706483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:37.716644 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-36b28ed0-c27d-4f25-aa15-bfe75b59a421 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1324 microversion: 2.1 time: 0.249987 Sep 03 21:19:37.723752 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2667/5567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:37 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:38.748344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:38.748981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:38.760055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:38.762180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:38.762815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:38.767105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:38.768531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:38.769333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:39.327997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:39.345222 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2f378f77-c9bd-4e9d-a311-8137f29b4cc4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.599688 Sep 03 21:19:39.346248 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2901/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:38 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:40.370250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:40.371052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:40.391451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:40.395251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:40.396011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:40.397084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:40.397450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:40.397968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:40.987679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:41.000451 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe00e3e9-18ca-4978-ad80-8ba903c1513c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.634414 Sep 03 21:19:41.004106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2668/5569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:40 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:42.033798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:42.035841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:42.049588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:42.050524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:42.051206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:42.052771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:42.061602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:42.071694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:42.510412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:42.554372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:42.555575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:42.556702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:42.595363 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] Creating event network-changed:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:19:42.614272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6a40c2ad-ae54-4342-bc57-662396874329 req-130d2bb9-18d9-4b49-9a7e-03c8de7fd76c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108130 Sep 03 21:19:42.620481 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2669/5570] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:19:43.312343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:43.323265 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9feadaa-2895-41e9-8714-451d257b8780 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 1.299286 Sep 03 21:19:43.327072 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2902/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:42 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:44.352817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:44.354300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:44.363413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:44.364297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:44.365062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:44.366038 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:44.366856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:44.367523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:44.676436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:44.686651 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6844e7d3-27bd-4740-8486-262f86d238aa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.338304 Sep 03 21:19:44.689234 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2670/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:44 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:45.710908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:45.711454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:45.723037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:45.726867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:45.733949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:45.737149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:45.737759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:45.739320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:45.742498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:45.743246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:46.382759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:46.393783 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b344f488-d333-4d53-b534-e4cd3addef7a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.687337 Sep 03 21:19:46.394379 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2903/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:45 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:47.424008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:47.425319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:47.431745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:47.435517 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:47.436362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:47.437237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:47.438425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:47.439116 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:47.440058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:47.816349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:47.824932 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e22417e7-46ed-416a-b874-3907b1b161bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.407046 Sep 03 21:19:47.825530 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2671/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:47 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:48.418049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-plugged", "status": "completed", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:48.429169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:48.430008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:48.430681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:48.445505 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] Creating event network-vif-plugged:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:19:48.455267 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-47c44c11-35ef-4234-ae32-081384f5f7a2 req-9ba0f151-e59c-4a51-ab1a-77d659c64c53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040783 Sep 03 21:19:48.456093 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2904/5575] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:19:48.848651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:48.849560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:48.856885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:48.857431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:48.858072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:48.859102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:48.859387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:48.859822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:49.076973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:49.086942 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c3a29b4-9c8e-42f8-8630-56ac0e8f7c8c tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1392 microversion: 2.1 time: 0.242736 Sep 03 21:19:49.104101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2672/5576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:48 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:50.111520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:50.112868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:50.131283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:50.132186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:50.136054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:50.137132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:50.138013 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:50.139311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:50.523061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:50.533401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c7d347c-fbfa-450f-bab4-19882710026b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1565 microversion: 2.1 time: 0.426574 Sep 03 21:19:50.540943 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2905/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:50 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1565 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:50.558296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:50.559731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:50.567987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:50.568730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:50.569369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:50.570270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:50.570890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:50.571571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:50.755236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:50.766490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-68ac8bd4-a253-4943-80f8-d7be11193a9e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1565 microversion: 2.1 time: 0.211886 Sep 03 21:19:50.767085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2673/5578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:50 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:19:53.753171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:19:53.756258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:19:53.762184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:19:53.771468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:53.776454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:53.777419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:53.778132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:53.779167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:19:53.779836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:53.780580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:19:53.781261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:53.782214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:19:53.812567 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] Creating event network-changed:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:19:53.820447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d4edc439-42a0-41af-aee1-a5feaafca595 req-18e5a79e-a7f1-4855-b371-f69fe98a2ca2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070987 Sep 03 21:19:53.824946 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2674/5579] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:19:54.266030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:19:54.288450 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-939a5114-8470-427a-803d-4aa7977ad1f9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1565 microversion: 2.1 time: 0.542151 Sep 03 21:19:54.305919 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2906/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:19:53 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1565 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:15.663191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=20 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:15.664065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=40 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:15.669638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:15.672406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:15.680141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:15.680841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:15.681576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:15.682558 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:15.683111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:15.684126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:15.744128 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78c9a15b-0e1e-4ac3-9e5c-4048421efef5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action" status: 200 len: 24564 microversion: 2.1 time: 0.084331 Sep 03 21:20:15.746039 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2675/5581] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:20:15 2022] POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action => generated 24564 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:20:20.275286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:20.276282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=40 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:20.475296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd8ec856-6342-4f57-8dcb-722e1dd2d47c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Action: 'create', calling method: .version_select at 0x7fae65b49550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1313587585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkav+CDUNjnUGcYrxn8zrzLw1YW8YF+33lSyN2FHEMBuVy94whRAmGvDeqtrhzqffXjffCIYhL2Vm3O4aE9B5R7OCK0uPUi3i5WLQBjJIkV3eA3ZRUxfruwsJfGUrnLcw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:20.493726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fd8ec856-6342-4f57-8dcb-722e1dd2d47c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for project 800b0894aabe47369a800b88dae3d10e. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:20:20.499188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-fd8ec856-6342-4f57-8dcb-722e1dd2d47c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for user 7a40d55acc0d452dae9ffadfa35fae88 and project 800b0894aabe47369a800b88dae3d10e. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:20:20.528840 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd8ec856-6342-4f57-8dcb-722e1dd2d47c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.259084 Sep 03 21:20:20.529565 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2907/5582] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:20:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:22.133161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:22.134634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:22.149821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.150429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.151042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.151936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.152510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.153052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.299095 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8165003-76da-405e-ac4b-6f6014fca746 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1835 microversion: 2.1 time: 0.172655 Sep 03 21:20:22.299692 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2676/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:22 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1835 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:22.322826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:22.323445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:22.330554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.331060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.331508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.332228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.333254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.333692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.665282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:22.674178 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0478d46-e0fa-4158-af8d-2bff528a25c3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1684 microversion: 2.1 time: 0.356210 Sep 03 21:20:22.674769 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2908/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:22 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1684 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:22.803579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:22.806900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:22.814645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.815354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.815800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.816572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:22.817606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:22.818045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:22.874104 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-10c1dd94-58c8-49ba-9d53-054646825d00 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action" status: 200 len: 32638 microversion: 2.1 time: 0.074907 Sep 03 21:20:22.875622 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2677/5585] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:20:22 2022] POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:20:23.105727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:23.107279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:23.115583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:23.122752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:23.123801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:23.124834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:23.125581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:23.126252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:23.167826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '01ba5e445af242a69db93175b6d44fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8013e1e6804708b2991d2dcd829154', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:23.168643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] flavor_id is None. Assuming migration. {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 03 21:20:23.169181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:20:23.296635 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0f84236b-3fb9-42bd-9d2c-4e2ae6822c1a tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action" status: 202 len: 0 microversion: 2.1 time: 0.196277 Sep 03 21:20:23.301203 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2909/5586] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:20:23 2022] POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:20:23.307143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:23.308582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:23.317111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:23.317696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:23.318220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:23.319035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:23.319563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:23.320209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:23.469328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:23.477438 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d53984e-be6d-41b6-b037-877f1f6e89b1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.174592 Sep 03 21:20:23.478011 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2678/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:23 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:24.503795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:24.505026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:24.512847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:24.513379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:24.513820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:24.515268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:24.516177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:24.517019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:24.864888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:24.880475 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bd94510c-2243-4c19-89b3-727d26d9e5cc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.382015 Sep 03 21:20:24.883144 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2910/5588] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:24 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:25.906261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:25.907091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:25.922110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:25.922609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:25.923341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:25.924246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:25.927244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:25.927864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:26.167352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:26.187113 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8a67e04-5aee-4c24-aa4e-455791c59098 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.284932 Sep 03 21:20:26.187711 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2679/5589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:25 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:27.216178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:27.225009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:27.233883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:27.236595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:27.238692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:27.241075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:27.243543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:27.245527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:28.011345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:28.021624 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-461a746c-49e5-43bd-979b-07252f9712c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.809690 Sep 03 21:20:28.022370 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2911/5590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:27 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:29.051056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:29.052238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:29.078377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:29.079268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:29.079930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:29.086079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:29.086943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:29.090137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:29.175569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1069737278-access_point-22384346", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "ebe3b369-db68-4051-95c0-9cbb8f323e1d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1313587585", "security_groups": [{"name": "tempest-secgroup_access--468110300"}, {"name": "tempest-secgroup_general--220625452"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:29.297657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:29.310827 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2ce3cee-1b10-4147-88bf-00c0c925cde4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.264519 Sep 03 21:20:29.311989 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2680/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:29 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:29.681120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] validate_networks() for [('ebe3b369-db68-4051-95c0-9cbb8f323e1d', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:20:30.338414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:30.339915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:30.359345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:30.360126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:30.360764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:30.361686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:30.362302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:30.363002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:30.464182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:20:30.465182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:20:30.465827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:20:30.466420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:20:30.467005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:20:30.490510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:30.491349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:30.491934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:30.493630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:30.494401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:30.495062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:30.524074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for project 800b0894aabe47369a800b88dae3d10e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:20:30.531109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for user 7a40d55acc0d452dae9ffadfa35fae88 and project 800b0894aabe47369a800b88dae3d10e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:20:30.547837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:20:30.550879 ncdv-master-1 devstack@n-api.service[140520]: WARNING nova.utils [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1069737278-access_point-22384346 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1069737278-ac Sep 03 21:20:30.553148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:20:30.626933 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f9b9b3e-e265-45a5-a6b4-0415dbc4e4a7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.455163 Sep 03 21:20:30.632204 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2912/5592] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:20:29 2022] POST /compute/v2.1/servers => generated 456 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:20:30.642351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a83105dd-14ad-42aa-9177-f03e09ad5a8e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:30.651544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:30.655752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a83105dd-14ad-42aa-9177-f03e09ad5a8e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:30.679069 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b54b9e65-a03d-4de6-96e3-bf916184f696 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1693 microversion: 2.1 time: 0.347036 Sep 03 21:20:30.680369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2681/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:30 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1693 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:20:31.075865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a83105dd-14ad-42aa-9177-f03e09ad5a8e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:31.085274 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a83105dd-14ad-42aa-9177-f03e09ad5a8e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1293 microversion: 2.1 time: 0.447257 Sep 03 21:20:31.086452 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2913/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:30 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:20:31.702911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:31.703628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:31.711569 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:31.712317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:31.713134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:31.714062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:31.714687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:31.715526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:31.853958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:31.866801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a339edc6-28ca-426d-b607-098f8b1c826e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.167859 Sep 03 21:20:31.868252 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2682/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:31 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:32.110551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:32.111296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:32.123648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:32.124412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:32.125075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:32.126008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:32.126591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:32.127136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:32.212399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:32.222032 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3937d3c3-bbc5-4a5f-96bb-a19b3c646d2b tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1351 microversion: 2.1 time: 0.116194 Sep 03 21:20:32.222743 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2914/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:32 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:32.891689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:32.892318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:32.903658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:32.904287 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:32.904755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:32.905552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:32.906025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:32.906462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:33.249595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:33.250927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:33.260431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:33.261210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:33.261851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:33.264847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:33.265658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:33.266257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:33.292646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:33.311239 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f61a911b-bd54-46e7-bf6d-b4220b6712ac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.420655 Sep 03 21:20:33.311910 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2683/5597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:32 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:33.561421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:33.572220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c42c277-2deb-4328-8f24-97fe57354882 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.329454 Sep 03 21:20:33.574330 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2915/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:33 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:33.772029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110eb474-29f1-4ca1-8ad0-e83b8a04ab0e", "tag": "8960bae6-b7cc-456e-aa12-86ab6aafc3a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:33.787434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:33.788623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:33.791584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:33.837032 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] Creating event network-changed:8960bae6-b7cc-456e-aa12-86ab6aafc3a0 for instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e on nch2-master-1 Sep 03 21:20:33.843335 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d8049dcf-4d92-408e-bfd0-a3885654dad6 req-cfd22399-79c3-4adf-acdb-2c2e456aee85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074636 Sep 03 21:20:33.844212 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2684/5599] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:34.338837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:34.339448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:34.346023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:34.346763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:34.347305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:34.348665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:34.349313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:34.349743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:34.503377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:34.511663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a5718396-65dc-4a11-999f-db37919431bc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.176696 Sep 03 21:20:34.512393 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2916/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:34 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:34.601622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:34.602463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:34.609455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:34.610031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:34.610536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:34.611362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:34.611914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:34.612607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:34.841826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:34.849658 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd3b0210-322f-412f-9fdf-0a76f7ba46ad tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.256752 Sep 03 21:20:34.850479 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2685/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:34 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:35.538873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:35.539647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:35.548853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:35.549455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:35.550001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:35.551630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:35.552371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:35.552930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:35.875267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:35.875826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:35.883015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:35.883510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:35.883953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:35.884698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:35.885189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:35.885621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:36.039666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:36.048199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a7b4a5f-001e-498f-abc9-c9164a50946e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.176917 Sep 03 21:20:36.048785 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2686/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:35 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:20:36.123421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:36.132580 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93b9dc5d-047d-49c5-943c-508d22f01f0d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.598248 Sep 03 21:20:36.145497 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2917/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:35 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:37.071460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:37.072355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:37.080758 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:37.081437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:37.081953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:37.083383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:37.084334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:37.084561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:37.157971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:37.158758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:37.169299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:37.170180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:37.171039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:37.172023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:37.172706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:37.173389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:37.332783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:37.341692 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8627877-06a5-4a7d-91e8-9304c25ed83a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.187731 Sep 03 21:20:37.342289 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2918/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:37 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:37.646037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:37.654954 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13377f5d-0c19-4009-a0d5-81dc14c9a1ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.587359 Sep 03 21:20:37.655538 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2687/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:37 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:38.367014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:38.367690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:38.375993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:38.377608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:38.378066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:38.378787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:38.379814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:38.380251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:38.539292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:38.548501 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bbcaa45f-46b2-4883-9451-5ebf0bbfc86a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.186550 Sep 03 21:20:38.549661 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2919/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:38 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:38.678660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:38.679339 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:38.693845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:38.694599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:38.695502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:38.702755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110eb474-29f1-4ca1-8ad0-e83b8a04ab0e", "name": "network-vif-plugged", "status": "completed", "tag": "8960bae6-b7cc-456e-aa12-86ab6aafc3a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:38.716393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:38.716924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:38.717369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:38.741202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:38.741690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:38.742194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:38.758572 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] Creating event network-vif-plugged:8960bae6-b7cc-456e-aa12-86ab6aafc3a0 for instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e on nch2-master-1 Sep 03 21:20:38.764444 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-041642cd-ed61-4f43-94a1-5c954c26bf7b req-a7d266cf-0497-4f02-81e1-cc17084b031e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155343 Sep 03 21:20:38.766055 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2688/5607] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:38.958996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:38.989247 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f7536656-0b09-43e4-a8bc-8fb3684a192c tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.313555 Sep 03 21:20:38.990395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2920/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:38 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:20:39.574106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:39.574807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:39.581804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:39.582908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:39.583823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:39.585526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:39.585625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:39.586024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:39.728186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:39.736953 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02f3d449-75b6-4cac-a62b-aa52b6cee2d5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.167007 Sep 03 21:20:39.737531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2689/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:39 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:40.019266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:40.020679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:40.034994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:40.042670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:40.043202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:40.044177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:40.044817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:40.045284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:40.343333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:40.351809 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11e57a4f-8ab3-4e6b-a283-73596e948e1f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1469 microversion: 2.1 time: 0.342960 Sep 03 21:20:40.352544 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2921/5610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:40 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:40.762088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:40.763355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:40.774581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:40.775354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:40.776433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:40.777535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:40.778135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:40.778868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:40.927135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:40.935197 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90cfeedc-a99b-4025-95d7-190b818ec366 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.177697 Sep 03 21:20:40.935697 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2690/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:40 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:41.378454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:41.381053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:41.386324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:41.388219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:41.391342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.392097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.392612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.393434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.394183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.395225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.619813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:41.630780 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8159d4f7-b976-443e-a0c6-e5c50a9ddb41 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1640 microversion: 2.1 time: 0.256076 Sep 03 21:20:41.634519 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2922/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:41 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1640 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:41.654188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:41.655086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:41.661408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.662104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.662718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.663591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.664205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.664789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.854264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:41.865146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90141e7c-5cf6-4a00-bb85-777ec82b37b9 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1640 microversion: 2.1 time: 0.214555 Sep 03 21:20:41.866772 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2691/5613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:41 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1640 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:41.889795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:41.890925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:41.900749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.901413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.902192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.903206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.904147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.905216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.960035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:41.961388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:41.970509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.971106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.971647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:41.972453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:41.973107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:41.974092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:42.164585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:42.174517 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae299c2e-01e8-4906-a9a1-d91e01c5090f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.219913 Sep 03 21:20:42.175203 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2692/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:41 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:42.512976 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7e3bcdb0-0d42-4175-bc79-65c1a6610662 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1791 microversion: 2.1 time: 0.624460 Sep 03 21:20:42.532940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2923/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:41 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1791 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:43.201541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:43.202934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:43.211953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:43.212983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:43.213680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:43.214649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:43.216119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:43.216837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:43.242971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=100 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:43.467154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:43.476432 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53a26a2f-151d-45a9-a2d1-27f12cdbc4bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.279423 Sep 03 21:20:43.489545 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2693/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:43 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:44.512043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:44.512667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:44.527167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:44.528333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:44.529193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:44.530138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:44.530768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:44.531371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:44.575048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:44.817706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:44.828855 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fee86b77-677c-41cc-9a75-b5cd942f8adc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.329970 Sep 03 21:20:44.829744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2924/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:44 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:44.903689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110eb474-29f1-4ca1-8ad0-e83b8a04ab0e", "tag": "8960bae6-b7cc-456e-aa12-86ab6aafc3a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:44.916653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:44.917711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:44.918412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:44.931577 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] Creating event network-changed:8960bae6-b7cc-456e-aa12-86ab6aafc3a0 for instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e on nch2-master-1 Sep 03 21:20:44.938321 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-75ccbafc-80a8-4996-87c4-399e79548d96 req-5d505188-e8ce-40c8-a0ef-619d030f9d42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114938 Sep 03 21:20:44.939071 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2694/5618] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:20:45.854149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:45.855032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:45.873444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:45.874066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:45.874529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:45.875567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:45.876040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:45.876482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:46.217687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:46.237156 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3dc7968d-c79b-44a7-93c5-7122791e0b40 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.386832 Sep 03 21:20:46.253740 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2925/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:45 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:47.271075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:47.272548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:47.295639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=41 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:47.299654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:47.301246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:47.302587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:47.303352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:47.307342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:47.308253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:47.591261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:47.601139 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-451975d7-375e-4df7-9a0a-7851667526fc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1698 microversion: 2.1 time: 0.337005 Sep 03 21:20:47.614307 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2695/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:47 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1698 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:48.310394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-unplugged", "status": "completed", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:48.338883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:48.339377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:48.339817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:48.368261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Creating event network-vif-unplugged:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch1-master-1 Sep 03 21:20:48.385540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] Instance 3e58e056-348d-476c-9a1d-f173c9702918 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:20:48.415032 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4f85608d-14c3-4717-8b85-8632b6bf16df req-6a419e41-7b2c-496f-9751-c5142bf24968 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108758 Sep 03 21:20:48.416125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2926/5621] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:48.627115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:48.627744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:48.639709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:48.642305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:48.642776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:48.643515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:48.643992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:48.644415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:48.915366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:48.924587 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c2e9e6dd-640a-44e0-9103-d3a743b00cb5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1697 microversion: 2.1 time: 0.301894 Sep 03 21:20:48.925799 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2696/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:48 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:49.952348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:49.953255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:49.960573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:49.961472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:49.961922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:49.962932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:49.963615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:49.964126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:50.184163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:50.203660 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4133df4a-eb05-4346-b9c8-4727b0bda0f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1695 microversion: 2.1 time: 0.254350 Sep 03 21:20:50.218608 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2927/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:49 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:50.471782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:50.490012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:50.491298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:50.491936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:50.508495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Creating event network-changed:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch1-master-1 Sep 03 21:20:50.515366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] Instance 3e58e056-348d-476c-9a1d-f173c9702918 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:20:50.529854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-21c0f9a3-e38e-4fe3-a5a3-3add7c4b10d4 req-0f38e874-a6eb-4a82-af6f-eb73467075c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064166 Sep 03 21:20:50.542766 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2697/5624] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:51.231898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:51.233077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:51.236495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:51.243127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:51.243717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:51.244233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:51.245065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:51.245598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:51.246119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:51.401784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:51.412747 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b084bbaf-2489-4d9e-8e2a-5902dcd76b77 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1695 microversion: 2.1 time: 0.185355 Sep 03 21:20:51.413391 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2928/5625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:51 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:52.437185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:52.437938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:52.449331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:52.450162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:52.450705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:52.452656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:52.453836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:52.459752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:52.879899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:52.890771 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a41745d-8fd4-4c2c-a4b6-35dddaa72591 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1695 microversion: 2.1 time: 0.458579 Sep 03 21:20:52.901360 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2698/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:52 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1695 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:53.930942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:53.932809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:53.945268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:53.946043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:53.947392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:53.953293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:53.955305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:53.955981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:54.224752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:54.233783 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1c9ccee-d9b6-4676-a693-a93142d59ecf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1692 microversion: 2.1 time: 0.321824 Sep 03 21:20:54.248742 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2929/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:53 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1692 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:54.259098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:54.259670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:54.270526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:54.271277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:54.271933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:54.272932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:54.273602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:54.274237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:54.439930 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-67748887-9f62-49b5-809b-fdedcd5d2ddc tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action" status: 202 len: 0 microversion: 2.1 time: 0.184814 Sep 03 21:20:54.441994 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2699/5628] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:20:54 2022] POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:20:54.452051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:54.453086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:54.477656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:54.479689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:54.481457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:54.483232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:54.484300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:54.485035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:54.673634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:54.685998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93caf747-25fa-436d-bf8a-9eb06713a9a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.240140 Sep 03 21:20:54.686599 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2930/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:54 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:55.714805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:55.716110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:55.735082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:55.736440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:55.738488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:55.739568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:55.740276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:55.740989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:55.814326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-plugged", "status": "completed", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:55.840368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:55.840999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:55.843467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:55.865223 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Creating event network-vif-plugged:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch1-master-1 Sep 03 21:20:55.882210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] Instance 3e58e056-348d-476c-9a1d-f173c9702918 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:20:55.902836 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7515a570-b5b0-4336-bd44-e97351c67bc9 req-19df993f-0a2d-448c-8fce-30b62b3399f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092037 Sep 03 21:20:55.904213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2931/5630] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:20:56.127026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:56.138635 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-85aeb292-8995-4509-9cd1-ca61fe7da2c6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.427935 Sep 03 21:20:56.139908 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2700/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:55 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:57.165611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:57.166319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:57.173161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:57.173660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:57.174380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:57.175181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:57.176202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:57.176923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:57.427855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:57.444066 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4916e8ef-ffa3-4f32-9241-820b9a8234a4 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.284689 Sep 03 21:20:57.444855 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2932/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:57 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:58.469683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:58.470222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:58.479033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:58.479849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:58.480294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:58.481144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:58.481896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:58.482927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:58.756598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:58.767165 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c9583fe-12b1-4a6d-a725-3bf85594b699 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.300590 Sep 03 21:20:58.767844 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2701/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:58 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:20:59.046524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-unplugged", "status": "completed", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:20:59.056871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:59.057393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:59.057835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:59.070015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Creating event network-vif-unplugged:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:20:59.075629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] Instance 3e58e056-348d-476c-9a1d-f173c9702918 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:20:59.089032 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1e6c1169-4be3-4662-a7fb-5a95b3ac40a8 req-bc2ad210-cb4d-45ac-9b17-448b4e663a85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045874 Sep 03 21:20:59.089831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2933/5634] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:20:59.791646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:20:59.792198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:20:59.798978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:59.799449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:59.799923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:59.800688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:20:59.801170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:20:59.801603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:20:59.951522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:20:59.959878 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e91a2a06-5345-4e8b-8241-7dae1b2b6714 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.172177 Sep 03 21:20:59.960797 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2702/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:20:59 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:00.985707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:00.986331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:00.993196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:00.993736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:00.994240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:00.994989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:00.995458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:00.995904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:01.169361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:01.179683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:01.180330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:01.180775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:01.193197 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Creating event network-changed:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:21:01.198496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] Instance 3e58e056-348d-476c-9a1d-f173c9702918 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:21:01.210004 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-1deabb76-6153-4fb3-881d-cfe9a145308c req-fd768980-4ce5-4634-9844-6a41c3174c1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044290 Sep 03 21:21:01.210599 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2703/5636] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:21:01.384752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:01.392618 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-21cfb046-e67a-449e-b8dd-5c992fc65b2e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.412539 Sep 03 21:21:01.393226 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2934/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:00 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:02.419239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:02.421279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:02.436406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:02.437566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:02.439774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:02.452005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:02.452857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:02.454311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:02.777798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:02.788567 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1d9c8d4-8b5c-46c8-9ec7-b7a74d6f1f3f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1691 microversion: 2.1 time: 0.374805 Sep 03 21:21:02.791459 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2704/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:02 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1691 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:03.811660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:03.812277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:03.819923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:03.820416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:03.820862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:03.821603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:03.822065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:03.822500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:03.955810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:03.963856 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09e15164-d7ff-451a-962a-42f547670c9f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1684 microversion: 2.1 time: 0.156146 Sep 03 21:21:03.964432 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2935/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:03 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:04.776415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-plugged", "status": "completed", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:04.795351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:04.796009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:04.796540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:04.812951 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] Creating event network-vif-plugged:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:21:04.820581 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8d55e2f9-2f48-4bb9-bf7b-e269d01c8f00 req-6edcf292-6882-4e3f-965a-7d7b656ea04e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048983 Sep 03 21:21:04.822092 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2705/5640] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:24.209634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-666018955", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "454978ff-9b46-4c65-9083-47534ee04bc3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1313587585", "security_groups": []}, "os:scheduler_hints": {"different_host": ["110eb474-29f1-4ca1-8ad0-e83b8a04ab0e"]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:24.227489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=15 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:24.228227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=62 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:24.284243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] validate_networks() for [('454978ff-9b46-4c65-9083-47534ee04bc3', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:21:24.737109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:21:24.738064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:21:24.739077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:21:24.739597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:21:24.740274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:21:24.754679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:24.755600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:24.756124 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:24.756994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:24.757728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:24.758534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:24.777324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for project 800b0894aabe47369a800b88dae3d10e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:21:24.784129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Getting quotas for user 7a40d55acc0d452dae9ffadfa35fae88 and project 800b0894aabe47369a800b88dae3d10e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:21:24.799662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:21:24.803076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:21:24.867554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-300c9d31-7b5d-4ade-8816-16fac0c18fd7 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.662964 Sep 03 21:21:24.868317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2936/5641] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:21:24 2022] POST /compute/v2.1/servers => generated 361 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:21:24.878858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=25 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:24.879984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:24.884223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01b33e84-675e-4993-a3ce-0a2ee020e6d1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:24.885722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-01b33e84-675e-4993-a3ce-0a2ee020e6d1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:24.984113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-01b33e84-675e-4993-a3ce-0a2ee020e6d1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:24.993087 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01b33e84-675e-4993-a3ce-0a2ee020e6d1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1241 microversion: 2.1 time: 0.116930 Sep 03 21:21:25.008852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2706/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:24 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:26.017016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:26.018264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:26.026206 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:26.026704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:26.027151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:26.027888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:26.028366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:26.028800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:26.100315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:26.109759 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e816f22f-cb9e-4e42-9deb-d71bc3384fd0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1293 microversion: 2.1 time: 0.097847 Sep 03 21:21:26.110356 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2937/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:26 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:27.134327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:27.135089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:27.146648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:27.147599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:27.148223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:27.148976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:27.150818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:27.151605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:27.240069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:27.254731 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b796cad5-f3af-4742-b668-56ba9532b111 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.123039 Sep 03 21:21:27.257505 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2707/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:27 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:28.198927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:28.201836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:28.217883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:28.220454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:28.221615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:28.223169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:28.223872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:28.224539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:28.279037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:28.280369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:28.290585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:28.291780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:28.292405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:28.293356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:28.293982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:28.294696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:28.301441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1fc4c713-07d7-4a6e-8148-312a719e4370 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action" status: 200 len: 63145 microversion: 2.1 time: 0.106164 Sep 03 21:21:28.302917 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2938/5645] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:21:28 2022] POST /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918/action => generated 63145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:21:28.459068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:28.468303 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c86aaa9-b4db-4092-a3fe-2c91c388ac24 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.193596 Sep 03 21:21:28.468881 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2708/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:28 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:21:28.724386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac599458-2a43-4e6b-8305-c1a793a72daf", "tag": "9eee89fc-23af-4ee4-b883-90eb0f54a3d3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:28.739014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:28.739609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:28.740175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:28.760826 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] Creating event network-changed:9eee89fc-23af-4ee4-b883-90eb0f54a3d3 for instance ac599458-2a43-4e6b-8305-c1a793a72daf on nch1-master-1 Sep 03 21:21:28.769564 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-09b7269c-d72f-4e44-9e09-98e12a131fe8 req-8b67929c-c4a4-4da4-8e19-1e4580fba997 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048116 Sep 03 21:21:28.770285 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2939/5647] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:29.494048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:29.494772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:29.501900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:29.502466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:29.502908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:29.503723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:29.504187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:29.504598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:29.586280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:29.594050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ea0e2f8c-0997-4d61-9dc3-7e0002f08dec tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.103982 Sep 03 21:21:29.594633 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2709/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:29 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:30.618198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:30.618906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:30.626023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:30.626508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:30.626948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:30.627642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:30.628096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:30.628520 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:30.709450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:30.717249 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9c70564a-39da-4792-836b-1c65a2adb61a tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.103367 Sep 03 21:21:30.717845 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2940/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:30 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:31.740878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:31.741560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:31.749244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:31.749743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:31.750191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:31.750902 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:31.751362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:31.751792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:31.883916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:31.894386 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e77b5d8-5ee2-45d7-867b-c79f5e16509e tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.157354 Sep 03 21:21:31.895080 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2710/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:31 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:32.917398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:32.917971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:32.924755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:32.925801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:32.926243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:32.926938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:32.927395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:32.927826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:33.011652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:33.019421 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cccce97e-53eb-4841-aae7-1cfa51f412ca tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.105943 Sep 03 21:21:33.019983 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2941/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:32 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:34.043004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:34.044931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:34.053142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:34.053794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:34.054383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:34.055468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:34.056151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:34.056722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:34.156309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:34.165254 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de68a490-d69f-43f5-b37c-19a34eecaf80 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.126425 Sep 03 21:21:34.165996 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2711/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:34 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:34.600260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:34.601126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:34.608234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:34.608791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:34.609259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:34.610076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:34.610533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:34.611019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:34.751831 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5518f5f-f89a-443b-93d4-7444007f03f8 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1835 microversion: 2.1 time: 0.155873 Sep 03 21:21:34.752460 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2942/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:34 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1835 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:35.188604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:35.190209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:35.196754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:35.199699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:35.200297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:35.201019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:35.201817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:35.202284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:35.202873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:35.341143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:35.350218 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91e6e103-ba09-4330-878a-42ad2052c555 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.166091 Sep 03 21:21:35.351983 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2712/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:35 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:35.729294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac599458-2a43-4e6b-8305-c1a793a72daf", "name": "network-vif-plugged", "status": "completed", "tag": "9eee89fc-23af-4ee4-b883-90eb0f54a3d3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:35.742840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:35.744555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:35.775910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:35.777543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:35.778169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:35.795808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] Creating event network-vif-plugged:9eee89fc-23af-4ee4-b883-90eb0f54a3d3 for instance ac599458-2a43-4e6b-8305-c1a793a72daf on nch1-master-1 Sep 03 21:21:35.802145 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-011f6312-31e2-41b6-86cb-49b98c9ab938 req-2689690d-dabd-4d45-9a78-99eee3b8bb92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079539 Sep 03 21:21:35.802816 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2943/5655] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:36.078658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:36.079480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:36.082779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:36.086839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.087337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.087780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.088493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.088988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.089661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.094603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.095153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.095903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.111278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] Creating event network-changed:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:21:36.116722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ea7bcf9f-b622-4666-89c1-7225405d14f4 req-a51f8be4-98df-4280-aaf3-2a7348b10b4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039477 Sep 03 21:21:36.117338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:21:36.118379 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2944/5656] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:36.205812 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5e670ea-3bfe-47e9-b962-30071bb5f57f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 204 len: 0 microversion: 2.1 time: 0.130732 Sep 03 21:21:36.207547 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2713/5657] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:21:36 2022] DELETE /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:21:36.217428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:36.218125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:36.225203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.225973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.226616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.227328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.227955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.228386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.374246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:36.375097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:36.382245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.382732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.383167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.383867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:36.384411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:36.384866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:36.408423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:36.416918 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6a3c45b3-4c8f-4cdc-80ce-464199a198bf tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1690 microversion: 2.1 time: 0.204305 Sep 03 21:21:36.417694 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2945/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:36 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:36.484933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:36.493514 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54bc7fa9-2fda-451a-abc4-d9b305fe5b97 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1299 microversion: 2.1 time: 0.123636 Sep 03 21:21:36.494095 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2714/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:36 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:21:37.445749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:37.446567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:37.453685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.454334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.454825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.455593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.456166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.456777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.519628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:37.520634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:37.530384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.531221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.531669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.532399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.532857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.533437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.699366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:37.709107 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-97abe231-714f-41c2-a875-7ba275c79956 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1471 microversion: 2.1 time: 0.195146 Sep 03 21:21:37.718266 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2715/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:37 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:21:37.732226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:37.733468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:37.740695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.741898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.742468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.743202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.743852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.744456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.921754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:37.930332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:37.932368 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff9ac268-b35a-4fef-b775-0f0e6cea3469 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1471 microversion: 2.1 time: 0.203942 Sep 03 21:21:37.942486 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-309b97a9-7d86-4830-961e-7828be18dae2 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 200 len: 1690 microversion: 2.1 time: 0.502868 Sep 03 21:21:37.949053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2716/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:37 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:21:37.955372 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2946/5662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:37 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 1690 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:37.965469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:37.966352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:37.978278 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.978754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.979169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:37.979896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:37.980356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:37.980840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.116092 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a7fc693-e281-4a53-ac28-8a39923c02f9 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1622 microversion: 2.1 time: 0.157038 Sep 03 21:21:38.117139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2717/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:37 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:21:38.156048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:38.156672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:38.163833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.164394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.164842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.165727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.166192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.166681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.332329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e58e056-348d-476c-9a1d-f173c9702918", "name": "network-vif-deleted", "tag": "d6302cd5-98cd-4823-9ec6-c5f5200895d5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:38.355512 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5752157f-795f-460a-93f8-e7f722dbb5a7 tempest-TestSecurityGroupsBasicOps-520672931 tempest-TestSecurityGroupsBasicOps-520672931-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1910 microversion: 2.1 time: 0.213689 Sep 03 21:21:38.356320 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2947/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:38 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1910 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:38.358328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.358328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.373217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.374091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] Creating event network-vif-deleted:d6302cd5-98cd-4823-9ec6-c5f5200895d5 for instance 3e58e056-348d-476c-9a1d-f173c9702918 on nch2-master-1 Sep 03 21:21:38.379423 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9473163d-bf2d-43d8-995e-5ec89378b444 req-8d94dcf1-567c-480b-b4d5-4ef534119f86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052362 Sep 03 21:21:38.380019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2718/5665] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:38.439238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:38.440106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:38.447178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.447830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.448111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.449071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.449568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.450149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.480369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:21:38.561309 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ba9e6c8-7b53-42d8-ae53-38b2874202f1 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 204 len: 0 microversion: 2.1 time: 0.125639 Sep 03 21:21:38.561955 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2948/5666] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:21:38 2022] DELETE /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:21:38.571945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:38.572868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:38.578998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.579483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.579931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.580609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.581162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.581590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.678487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:38.687128 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2b863f2-d010-47cc-956f-175657312048 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1477 microversion: 2.1 time: 0.120617 Sep 03 21:21:38.687782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2719/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:38 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1477 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:38.968316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:38.969170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 3e58e056-348d-476c-9a1d-f173c9702918] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:38.975966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.976532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.977102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.977878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:38.978462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:38.978913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:38.992667 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] HTTP exception thrown: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Request method failure captured: Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 HTTP/1.1 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8Q61xsrwJZH_CmX1y-Jt7jA04duaIwPytdJnkJoYu5DG2AHZVSOereuWcBL1xi7yFc9BdQ8CuHkUO0j2Wyegu-gQ5hyf1y0n6VmE4AvTu52e5sWJ1976KyvCihpFzAG4aOpTDrWz2dtbGccttFrIVf6Um160RrF-pWfUx875wZdeMc Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: b5c96be8fbe1436bb3e84340ceda1917 Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '3e58e056-348d-476c-9a1d-f173c9702918'} Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:38.994340 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Returning 404 to user: Instance 3e58e056-348d-476c-9a1d-f173c9702918 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14a405b1-05a8-4134-86e2-5698f8e21e4e tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918" status: 404 len: 111 microversion: 2.1 time: 0.031839 Sep 03 21:21:38.999701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2949/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:38 2022] GET /compute/v2.1/servers/3e58e056-348d-476c-9a1d-f173c9702918 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:21:39.710429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:39.711043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:39.717927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:39.718415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:39.718852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:39.719554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:39.720011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:39.720439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:39.821561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:39.829352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d5a8ffb2-dc05-4d69-90fe-fd48cbfec887 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1477 microversion: 2.1 time: 0.122940 Sep 03 21:21:39.829917 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2720/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:39 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1477 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:40.856117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:40.858135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:40.867467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:40.869251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:40.869908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:40.870984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:40.878924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:40.879957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:40.900212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac599458-2a43-4e6b-8305-c1a793a72daf", "name": "network-vif-deleted", "tag": "9eee89fc-23af-4ee4-b883-90eb0f54a3d3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:40.914845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:40.915332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:40.922189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:40.953608 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] Creating event network-vif-deleted:9eee89fc-23af-4ee4-b883-90eb0f54a3d3 for instance ac599458-2a43-4e6b-8305-c1a793a72daf on nch1-master-1 Sep 03 21:21:40.963850 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ee855937-da10-4b7f-9cee-4eac0676cb45 req-782baf32-53ec-44bf-9b92-41cf622bff0c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065087 Sep 03 21:21:40.965073 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2721/5670] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:21:41.025720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:41.048602 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-523c95ec-599f-4f8f-9a39-38b546ae83c0 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 200 len: 1477 microversion: 2.1 time: 0.198932 Sep 03 21:21:41.054286 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2950/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:40 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:42.078713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:42.080285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: ac599458-2a43-4e6b-8305-c1a793a72daf] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:42.089747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:42.091057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:42.091614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:42.092457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:42.093201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:42.093690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:42.109267 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] HTTP exception thrown: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Request method failure captured: Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf HTTP/1.1 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8UTDXk_iump9NSHsA8fmIlb6aH_nUlDkuuNe4SdGbx0v0GejLUffowFUgvkR9iv6J3TcNOs6O2V08ieyTQe_EHeg6yk5lP_x22Blm1JwzVjHZiOAxzcDIAxrFMs68vQFFgaq0RQOQN46Wpxu5m2QAdX7ePz2569SLkcUC_gqz6Lv_Q Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 800b0894aabe47369a800b88dae3d10e Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_800b0894aabe47369a800b88dae3d10e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 800b0894aabe47369a800b88dae3d10e Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestSecurityGroupsBasicOps-1069737278-project Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 7a40d55acc0d452dae9ffadfa35fae88 Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1069737278-project Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'ac599458-2a43-4e6b-8305-c1a793a72daf'} Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:21:42.111238 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Returning 404 to user: Instance ac599458-2a43-4e6b-8305-c1a793a72daf could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e40daaf1-1721-4a80-8f78-bc4cd13bddf5 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf" status: 404 len: 111 microversion: 2.1 time: 0.041286 Sep 03 21:21:42.123787 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2722/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:42 2022] GET /compute/v2.1/servers/ac599458-2a43-4e6b-8305-c1a793a72daf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:21:43.314801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-14782922-8e98-4e2c-8135-617d55cb130b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '.version_select at 0x7fae66021ee0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:43.339760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-14782922-8e98-4e2c-8135-617d55cb130b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-682917983" status: 202 len: 0 microversion: 2.1 time: 0.028752 Sep 03 21:21:43.340277 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2951/5673] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 21:21:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-682917983 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:21:43.380589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62e622bd-f9ad-4f89-aafd-33d8ea69637d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: .version_select at 0x7fae65e5aee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-809328202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXgN+1hNS31qAKmRarisRJOvXyjUMoTMThb1XXXvB+cfd2hpG4gkB5sXE9vofQKf6A7uL1Kmy0fU5BtfFGN7il0RESv4Gkiji2pzTbvdg+R8DrLwJQmWJHqH1huJ0Be4Q=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:43.403193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-62e622bd-f9ad-4f89-aafd-33d8ea69637d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:21:43.409774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-62e622bd-f9ad-4f89-aafd-33d8ea69637d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:21:43.449020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62e622bd-f9ad-4f89-aafd-33d8ea69637d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.072111 Sep 03 21:21:43.449908 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2723/5674] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:21:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:21:48.787461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:48.788058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:48.801992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:48.802845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:48.803535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:48.804522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:48.805249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:48.806062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:48.849380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:21:48.998636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110eb474-29f1-4ca1-8ad0-e83b8a04ab0e", "tag": "8960bae6-b7cc-456e-aa12-86ab6aafc3a0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:49.001345 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36fed017-0f7e-4150-89ac-610e1fc96b7f tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "DELETE /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 204 len: 0 microversion: 2.1 time: 0.220911 Sep 03 21:21:49.005701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2952/5675] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:21:48 2022] DELETE /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:21:49.021769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:49.022469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:49.023071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:49.041900 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] Creating event network-changed:8960bae6-b7cc-456e-aa12-86ab6aafc3a0 for instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e on nch2-master-1 Sep 03 21:21:49.043997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:49.047955 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:49.053435 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2725a821-84fd-467b-bdd2-8e1d714e2e96 req-552eb11d-377b-43e7-9c2e-854cd01f17d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246412 Sep 03 21:21:49.054645 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2724/5676] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:21:49.067220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:49.068443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:49.073601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:49.074724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:49.076078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:49.076760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:49.267908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:49.271575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:49.283926 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-88aab21c-6530-480e-a105-097617c073c6 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1765 microversion: 2.1 time: 0.271692 Sep 03 21:21:49.284718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2953/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:49 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1765 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:50.309484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:50.310478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:50.332649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:50.334283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:50.335010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:50.339748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:50.340539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:50.341300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:50.388193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:50.717512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:50.729746 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6d5f663-dad0-40e1-aca3-96ed1aad44a4 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1765 microversion: 2.1 time: 0.425584 Sep 03 21:21:50.730655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2725/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:50 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1765 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:51.139482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110eb474-29f1-4ca1-8ad0-e83b8a04ab0e", "name": "network-vif-deleted", "tag": "8960bae6-b7cc-456e-aa12-86ab6aafc3a0"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:51.161675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:51.163657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:51.165042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:51.195395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] Creating event network-vif-deleted:8960bae6-b7cc-456e-aa12-86ab6aafc3a0 for instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e on nch2-master-1 Sep 03 21:21:51.200635 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3f05b55a-40fb-45f8-8575-fba857f87abf req-a57e6888-b0b1-4563-9feb-b47c5cfba182 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065167 Sep 03 21:21:51.209935 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2954/5679] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:21:51.758768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:51.760173 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:51.769709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:51.771468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:51.772160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:51.773196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:51.775982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:51.776683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:51.857381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:51.858590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:51.859415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:51.862945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lazy-loading 'fault' on Instance uuid 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:21:51.969265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a40d55acc0d452dae9ffadfa35fae88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800b0894aabe47369a800b88dae3d10e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:51.976978 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7c754551-ed8c-4cdd-b078-4d47a96ea224 tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 200 len: 1383 microversion: 2.1 time: 0.225573 Sep 03 21:21:51.979595 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2726/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:51 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 1383 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:21:53.007002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:53.008504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] [instance: 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:53.062231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:53.063134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:53.063973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:53.065146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:53.065788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:53.066650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:53.099539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] HTTP exception thrown: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Request method failure captured: Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e HTTP/1.1 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8UTDXk_iump9NSHsA8fmIlb6aH_nUlDkuuNe4SdGbx0v0GejLUffowFUgvkR9iv6J3TcNOs6O2V08ieyTQe_EHeg6yk5lP_x22Blm1JwzVjHZiOAxzcDIAxrFMs68vQFFgaq0RQOQN46Wpxu5m2QAdX7ePz2569SLkcUC_gqz6Lv_Q Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 800b0894aabe47369a800b88dae3d10e Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_800b0894aabe47369a800b88dae3d10e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/800b0894aabe47369a800b88dae3d10e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 800b0894aabe47369a800b88dae3d10e Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1069737278 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestSecurityGroupsBasicOps-1069737278-project Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 7a40d55acc0d452dae9ffadfa35fae88 Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1069737278-project Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '110eb474-29f1-4ca1-8ad0-e83b8a04ab0e'} Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:53.102475 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. Sep 03 21:21:53.108370 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:21:53.110608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Returning 404 to user: Instance 110eb474-29f1-4ca1-8ad0-e83b8a04ab0e could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:21:53.112133 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-43509e39-2adf-407c-985a-e6831fcb6bda tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e" status: 404 len: 111 microversion: 2.1 time: 0.111802 Sep 03 21:21:53.113511 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2955/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:52 2022] GET /compute/v2.1/servers/110eb474-29f1-4ca1-8ad0-e83b8a04ab0e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:21:55.991538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-691259849", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "39927d91-656a-4974-9d9d-a55379b4fb73"}], "key_name": "tempest-TestNetworkAdvancedServerOps-809328202", "security_groups": [{"name": "tempest-secgroup-smoke-966257713"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:21:56.014832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:56.015901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:56.284545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] validate_networks() for [('39927d91-656a-4974-9d9d-a55379b4fb73', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:21:57.790610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:21:57.791879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:21:57.792548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:21:57.793290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:21:57.793919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:21:57.807571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:57.808692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:57.809436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:57.810809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:21:57.811469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:21:57.812080 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:21:57.871855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:21:57.882874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:21:57.902439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:21:57.906169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:21:57.983184 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [52c98b0b-064a-4625-bf4f-4cbd285a8192] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:21:58.992433 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [52c98b0b-064a-4625-bf4f-4cbd285a8192] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39450. Sep 03 21:21:59.006865 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-56724c52-dbb3-424d-94b2-32485965526b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.021992 Sep 03 21:21:59.010441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2727/5682] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:21:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:21:59.023163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-432b93e1-b64f-40c9-b477-380a0f5f41a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:21:59.023798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-432b93e1-b64f-40c9-b477-380a0f5f41a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:21:59.029559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:59.240502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-432b93e1-b64f-40c9-b477-380a0f5f41a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:21:59.253715 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-432b93e1-b64f-40c9-b477-380a0f5f41a3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1265 microversion: 2.1 time: 0.235685 Sep 03 21:21:59.256387 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2956/5683] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:21:59 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:00.238800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-23cd5946-4dfd-4abf-ac9c-3a4e11c31c06 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Action: 'create', calling method: .version_select at 0x7fae65b605e0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-734367685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0nI6h1u11qFLIFhU97X+M/Ne5saY3YlXm0tQ4SYNkJZiudLD1eccKoQJi+szRkuHJ2bNekKEbUxqvhQSRjdEV368owSxL3nQfR3Q1+xgphdPHLzIWm9+y8pjJX9sYXdg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:00.280227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:00.280991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:00.295130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-23cd5946-4dfd-4abf-ac9c-3a4e11c31c06 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:22:00.301266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-23cd5946-4dfd-4abf-ac9c-3a4e11c31c06 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for user 98434520e99e42099265bd81e88f1862 and project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:22:00.313446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:00.315618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:00.323236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:00.326720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:00.330278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:00.332056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:00.337482 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-23cd5946-4dfd-4abf-ac9c-3a4e11c31c06 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.420204 Sep 03 21:22:00.340804 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2728/5684] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:21:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:00.348629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4f565414-5e0a-476f-8037-60d89f9764dd tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] Calling method '.version_select at 0x7fae6683ab80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:00.390143 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4f565414-5e0a-476f-8037-60d89f9764dd tempest-TestSecurityGroupsBasicOps-1069737278 tempest-TestSecurityGroupsBasicOps-1069737278-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1313587585" status: 202 len: 0 microversion: 2.1 time: 0.048198 Sep 03 21:22:00.391274 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2729/5685] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Sep 3 21:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1313587585 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:22:00.471833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:00.486491 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5809cd9a-72d3-4347-b703-7efb36a1134b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1317 microversion: 2.1 time: 0.209735 Sep 03 21:22:00.488483 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2957/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:00 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:22:01.528061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:01.528715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:01.546360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:01.546867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:01.548310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:01.550625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:01.551491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:01.554142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:01.703180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:01.716642 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6036aa18-cf30-415f-85b0-721e35bc60f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1323 microversion: 2.1 time: 0.204178 Sep 03 21:22:01.739486 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2730/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:01 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:02.700148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-541202045", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-734367685", "security_groups": [{"name": "tempest-secgroup-smoke-559590491"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d14880be-32d1-42d3-8376-bf82939404c6"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:02.749648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:02.750894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:02.761901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:02.763787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:02.764257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:02.786206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:02.786985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:02.787463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:02.928399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] validate_networks() for [('d14880be-32d1-42d3-8376-bf82939404c6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:22:03.084869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:03.097575 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-380a1a9d-d645-49ee-bcd7-2e6de2f381f5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.353520 Sep 03 21:22:03.098667 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2731/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:02 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:03.463993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:22:03.470881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for user 98434520e99e42099265bd81e88f1862 and project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: dict_keys(['metadata_items']) {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:22:03.484249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:22:03.484675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:22:03.485201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:22:03.485615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:22:03.486027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:22:03.496805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:03.498042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:03.498511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:03.499347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:03.499835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:03.500309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:03.524260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:22:03.530147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Getting quotas for user 98434520e99e42099265bd81e88f1862 and project 6d0bae9fc4a443f1bdbd9d136784516a. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:22:03.552515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:22:03.555204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:22:03.586927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:03.597497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:03.598443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:03.599152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:03.618004 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] Creating event network-changed:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch1-master-1 Sep 03 21:22:03.623969 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-09bd7e86-bf60-4f0e-a67d-431f7acdbcb0 req-1985fde4-1038-4b3e-9ad0-03a64b2bd5fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047356 Sep 03 21:22:03.628753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2732/5689] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:22:03.666509 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11f8bc78-728c-42bb-ac3c-2f498a0deb54 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970675 Sep 03 21:22:03.667977 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2958/5690] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:22:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:22:03.680099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-58d0702d-ae4e-4f58-9985-3e1d5c9f9ffa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:03.680807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-58d0702d-ae4e-4f58-9985-3e1d5c9f9ffa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:03.773726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-58d0702d-ae4e-4f58-9985-3e1d5c9f9ffa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:03.785093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-58d0702d-ae4e-4f58-9985-3e1d5c9f9ffa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1301 microversion: 2.1 time: 0.109179 Sep 03 21:22:03.785777 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2733/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:03 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:04.122947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:04.124356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:04.134140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:04.135021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:04.135784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:04.137199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:04.138875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:04.139817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:04.328131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:04.338168 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c4ffb2c-b4ce-417f-aa19-6556ff556890 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.220187 Sep 03 21:22:04.349328 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2959/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:04 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:04.808680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:04.809624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:04.817292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:04.817658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:04.818101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:04.818807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:04.819269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:04.819697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:04.888744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:04.898276 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c22c325f-4bdb-40c6-b57c-8039dec75270 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1353 microversion: 2.1 time: 0.093685 Sep 03 21:22:04.899175 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2734/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:04 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:05.369191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:05.369966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:05.377267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:05.378562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:05.379117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:05.379949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:05.380654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:05.381291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:05.607528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:05.616435 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa5983e1-f4e6-4abb-b1d4-1378a28a1b48 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.251216 Sep 03 21:22:05.617053 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2960/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:05 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:05.925766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:05.926645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:05.933959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:05.934394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:05.934745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:05.935712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:05.936121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:05.936613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:06.110128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:06.119685 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-61471407-7e8f-41c2-9998-3f83ae6242aa tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.201391 Sep 03 21:22:06.120278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2735/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:05 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:06.641597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:06.643290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:06.655386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:06.656849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:06.677253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf0496a-ba7b-41bc-aaf7-88c884a43e1f", "tag": "64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:06.681503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:06.683836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:06.685104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:06.685541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:06.700353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:06.701167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:06.701831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:06.717276 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] Creating event network-changed:64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0 for instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f on nch2-master-1 Sep 03 21:22:06.723968 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-221cc198-6a53-447b-bdf2-9f2a6914f0ab req-306813d0-bd09-440d-90a7-06d89caa6a53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058481 Sep 03 21:22:06.726085 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2736/5696] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:06.966554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:06.975342 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-317139b4-ed3f-41ca-94c8-571f4fe05fa0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.339387 Sep 03 21:22:06.975929 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2961/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:06 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:07.147159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:07.147988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:07.155653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:07.156656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:07.157139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:07.158043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:07.158516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:07.158953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:07.305917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:07.324295 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e4dded8b-6f0b-419b-a01a-e6e35d0f4e38 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.183519 Sep 03 21:22:07.341475 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2737/5698] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:07 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:08.005860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:08.007315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:08.014766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:08.015276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:08.015720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:08.016417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:08.016874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:08.017395 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:08.231179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:08.239667 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c76b6b44-174a-4169-9e98-062fcaef3e4a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.237975 Sep 03 21:22:08.240247 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2962/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:08 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:08.351508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:08.352740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:08.356450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:08.361896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:08.362391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:08.362825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:08.363757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:08.364220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:08.364645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:08.520318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:08.528396 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-27ed01b1-fca7-4068-a2a8-8a4a13f4d653 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.181162 Sep 03 21:22:08.529000 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2738/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:08 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:09.262456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:09.263102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:09.270667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:09.271153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:09.271598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:09.272314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:09.272773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:09.273261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:09.417721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:09.425601 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-58eff5f7-ac38-408a-aaff-354555ac7b19 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.167153 Sep 03 21:22:09.426775 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2963/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:09 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:22:09.550725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:09.551352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:09.558483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:09.558996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:09.559481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:09.560226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:09.560698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:09.561164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:09.694212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:09.702081 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d6cd4e8-d5fe-4564-ab1a-16f34d9d5d64 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.155254 Sep 03 21:22:09.703118 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2739/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:09 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:09.887856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "name": "network-vif-plugged", "status": "completed", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:09.899509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:09.900021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:09.900468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:09.915410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] Creating event network-vif-plugged:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch1-master-1 Sep 03 21:22:09.920536 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-90e145cc-c8b6-4414-849a-94965bc5a588 req-75af2b69-0f6b-43de-b95a-8751aa23fd67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036335 Sep 03 21:22:09.921222 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2964/5703] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:10.449469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:10.450126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:10.456258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:10.456745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:10.457217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:10.457912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:10.458373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:10.458803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:10.589763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:10.597956 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6d2500e3-4c52-4b10-8758-2721b8b1a535 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1390 microversion: 2.1 time: 0.151963 Sep 03 21:22:10.598528 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2740/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:10 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:10.727843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:10.728569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:10.735036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:10.735524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:10.735963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:10.736672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:10.737224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:10.737658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:10.873649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:10.881321 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-093cb9ab-2518-49eb-bb9a-8f6761087743 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.159295 Sep 03 21:22:10.881896 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2965/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:10 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:11.621563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:11.622187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:11.629039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.629526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.630457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.631159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.631623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.632058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.768481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:11.776251 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-53a3f43d-acd7-4e62-bc9d-42288c51dfd9 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1562 microversion: 2.1 time: 0.158585 Sep 03 21:22:11.776822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2741/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:11 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:11.798315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:11.798961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:11.806272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.806751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.807189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.807876 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.808329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.808753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.903647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:11.904363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:11.910546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.911140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.911661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.912442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.913031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.913537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.945546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:11.954183 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82583fda-ff65-4895-a5a3-6d525cf58bbd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1562 microversion: 2.1 time: 0.159617 Sep 03 21:22:11.954890 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2966/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:11 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:11.959615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf0496a-ba7b-41bc-aaf7-88c884a43e1f", "name": "network-vif-plugged", "status": "completed", "tag": "64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:11.969755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:11.970159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:11.970596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:11.985817 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] Creating event network-vif-plugged:64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0 for instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f on nch2-master-1 Sep 03 21:22:11.991825 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-dd360368-548d-4e70-aaf7-99251670d198 req-58647c66-3861-45b3-ba0a-948ff8a048ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Sep 03 21:22:11.992744 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2967/5708] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:12.066121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:12.075134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bff5820e-b9ee-45c3-a672-7353041b27ce tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.175368 Sep 03 21:22:12.075715 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2742/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:11 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:22:13.100115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:13.100830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:13.107582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:13.108334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:13.108775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:13.109512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:13.109971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:13.110400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:13.507886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:13.539739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:13.542160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=12 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:13.549755 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9fbe43d-8119-446f-a3a3-2a2cbd8ca4b6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1426 microversion: 2.1 time: 0.454805 Sep 03 21:22:13.550283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2968/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:13 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1426 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:14.109164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:14.109815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:14.112582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=12 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:14.122053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.122557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.123037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.125972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:14.134428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.135179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.135632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.147466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.147963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.148406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.160383 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] Creating event network-changed:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch1-master-1 Sep 03 21:22:14.165626 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-9b664e81-197c-4ef9-a175-bb0c3908e0a9 req-4e5fb329-c273-4b3e-b79f-70e9cd48f539 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050362 Sep 03 21:22:14.166826 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2969/5711] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:14.338050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:14.346377 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-af0743bc-59a0-4296-b35d-2d39ae779cec tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1562 microversion: 2.1 time: 0.242666 Sep 03 21:22:14.347168 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2743/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:14 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:14.573936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:14.574659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:14.581123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.581849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.582289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.583064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.583528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.583961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.722110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:14.731015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9332d41-1cc2-4414-932d-d71f12a747e0 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1606 microversion: 2.1 time: 0.160905 Sep 03 21:22:14.737257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2970/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:14 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1606 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:14.754403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:14.755258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:14.761646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.762151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.762597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.763342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.763811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.764247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.916442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:14.924317 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e944f6cc-5ec3-41d7-9cc5-ff211d1882c9 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1606 microversion: 2.1 time: 0.173802 Sep 03 21:22:14.924887 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2744/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:14 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1606 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:22:14.947927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:14.948543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:14.955307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.955526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.955858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:14.956563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:14.957315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:14.957803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:15.092745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:22:15.101374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74d8d304-0a9b-429a-a784-89ece3e7f6c1 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1606 microversion: 2.1 time: 0.157192 Sep 03 21:22:15.101945 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2971/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:22:14 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1606 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:22:16.938196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf0496a-ba7b-41bc-aaf7-88c884a43e1f", "tag": "64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:16.949212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:16.949704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:16.950166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:16.961964 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] Creating event network-changed:64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0 for instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f on nch2-master-1 Sep 03 21:22:16.967074 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-195f72df-e051-4432-8799-e03786a32d16 req-aff2a0a6-eeee-48a5-b8ea-09b343d31dbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032588 Sep 03 21:22:16.967857 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2745/5716] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:22:49.649917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:22:49.652087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:49.654524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:49.655184 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=78 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:49.661855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:49.662342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:49.662781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:49.663474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:49.663954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:49.664354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:49.735767 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0e4b9b4d-eaa8-4df0-bb83-764bf5d291d8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action" status: 200 len: 24573 microversion: 2.1 time: 0.090467 Sep 03 21:22:49.736402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2972/5717] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:22:49 2022] POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:22:52.423010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:52.423768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=90 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:52.429032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:22:52.429620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:22:52.437152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:52.437642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:52.438086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:52.438780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:22:52.439241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:22:52.439672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:22:52.464915 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22bdbded-c952-437c-8a4f-b7b9eb7d9c4c tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044173 Sep 03 21:22:52.465489 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2746/5718] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Sep 3 21:22:52 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:28.553365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:28.554072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:28.557047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:28.557823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:28.565153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:28.565650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:28.566101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:28.566840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:28.567301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:28.567737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:28.703306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:28.711764 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7f5ff9f-e456-4a0c-8d9b-2965dde70ec1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1681 microversion: 2.1 time: 0.162692 Sep 03 21:23:28.712557 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2973/5719] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:28 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:28.815524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:28.817769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:28.819977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:28.820610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:28.827025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:28.827526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:28.828004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:28.828714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:28.829206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:28.829639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:28.897771 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fa8fa65f-e96e-420a-b328-2f1e8507c671 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action" status: 200 len: 32649 microversion: 2.1 time: 0.086317 Sep 03 21:23:28.898894 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2747/5720] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:23:28 2022] POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action => generated 32649 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:23:29.069655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:29.070278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:29.077130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:29.077630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:29.078077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:29.078787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:29.079248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:29.079684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:29.211017 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-efc11508-a896-4a17-9902-9865b7c00e69 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1832 microversion: 2.1 time: 0.144387 Sep 03 21:23:29.211579 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2974/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:29 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1832 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:29.240877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:29.243523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:29.250641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:29.251127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:29.251567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:29.252271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:29.252730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:29.253178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:29.293519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lazy-loading 'flavor' on Instance uuid 9508854e-acf7-4385-893b-a7bade3450c7 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:23:29.305683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Going to try to live migrate instance to another host {{(pid=140519) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 03 21:23:30.676610 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4dfbb4fc-5b8a-47ea-afc7-a05e5bd10b65 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action" status: 202 len: 0 microversion: 2.1 time: 1.439692 Sep 03 21:23:30.677577 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2748/5722] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:23:29 2022] POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:23:30.686794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:30.687444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:30.694357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:30.695614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:30.695873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:30.696735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:30.697128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:30.697556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:30.865968 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:30.874291 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-814b652b-b5e0-48da-b34e-67149c7e2bab tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.191499 Sep 03 21:23:30.875218 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2975/5723] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:30 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:31.898209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:31.898827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:31.907224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:31.907730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:31.908176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:31.908885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:31.909370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:31.909802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:31.995533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "name": "network-vif-unplugged", "status": "completed", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:32.006855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:32.006855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:32.007082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:32.019421 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] Creating event network-vif-unplugged:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch1-master-1 Sep 03 21:23:32.024790 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-292dcfae-b28b-440c-9b9c-7f652a20e5e6 req-3cbe08d8-a716-45ef-b60c-ba238ff5c891 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033890 Sep 03 21:23:32.026154 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2976/5724] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:23:32.050451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:32.059027 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c85ef87a-bfcf-4670-9930-998ffe519aad tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.164755 Sep 03 21:23:32.059619 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2749/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:31 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:33.084383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:33.085122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:33.091997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:33.092483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:33.092950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:33.093650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:33.094112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:33.094546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:33.228387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:33.236914 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-42da23df-4c3c-41c8-96cc-86a4d965151f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.157606 Sep 03 21:23:33.237514 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2977/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:33 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:34.065153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:34.076138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:34.076620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:34.077083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:34.087802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] Creating event network-changed:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch1-master-1 Sep 03 21:23:34.092597 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5d0eabf2-8d2c-4162-9385-3952635c87c2 req-a0a9c3fd-c8ee-4b6e-bbb2-b6168e57b145 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031270 Sep 03 21:23:34.093208 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2750/5727] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:34.259715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:34.260330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:34.267365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:34.267857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:34.268298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:34.269028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:34.269488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:34.269912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:34.402442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:34.410261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e15eb36-330a-44b6-9c86-680c9ccbf25f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.154438 Sep 03 21:23:34.410831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2978/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:34 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:35.436772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:35.437587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:35.445678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:35.446177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:35.446626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:35.447332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:35.447804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:35.448365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:35.580817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:35.589334 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-498020b3-870e-45b3-867b-0ea4fba33660 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.156594 Sep 03 21:23:35.589852 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2751/5729] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:35 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:36.612591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:36.613238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:36.619894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:36.620385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:36.620832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:36.621554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:36.622017 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:36.622450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:36.754785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:36.763033 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-70805897-b197-46c8-b4f9-1bac9994c43b tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.154634 Sep 03 21:23:36.763601 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2979/5730] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:36 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:37.787209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:37.787778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:37.801877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:37.802401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:37.802852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:37.803591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:37.804737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:37.805199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:38.136816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:38.146233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5b51a71-0540-4212-8b34-44a6bdd4e5c5 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.362824 Sep 03 21:23:38.146825 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2752/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:37 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:39.171617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:39.172434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:39.180245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:39.180749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:39.181260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:39.181969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:39.182461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:39.182890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:39.329135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:39.337754 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4820ec07-c49d-45ae-9141-080b1d8909ee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1691 microversion: 2.1 time: 0.169987 Sep 03 21:23:39.344044 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2980/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:39 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:40.364200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:40.365043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:40.373031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.373524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.373965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.374680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.375276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.375552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.505305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:40.513091 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74e35596-4025-4f4b-8f7c-109f7c2f2869 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1681 microversion: 2.1 time: 0.152918 Sep 03 21:23:40.513662 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2753/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:40 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:40.535159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:40.535792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:40.543102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.543583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.544023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.544714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.545193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.545619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.672829 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8007117c-f110-4dab-948c-b83e28523cc5 tempest-TestNetworkAdvancedServerOps-394287443 tempest-TestNetworkAdvancedServerOps-394287443-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1832 microversion: 2.1 time: 0.141239 Sep 03 21:23:40.673458 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2981/5734] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:40 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1832 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:40.696226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:40.696834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:40.702866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.703280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.703719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.704408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.704861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.705309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.839431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:40.847594 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd5ea552-220c-4644-b147-28c6e4e46744 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1681 microversion: 2.1 time: 0.155127 Sep 03 21:23:40.848191 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2754/5735] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:40 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:40.943253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:40.945477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:40.951572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.952055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.952493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:40.953273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:40.953673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:40.954098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:41.004616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d165d174-e12c-41c3-9984-0c2e364a8091 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action" status: 200 len: 38377 microversion: 2.1 time: 0.065197 Sep 03 21:23:41.005283 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2982/5736] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:23:40 2022] POST /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7/action => generated 38377 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:23:41.958154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:41.964729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:41.969111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:41.976541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:41.977267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:41.978191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:41.979008 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:41.979566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:41.979706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:41.980088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:41.980205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:41.980536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:41.993444 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] Creating event network-changed:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch2-master-1 Sep 03 21:23:41.999930 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1fd61cdd-8356-413a-a38f-96473966d7ab req-2653b882-e5f2-4442-91c5-a9672d07bdb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039767 Sep 03 21:23:42.000756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2983/5737] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:42.007418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:23:42.109478 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c9c7c62c-d102-4d48-b701-91444c11aa03 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 204 len: 0 microversion: 2.1 time: 0.154272 Sep 03 21:23:42.110445 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2755/5738] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:23:41 2022] DELETE /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:23:42.121663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:42.122737 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:42.130734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:42.131740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:42.132403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:42.134553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:42.135234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:42.136624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:42.319579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:42.328287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf31c73d-7567-4f70-ae60-08526b81e20f tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 200 len: 1687 microversion: 2.1 time: 0.212668 Sep 03 21:23:42.328792 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2984/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:42 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:43.043798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9508854e-acf7-4385-893b-a7bade3450c7", "name": "network-vif-deleted", "tag": "b331395a-9ad4-41a7-928c-8fbdffc84f71"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:43.054804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:43.056115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:43.056771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:43.069349 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] Creating event network-vif-deleted:b331395a-9ad4-41a7-928c-8fbdffc84f71 for instance 9508854e-acf7-4385-893b-a7bade3450c7 on nch2-master-1 Sep 03 21:23:43.076362 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-8a1182d4-b6cd-49f8-8300-5d261db35de1 req-7a5ff763-ceed-414c-a54b-f313fdd265a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037417 Sep 03 21:23:43.077254 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2756/5740] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:43.352258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:43.353446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 9508854e-acf7-4385-893b-a7bade3450c7] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:43.361004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:43.361505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:43.361950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:43.362668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:43.363128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:43.363563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:43.378294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] HTTP exception thrown: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Request method failure captured: Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 HTTP/1.1 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8Q61xsrwJZH_CmX1y-Jt7jA04duaIwPytdJnkJoYu5DG2AHZVSOereuWcBL1xi7yFc9BdQ8CuHkUO0j2Wyegu-gQ5hyf1y0n6VmE4AvTu52e5sWJ1976KyvCihpFzAG4aOpTDrWz2dtbGccttFrIVf6Um160RrF-pWfUx875wZdeMc Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: b5c96be8fbe1436bb3e84340ceda1917 Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '9508854e-acf7-4385-893b-a7bade3450c7'} Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:23:43.380207 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Returning 404 to user: Instance 9508854e-acf7-4385-893b-a7bade3450c7 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c670bf0-7ae5-4f3a-801e-126388572575 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7" status: 404 len: 111 microversion: 2.1 time: 0.033778 Sep 03 21:23:43.385880 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2985/5741] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:43 2022] GET /compute/v2.1/servers/9508854e-acf7-4385-893b-a7bade3450c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:23:46.632434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02783bdf-9a9d-405b-b30f-d6f4f9d13383 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '.version_select at 0x7fae65ac5160>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:46.652468 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02783bdf-9a9d-405b-b30f-d6f4f9d13383 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-809328202" status: 202 len: 0 microversion: 2.1 time: 0.024862 Sep 03 21:23:46.652855 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2757/5742] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 21:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-809328202 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:23:46.680142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8eff596b-eddd-4d92-b0fd-2d7c20b89aa3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: .version_select at 0x7fae65cae3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1598009459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK75dW4UbE9CtP3+X/tgiBX2oikZzenc49VaN+DZat7c+0MXk1pNHyd34Pqy9xvMnPwqA85z5wH4FLiLRVyQtUf1Pwh+pGIrZfIdZxcZJ+JHDBFF9u0krKEbJVAAJb/zRw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:46.697943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-8eff596b-eddd-4d92-b0fd-2d7c20b89aa3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:23:46.703883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-8eff596b-eddd-4d92-b0fd-2d7c20b89aa3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:23:46.730985 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8eff596b-eddd-4d92-b0fd-2d7c20b89aa3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054659 Sep 03 21:23:46.731824 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2986/5743] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:23:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:52.180696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-168905244", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "84027fb7-8b96-48bb-b453-19fad2555d87"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1598009459", "security_groups": [{"name": "tempest-secgroup-smoke-1314753981"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:52.313451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] validate_networks() for [('84027fb7-8b96-48bb-b453-19fad2555d87', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:23:52.733886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:23:52.735379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:23:52.736982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:23:52.737933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:23:52.739013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:23:52.755276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:52.755782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:52.756223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:52.756974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:52.757435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:52.758061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:52.777985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:23:52.783809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Getting quotas for user b5c96be8fbe1436bb3e84340ceda1917 and project 046a6abde8c84a498c1c063a1c908b42. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:23:52.797580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:23:52.800390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:23:52.855888 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5c72ae92-f2cd-4422-af63-7848acfbe983 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680278 Sep 03 21:23:52.856554 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2758/5744] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:23:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:23:52.869803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22559a02-fe2c-4f30-a231-f3ab07008128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:52.870445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22559a02-fe2c-4f30-a231-f3ab07008128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:52.930595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22559a02-fe2c-4f30-a231-f3ab07008128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:52.938575 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22559a02-fe2c-4f30-a231-f3ab07008128 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1266 microversion: 2.1 time: 0.074250 Sep 03 21:23:52.939376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2987/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:52 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:53.963264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:53.964532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:53.973263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:53.974090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:53.974729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:53.975624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:53.976253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:53.976856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:54.084308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:54.094545 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9dbe91e2-7522-4437-89b7-39ef8e5c2753 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1326 microversion: 2.1 time: 0.135768 Sep 03 21:23:54.109809 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2759/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:53 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:55.126564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:55.127095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:55.133629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=64 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:55.139407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:55.139961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:55.140404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:55.141152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:55.141606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:55.142073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:55.293035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:55.302180 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2fa87083-8bc9-4a24-9d7a-2e17e3f20e9a tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.186510 Sep 03 21:23:55.303053 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2988/5747] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:55 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:55.552554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:23:55.565191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:55.565680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:55.566130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:55.593590 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] Creating event network-changed:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:23:55.601569 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4dd1fbf8-2b02-4c98-8c65-bb9a1b75fa08 req-aec9905b-5e9c-4b36-abc9-5c01856b6025 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053035 Sep 03 21:23:55.602505 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2760/5748] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:23:56.325956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:56.326573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:56.333405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:56.333890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:56.334329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:56.335020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:56.335479 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:56.335905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:56.468767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:56.476560 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7a12841c-eb7e-4cbd-b3f8-b3ebc0b3abac tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.154529 Sep 03 21:23:56.477153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2989/5749] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:56 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:57.500824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:57.501590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:57.508028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:57.508523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:57.509002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:57.509707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:57.510171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:57.510606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:57.644198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:57.652686 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b459699e-3d2b-43a5-be75-c093bc95bed8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.156987 Sep 03 21:23:57.653284 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2761/5750] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:57 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:58.675711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:58.676235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:58.678971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:58.684874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:58.685391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:58.685843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:58.686572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:58.687036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:58.687494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:58.818549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:23:58.826343 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13b22f24-edbd-49ab-b61b-ad48c222ae38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.154717 Sep 03 21:23:58.826924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2990/5751] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:58 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:23:59.849848 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:23:59.850456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:23:59.853262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:59.858465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:59.858949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:59.859638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:59.860324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:23:59.860779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:23:59.861232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:23:59.865863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:00.004101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:24:00.012803 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-df2cd8f5-57de-4e16-bfb1-29aee7dfc6f3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.166697 Sep 03 21:24:00.013512 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2762/5752] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:23:59 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:24:00.393133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "name": "network-vif-plugged", "status": "completed", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:24:00.404564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:00.405107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:00.405631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:00.678966 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] Creating event network-vif-plugged:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:24:00.683942 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-f538385c-e47b-49c3-8da8-69b2c1173a69 req-22e94a9d-d1cd-4d82-9191-4cb5cb63b4ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294901 Sep 03 21:24:00.684558 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2991/5753] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:24:01.035545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:24:01.036149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:24:01.043189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:01.043678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:01.044121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:01.044847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:01.045333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:01.045766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:01.179965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:24:01.188352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c87d2b20-0b7c-452e-a978-57135d414475 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1392 microversion: 2.1 time: 0.156634 Sep 03 21:24:01.188864 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2763/5754] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:24:01 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:24:02.213967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:24:02.214672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:24:02.220817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:02.221421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:02.221946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:02.222726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:02.223187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:02.223620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:02.359373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:24:02.367130 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9301fa9e-e239-4556-bd66-1ca3b21409b8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1563 microversion: 2.1 time: 0.159229 Sep 03 21:24:02.367686 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2992/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:24:02 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:24:02.389823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:24:02.390449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:24:02.397354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:02.397844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:02.398321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:02.399048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:02.399507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:02.399939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:02.528890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:24:02.536659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2f7d6a18-74c6-407c-be2e-374ebc1a5438 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1563 microversion: 2.1 time: 0.150720 Sep 03 21:24:02.537260 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2764/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:24:02 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:24:04.421324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:24:04.421941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:24:04.426880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:24:04.435099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:04.437505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:04.438261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:04.444740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:04.445265 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:04.445708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:04.446423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:04.447379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:04.447799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:04.451421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:04.451901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:04.452344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:04.465016 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] Creating event network-changed:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:24:04.470043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-df03d158-393d-4107-a8a7-8cdcb5e01107 req-ccde0e3e-3c25-454a-b44c-924daab3ce5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046633 Sep 03 21:24:04.471029 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2765/5757] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:24:04.591140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:24:04.600077 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56e9f7a5-522a-4f57-9405-2119d0c2b09d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1563 microversion: 2.1 time: 0.182705 Sep 03 21:24:04.600642 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2993/5758] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:24:04 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:24:37.894090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=7 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:37.894982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=19 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:37.899833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:24:37.902131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:24:37.910698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:37.911193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:37.911636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:37.912335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:24:37.912824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:24:37.913279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:24:37.977960 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2844c20-7dd0-444e-a89a-a6975690742d tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action" status: 200 len: 24574 microversion: 2.1 time: 0.085846 Sep 03 21:24:37.978616 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2766/5759] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:24:37 2022] POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action => generated 24574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:25:16.999604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=7 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:17.000409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=32 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:17.001260 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:25:17.001408 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action (ip 10.222.0.16) !!! Sep 03 21:25:17.006246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:25:17.008973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:17.017228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.017722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.018173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.018880 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.019349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.019786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.240126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:25:17.240558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:25:17.241070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:25:17.241487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:25:17.241910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:25:17.303079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:17.310116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.310547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.311002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.311795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.312259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.312723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.338169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ece40ff2-c518-4bd8-9669-a191f7659ffd tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action" status: 202 len: 1135 microversion: 2.1 time: 0.340971 Sep 03 21:25:17.338813 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2994/5760] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:25:16 2022] POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action => generated 1135 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 03 21:25:17.360445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:17.361179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:17.365088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:17.365753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:17.370221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.370717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.371170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.371898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:17.372345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:17.372778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:17.567554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:17.575613 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-76ec4aaf-9d4f-437c-a78b-c3b045ebe6bb tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.220428 Sep 03 21:25:17.576414 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2767/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:17 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:18.601872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:18.602495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:18.609609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:18.610353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:18.610797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:18.611492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:18.611951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:18.612381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:18.742886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:18.751107 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4cd1aba7-2610-4cdf-8ebf-431de66b6e79 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.153183 Sep 03 21:25:18.751669 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2995/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:18 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:19.774862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:19.775475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:19.783151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:19.783634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:19.784073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:19.784762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:19.785245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:19.785675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:19.922981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:19.930775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91e8744e-778a-4fce-b998-cebceaacd7fa tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.159769 Sep 03 21:25:19.931342 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2768/5763] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:19 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:20.955283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:20.955909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:20.962625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:20.963148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:20.963598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:20.964304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:20.964768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:20.965238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:21.093990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:21.101794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9b8ff156-8927-40a1-88d6-776f25500d89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.151116 Sep 03 21:25:21.102370 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2996/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:20 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:22.125519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:22.126169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:22.133135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:22.133631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:22.134076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:22.134789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:22.135474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:22.135669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:22.269201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:22.277012 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-519463e3-c791-4ecb-9eb1-4dd54f003f37 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.156248 Sep 03 21:25:22.277588 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2769/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:22 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:23.301441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:23.302056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:23.308942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:23.309435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:23.309881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:23.310587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:23.311043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:23.311492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:23.448292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:23.456183 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b4dcbda3-68ec-4854-b7a1-7bdb22137dc1 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.158744 Sep 03 21:25:23.456742 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2997/5766] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:23 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:24.479596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:24.480210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:24.487321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:24.487802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:24.488239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:24.488945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:24.489439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:24.489866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:24.622406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:24.630733 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac95d809-73cb-4236-94d2-976678b0c0f6 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.155098 Sep 03 21:25:24.631299 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2770/5767] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:24 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:25.654687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:25.655859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:25.662750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:25.663250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:25.663698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:25.664408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:25.664873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:25.665331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:25.796456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:25.804252 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8561c2a-ed26-40d6-892b-a651dc0ce086 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.153674 Sep 03 21:25:25.804821 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2998/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:25 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:26.827714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:26.828334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:26.835299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:26.835783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:26.836231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:26.836954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:26.837419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:26.838112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:26.968706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:26.976578 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b1f238d-6d4e-4356-8490-b86b48e22587 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.152844 Sep 03 21:25:26.977185 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2771/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:26 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:28.000929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:28.001555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:28.008563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:28.009096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:28.009536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:28.010237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:28.010699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:28.011130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:28.149888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:28.158100 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24d4c8d2-e4f7-45ff-b0ec-72e4a479faee tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.161768 Sep 03 21:25:28.158668 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 2999/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:27 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:29.182212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:29.183302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:29.191469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:29.192016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:29.192853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:29.193814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:29.194307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:29.194750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:29.385619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:29.398630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-649236b6-adf9-43f9-a689-4fa5deb1fef7 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1690 microversion: 2.1 time: 0.220773 Sep 03 21:25:29.399217 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2772/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:29 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:30.422917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:30.423596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:30.430459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:30.430948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:30.431388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:30.432085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:30.432543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:30.432994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:30.562436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:30.570253 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dece49e3-ac89-4a43-a644-d0093dc033a8 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1696 microversion: 2.1 time: 0.151808 Sep 03 21:25:30.570823 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3000/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:30 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:31.593598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:31.594215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:31.601082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:31.601570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:31.602006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:31.602699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:31.603153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:31.603584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:31.737781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:31.745622 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7932a856-eb4c-42fd-98d0-6e4fa51e65e0 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1696 microversion: 2.1 time: 0.156028 Sep 03 21:25:31.746194 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2773/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:31 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:32.769888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:32.770503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:32.778031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:32.778799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:32.779320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:32.780111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:32.780686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:32.781320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:32.919043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:32.927020 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d165ae48-13eb-48c8-bf99-98b50d6dac89 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1696 microversion: 2.1 time: 0.161070 Sep 03 21:25:32.927614 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3001/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:32 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:32.977697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "name": "network-vif-unplugged", "status": "completed", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:25:32.987931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:32.988411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:32.988874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:33.000398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] Creating event network-vif-unplugged:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:25:33.006292 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a229e3b6-0838-4b93-bb12-5e96da1f40b6 req-f5a5cfe9-0808-4a93-a540-b1663f3f2696 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032369 Sep 03 21:25:33.007686 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2774/5775] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:25:33.951142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:25:33.951760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:25:33.958875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:33.959377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:33.959829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:33.960596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:33.961106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:33.961542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:34.091614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:25:34.099402 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ec51b11d-be7c-4d0b-b366-fc62a1e24d56 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1681 microversion: 2.1 time: 0.152185 Sep 03 21:25:34.099967 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3002/5776] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:25:33 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:25:35.192113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "name": "network-vif-plugged", "status": "completed", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:25:35.203087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:25:35.203617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:25:35.204063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:25:35.215524 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] Creating event network-vif-plugged:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:25:35.220888 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9514dab3-f20c-44c3-a9ec-96ab13cc3e73 req-bb79c4be-7339-44f0-87d2-8b5b349985a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033864 Sep 03 21:25:35.221699 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2775/5777] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:26:10.338343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:10.340540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:10.342627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=22 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:10.343940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:10.350010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:10.350506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:10.350963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:10.351677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:10.352147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:10.352586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:10.430621 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2af340b8-e842-4120-86c5-641228195d61 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action" status: 200 len: 24557 microversion: 2.1 time: 0.096346 Sep 03 21:26:10.431179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3003/5778] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:26:10 2022] POST /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5/action => generated 24557 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:26:41.725565 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 03 21:26:41.726245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=18 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:41.727083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=46 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:41.727827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:41.728652 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:26:41.728812 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 (ip 10.222.0.16) !!! Sep 03 21:26:41.732149 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:26:41.732791 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 (ip 10.222.0.16) !!! Sep 03 21:26:41.736062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:41.736884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:41.747600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:41.748131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:41.748838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:41.756816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:41.757780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:41.761208 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] Creating event network-changed:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:26:41.766539 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-48d5b5e1-ca20-4321-86ad-28153871977c req-c705e9a9-78a4-43c8-99a1-de79277ea99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044242 Sep 03 21:26:41.767469 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3004/5779] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:26:41.769660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:41.770435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:41.770888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:41.771605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:41.772101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:41.772536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:41.798959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:26:41.891508 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cf48ef34-81f9-4ebb-8adf-c9694088e6b3 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 204 len: 0 microversion: 2.1 time: 0.171560 Sep 03 21:26:41.892570 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2776/5780] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:26:41 2022] DELETE /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:26:41.902322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:41.903260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:41.910445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:41.911031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:41.911583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:41.912401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:41.913087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:41.913594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:42.349495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:42.357367 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca783a60-4bc9-41b5-b268-13de4f474a38 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1687 microversion: 2.1 time: 0.460216 Sep 03 21:26:42.357979 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3005/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:41 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1687 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:43.381519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:43.382106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:43.392138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:43.392628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:43.393132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:43.393841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:43.394301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:43.394729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:43.412484 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40030. Sep 03 21:26:43.553319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5c96be8fbe1436bb3e84340ceda1917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046a6abde8c84a498c1c063a1c908b42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:43.561090 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a182712-5ef5-4e3f-89d9-ec1e57eeab08 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 200 len: 1687 microversion: 2.1 time: 0.183913 Sep 03 21:26:43.561649 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2777/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:43 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:44.150716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2617773a-5f2f-4477-86bb-d20df90f14b5", "name": "network-vif-deleted", "tag": "d6bba419-007c-4adf-b849-4b87e68fe5fb"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:44.163188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:44.163679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:44.164126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:44.174760 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] Creating event network-vif-deleted:d6bba419-007c-4adf-b849-4b87e68fe5fb for instance 2617773a-5f2f-4477-86bb-d20df90f14b5 on nch1-master-1 Sep 03 21:26:44.179707 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-c52453ec-18e9-4b6a-9054-1e0c02018c22 req-aa0727dd-1535-430a-af2e-887d2e779ce5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134647 Sep 03 21:26:44.180320 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3006/5783] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:26:44.694515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:44.695144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [instance: 2617773a-5f2f-4477-86bb-d20df90f14b5] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:44.701332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:44.701866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:44.702313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:44.703047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:44.703513 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:44.703947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:44.717761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] HTTP exception thrown: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Request method failure captured: Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 HTTP/1.1 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8Q61xsrwJZH_CmX1y-Jt7jA04duaIwPytdJnkJoYu5DG2AHZVSOereuWcBL1xi7yFc9BdQ8CuHkUO0j2Wyegu-gQ5hyf1y0n6VmE4AvTu52e5sWJ1976KyvCihpFzAG4aOpTDrWz2dtbGccttFrIVf6Um160RrF-pWfUx875wZdeMc Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/046a6abde8c84a498c1c063a1c908b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 046a6abde8c84a498c1c063a1c908b42 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1857268927 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: b5c96be8fbe1436bb3e84340ceda1917 Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1857268927-project Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2617773a-5f2f-4477-86bb-d20df90f14b5'} Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:26:44.719430 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Returning 404 to user: Instance 2617773a-5f2f-4477-86bb-d20df90f14b5 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c186c841-b9db-4a00-a3c4-f47e81e7d229 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5" status: 404 len: 111 microversion: 2.1 time: 0.137949 Sep 03 21:26:44.725012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2778/5784] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:44 2022] GET /compute/v2.1/servers/2617773a-5f2f-4477-86bb-d20df90f14b5 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:26:47.721948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6745e230-5b66-45e9-abfc-ec35422b0d68 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] Calling method '.version_select at 0x7fae65e205e0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:47.726708 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6745e230-5b66-45e9-abfc-ec35422b0d68 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:26:48.734031 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [None req-6745e230-5b66-45e9-abfc-ec35422b0d68 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40058. Sep 03 21:26:48.753468 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6745e230-5b66-45e9-abfc-ec35422b0d68 tempest-TestNetworkAdvancedServerOps-1857268927 tempest-TestNetworkAdvancedServerOps-1857268927-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1598009459" status: 202 len: 0 microversion: 2.1 time: 1.037234 Sep 03 21:26:48.754043 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3007/5785] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Sep 3 21:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1598009459 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:26:52.522983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1216400210", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "9dbc92a5-79df-4788-8d6f-cbe63dea331c"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:52.577618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] validate_networks() for [('9dbc92a5-79df-4788-8d6f-cbe63dea331c', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:26:52.929445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:26:52.929876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:26:52.930389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:26:52.930804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:26:52.931246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:26:52.940196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:52.940683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:52.941162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:52.941901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:52.942368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:52.942796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:52.959858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Getting quotas for project ef9efdb2b0cd4585bb5d48040c46cdf0. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:26:52.965153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Getting quotas for user 4f8e7d53f6ce49c6ac44ade281e1309e and project ef9efdb2b0cd4585bb5d48040c46cdf0. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:26:52.978066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:26:52.980378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:26:53.027163 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b78223ac-0185-41e7-843f-84c65b11181d tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620130 Sep 03 21:26:53.028021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2779/5786] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:26:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:26:53.038901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-800fbe15-8213-4b32-bfcd-1b1ebbff81a1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:53.039679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-800fbe15-8213-4b32-bfcd-1b1ebbff81a1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:53.095241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-800fbe15-8213-4b32-bfcd-1b1ebbff81a1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:53.102290 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-800fbe15-8213-4b32-bfcd-1b1ebbff81a1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1215 microversion: 2.1 time: 0.067204 Sep 03 21:26:53.102854 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3008/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:53 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:54.125676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-520d0620-1384-4d16-8477-4d831c24ca80 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:54.126301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-520d0620-1384-4d16-8477-4d831c24ca80 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:54.183745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-520d0620-1384-4d16-8477-4d831c24ca80 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:54.190830 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-520d0620-1384-4d16-8477-4d831c24ca80 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1215 microversion: 2.1 time: 0.070067 Sep 03 21:26:54.191386 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2780/5788] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:54 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:55.213891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:55.214592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:55.218510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:55.224053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:55.224546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:55.225024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:55.225733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:55.226197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:55.226627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:55.286859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:55.294428 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-84c64c17-f071-4195-a370-ff3ff5e82e0c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1219 microversion: 2.1 time: 0.084434 Sep 03 21:26:55.295680 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3009/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:55 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:56.080344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:56.080879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:56.087856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.088351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.088802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.089542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.090021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.090431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.116405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:26:56.196618 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17ec949c-2675-4e7b-847a-bf2a809a25d6 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 204 len: 0 microversion: 2.1 time: 0.120485 Sep 03 21:26:56.197347 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2781/5790] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:26:56 2022] DELETE /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:26:56.206663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:56.207449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:56.214438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.215064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.215408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.216136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.216632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.217112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.318081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:56.319184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:56.325483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.326840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.327819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.328439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:56.329083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:56.329718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:56.366074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:56.375593 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9688b62a-49c1-49e6-bae6-48392bbbd8b8 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1731 microversion: 2.1 time: 0.172837 Sep 03 21:26:56.377729 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3010/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:56 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:56.438001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:56.445834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cab5312a-2e0b-46b5-a975-f1538c40402a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1285 microversion: 2.1 time: 0.131985 Sep 03 21:26:56.446432 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2782/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:56 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:26:57.398774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:57.399488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:57.407723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:57.408202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:57.408657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:57.409405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:57.409871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:57.410308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:57.469515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:57.470292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:57.477518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:57.478018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:57.479147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:57.479147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:57.479632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:57.480191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:57.548685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:57.557453 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-19c4fa00-a4d0-46d3-996f-992b191c7956 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1731 microversion: 2.1 time: 0.162442 Sep 03 21:26:57.571067 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3011/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:57 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:57.878214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fc846a-44e2-4064-9007-002ef4236e6d", "tag": "3550e5e9-a8fe-4b68-9472-804bc508e4c3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:57.888127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:57.888740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:57.889306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:57.900415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] Creating event network-changed:3550e5e9-a8fe-4b68-9472-804bc508e4c3 for instance 30fc846a-44e2-4064-9007-002ef4236e6d on nch1-master-1 Sep 03 21:26:57.905358 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-01bf9596-e80f-4073-9117-cafcca12ec13 req-d7ccf61f-2c03-41de-a9b8-78874a68aa93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Sep 03 21:26:57.906293 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3012/5794] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:26:58.117426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:58.126136 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1fdc9fba-7ae7-48c0-995e-b4b9edd8db5b tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.661069 Sep 03 21:26:58.126799 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2783/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:57 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:26:58.583666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:58.584515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:58.590890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:58.591386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:58.592402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:58.593148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:58.593614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:58.594079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:58.734398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98434520e99e42099265bd81e88f1862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d0bae9fc4a443f1bdbd9d136784516a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:58.743831 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-115e7929-2e94-4880-ac3d-10305a14d987 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 200 len: 1731 microversion: 2.1 time: 0.165318 Sep 03 21:26:58.744430 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3013/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:58 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:59.150028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:59.150645 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:59.158520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:59.159324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:59.159762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:59.160664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:59.161155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:59.161760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:59.316417 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:26:59.330206 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5a256707-bb1a-4157-9fa2-3329a892a8cd tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.183743 Sep 03 21:26:59.331048 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2784/5797] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:59 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:26:59.766525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:26:59.767150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:26:59.775007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:59.775421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:59.775868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:59.776823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:59.777620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:59.778289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:59.794041 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] HTTP exception thrown: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Request method failure captured: Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f HTTP/1.1 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8VujLJ_7-XAKxRqt5jM9AnvOdlBgbpWpNpYy0vR_s1siy10K1eTFgTDVL5jkSkHVk7VlbDpGiweVD8pS30jsjpdERXcfSIpjy81NH0JzFHvc6kpGZggfFcn4mRKNjYd1qbf4wc_9KYi0kFETIow2RzqvO16DFQSLG9rlinXZw6qKeU Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestServerBasicOps-1489738856 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestServerBasicOps-1489738856-project Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 98434520e99e42099265bd81e88f1862 Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestServerBasicOps-1489738856-project Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7bf0496a-ba7b-41bc-aaf7-88c884a43e1f'} Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:26:59.796421 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Returning 404 to user: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-97d43665-9477-4058-b02b-9eade89781eb tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 404 len: 111 microversion: 2.1 time: 0.035317 Sep 03 21:26:59.802142 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3014/5798] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:26:59 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:26:59.948435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf0496a-ba7b-41bc-aaf7-88c884a43e1f", "name": "network-vif-deleted", "tag": "64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:26:59.959498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:26:59.959953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:26:59.960386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:26:59.973816 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] Creating event network-vif-deleted:64d24fe5-d8b1-4d8e-9f8e-a0c757dc30f0 for instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f on nch2-master-1 Sep 03 21:26:59.978329 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b0036247-5bfc-439c-97bd-43404945ccf8 req-23eb8995-a9af-4642-8339-737cbf68e23b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034744 Sep 03 21:26:59.979021 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2785/5799] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:27:00.355623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:00.356537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:00.363003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.363497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.363942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.364683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.365184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.365610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.401879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:00.402394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:00.409103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.409599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.410049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.410769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.411279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.411712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.425570 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] HTTP exception thrown: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Request method failure captured: Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f HTTP/1.1 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8VujLJ_7-XAKxRqt5jM9AnvOdlBgbpWpNpYy0vR_s1siy10K1eTFgTDVL5jkSkHVk7VlbDpGiweVD8pS30jsjpdERXcfSIpjy81NH0JzFHvc6kpGZggfFcn4mRKNjYd1qbf4wc_9KYi0kFETIow2RzqvO16DFQSLG9rlinXZw6qKeU Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestServerBasicOps-1489738856-project Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 98434520e99e42099265bd81e88f1862 Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestServerBasicOps-1489738856-project Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7bf0496a-ba7b-41bc-aaf7-88c884a43e1f'} Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:27:00.427148 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Returning 404 to user: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e1154de2-124d-439a-a6f4-4fdd522fa5d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 404 len: 111 microversion: 2.1 time: 0.137360 Sep 03 21:27:00.431869 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3015/5800] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:27:00 2022] DELETE /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:27:00.436957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:00.437577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] [instance: 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:00.443416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.443913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.444364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.445131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:00.445592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:00.446032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:00.460172 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] HTTP exception thrown: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Request method failure captured: Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f HTTP/1.1 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8VujLJ_7-XAKxRqt5jM9AnvOdlBgbpWpNpYy0vR_s1siy10K1eTFgTDVL5jkSkHVk7VlbDpGiweVD8pS30jsjpdERXcfSIpjy81NH0JzFHvc6kpGZggfFcn4mRKNjYd1qbf4wc_9KYi0kFETIow2RzqvO16DFQSLG9rlinXZw6qKeU Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d0bae9fc4a443f1bdbd9d136784516a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6d0bae9fc4a443f1bdbd9d136784516a Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestServerBasicOps-1489738856 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestServerBasicOps-1489738856-project Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 98434520e99e42099265bd81e88f1862 Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestServerBasicOps-1489738856-project Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7bf0496a-ba7b-41bc-aaf7-88c884a43e1f'} Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:00.461766 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Returning 404 to user: Instance 7bf0496a-ba7b-41bc-aaf7-88c884a43e1f could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-06d12f67-ff78-4b98-947a-b9684211908a tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f" status: 404 len: 111 microversion: 2.1 time: 0.029868 Sep 03 21:27:00.467440 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3016/5801] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:00 2022] GET /compute/v2.1/servers/7bf0496a-ba7b-41bc-aaf7-88c884a43e1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:27:00.502617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:00.510609 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cbbe2515-f717-4a91-b222-b8a4ab7f99af tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.159976 Sep 03 21:27:00.511183 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2786/5802] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:00 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:27:00.626233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4986a5b5-5b9b-42d1-9e4e-6eea9f2a46d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] Calling method '.version_select at 0x7fae6698a280>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:00.648120 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4986a5b5-5b9b-42d1-9e4e-6eea9f2a46d3 tempest-TestServerBasicOps-1489738856 tempest-TestServerBasicOps-1489738856-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-734367685" status: 202 len: 0 microversion: 2.1 time: 0.026044 Sep 03 21:27:00.648807 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3017/5803] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Sep 3 21:27:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-734367685 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:01.533525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:01.534140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:01.541436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:01.541859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:01.542493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:01.543196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:01.543651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:01.544072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:01.700947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:01.711007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ad0ac951-75b1-45fa-ba18-ab5ec1410731 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.181289 Sep 03 21:27:01.711607 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2787/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:01 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:02.734463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:02.735359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:02.743668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:02.744191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:02.744634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:02.745387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:02.746567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:02.747202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:02.959656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:02.970605 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0cff4f65-e16d-42cc-acd8-18933f25b064 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.240505 Sep 03 21:27:02.984921 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3018/5805] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:02 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:03.802707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:03.918669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fc846a-44e2-4064-9007-002ef4236e6d", "name": "network-vif-plugged", "status": "completed", "tag": "3550e5e9-a8fe-4b68-9472-804bc508e4c3"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:03.930375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:03.931157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:03.931821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:03.947720 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] Creating event network-vif-plugged:3550e5e9-a8fe-4b68-9472-804bc508e4c3 for instance 30fc846a-44e2-4064-9007-002ef4236e6d on nch1-master-1 Sep 03 21:27:03.960925 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ff53bc25-4e9a-4501-b64e-9c66d9e3a2ac req-4a951813-ffc8-4a73-9c0e-40125fa21b07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163667 Sep 03 21:27:03.962048 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2788/5806] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:04.001104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:04.001650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:04.006363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:04.017166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:04.018057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:04.018742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:04.022352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:04.023099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:04.023823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:04.297769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:04.308750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-762de953-7b53-424a-a49b-27cd00366485 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.313368 Sep 03 21:27:04.309497 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3019/5807] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:03 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:05.329463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:05.334855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:05.335557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:05.343166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:05.343656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:05.344097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:05.344797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:05.345274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:05.345699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:05.849728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:05.858155 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11779a64-8a0e-4705-825b-f332da1afce4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1315 microversion: 2.1 time: 0.529746 Sep 03 21:27:05.858729 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2789/5808] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:05 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:06.882022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:06.882929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:06.890575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:06.891276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:06.891833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:06.892672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:06.893418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:06.893961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.099632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:07.108658 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cb8287a-fcd2-4463-8c2a-35297a6dfdb1 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1502 microversion: 2.1 time: 0.230702 Sep 03 21:27:07.109543 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3020/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:06 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:07.132201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:07.133466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:07.141673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.142512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.143109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.143979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.144598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.145212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.385656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:07.396350 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a0d1101-7798-4e9b-aabd-23cd036b04c8 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1502 microversion: 2.1 time: 0.268220 Sep 03 21:27:07.397351 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2790/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:07 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:07.423831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:07.424714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:07.431511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.432018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.432466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.433432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.433901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.434508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.459930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lazy-loading 'flavor' on Instance uuid 30fc846a-44e2-4064-9007-002ef4236e6d {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:27:07.559727 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9e54711d-26fc-4648-a76d-161895babb61 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.141322 Sep 03 21:27:07.569613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:07.570801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:07.574159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3021/5811] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:07 2022] POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:07.579329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.580689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.582081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.583695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:07.585047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:07.585782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:07.827512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:07.836435 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3ddc236-635d-442c-9ae3-825a9e5bc1d6 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1510 microversion: 2.1 time: 0.272431 Sep 03 21:27:07.837239 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2791/5812] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:07 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:08.860913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:08.861959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:08.869828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:08.870424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:08.870949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:08.871777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:08.872321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:08.873010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:09.017496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:09.025792 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8e820c0-d888-4ea3-8b6e-e41465ef8f00 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1493 microversion: 2.1 time: 0.169931 Sep 03 21:27:09.026367 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3022/5813] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:08 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1493 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:09.049827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:09.050372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:09.057554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:09.058056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:09.058505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:09.059227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:09.059690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:09.060155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:09.088326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:09.132550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-11d87c05-00fe-47f9-a2b0-b0412ede9b90 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.086732 Sep 03 21:27:09.133826 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2792/5814] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:09 2022] POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:27:09.143037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:09.144031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:09.152921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:09.155369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:09.156143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:09.158382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:09.159120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:09.159969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:09.312010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:09.320624 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e5aacf2-4c15-42ab-be0c-0fff7d249ce9 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1499 microversion: 2.1 time: 0.182219 Sep 03 21:27:09.322851 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3023/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:09 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1499 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:10.346980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:10.347870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:10.356410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:10.357567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:10.358363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:10.359149 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:10.359849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:10.360784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:10.511121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:10.524667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7958b3d0-b0d2-4446-8625-fc1aa8053e6c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1499 microversion: 2.1 time: 0.181844 Sep 03 21:27:10.525954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2793/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:10 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1499 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:11.550463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:11.551171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:11.558805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.559315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.560630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:11.561757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.562404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.563019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:11.805950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:11.814848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-60c64f6e-4e76-40f8-b5b9-f11a6c719d4a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1502 microversion: 2.1 time: 0.269442 Sep 03 21:27:11.815543 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3024/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:11 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:11.838114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:11.838685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:11.843238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:11.846980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.847757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.848270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:11.849086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.849611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.850127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:11.876678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lazy-loading 'flavor' on Instance uuid 30fc846a-44e2-4064-9007-002ef4236e6d {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:27:11.952016 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-01151265-76ad-4a67-8f75-49ae0dead0cf tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.117707 Sep 03 21:27:11.953043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2794/5818] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:11 2022] POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:11.961076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:11.961947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:11.965754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:11.970083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.970935 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.971421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:11.972454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:11.972956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:11.973388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:12.154606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:12.164507 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f3b2901b-65ea-44e8-88da-0614493be0b5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1510 microversion: 2.1 time: 0.207195 Sep 03 21:27:12.166039 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3025/5819] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:11 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:13.193258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:13.194989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:13.209041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.210085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.210772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.211672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.212304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.212930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.388174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:13.397554 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d100348-4fda-4948-aa1b-50dfd1e1a6a3 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1493 microversion: 2.1 time: 0.213147 Sep 03 21:27:13.398477 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2795/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:13 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1493 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:13.422610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:13.423190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:13.431163 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.431944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.432391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.433142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.433609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.434217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.491372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:13.513897 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8c7db42-dae5-40e8-b241-0d09f8a0a1db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.095740 Sep 03 21:27:13.514595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3026/5821] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:13 2022] POST /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:13.533045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:13.533790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:13.542207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.542710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.543160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.543874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:13.544987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:13.545424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:13.851069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:13.868121 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f1456322-ec99-40ae-b80f-7c774025b4db tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1499 microversion: 2.1 time: 0.349339 Sep 03 21:27:13.871850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2796/5822] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:13 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1499 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:14.896095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:14.897436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:14.907417 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:14.907907 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:14.908365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:14.909141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:14.909657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:14.910131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:15.139055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:15.148086 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa80f969-4c62-4d81-9425-c45e5915ffce tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1499 microversion: 2.1 time: 0.257237 Sep 03 21:27:15.149432 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3027/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:14 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:16.177241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:16.177909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:16.189416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.190104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.190367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:16.195647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.195792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.196259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:16.737638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:16.745709 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-761bb6c9-642b-471e-a01f-6a36239a5ea5 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1502 microversion: 2.1 time: 0.572788 Sep 03 21:27:16.746524 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2797/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:16 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1502 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:16.769372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:16.769981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:16.776375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.777173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.777808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:16.779306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.779936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.780536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:16.809365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:27:16.915608 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c114af73-dfef-42c5-b7ce-fd4568856b18 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 204 len: 0 microversion: 2.1 time: 0.150653 Sep 03 21:27:16.916648 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3028/5825] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:27:16 2022] DELETE /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:27:16.925609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:16.926488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:16.934753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.935277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.935722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:16.936433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:16.936934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:16.937367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:17.092586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:17.101855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-170c6022-90a9-4b67-8a77-62443907192a tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1508 microversion: 2.1 time: 0.180790 Sep 03 21:27:17.117403 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2798/5826] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:16 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:18.129233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:18.130563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:18.141568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:18.142566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:18.143246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:18.144471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:18.145049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:18.146655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:18.317803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:18.329555 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-819f0a70-98c6-4545-9a3d-1992b410c385 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1508 microversion: 2.1 time: 0.207681 Sep 03 21:27:18.330662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3029/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:18 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:19.358027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:19.358652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:19.366037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:19.366837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:19.367466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:19.368375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:19.369034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:19.369803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:19.564662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:19.580874 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1ce25a9a-039e-4737-ac77-40e75959cde4 tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1508 microversion: 2.1 time: 0.223909 Sep 03 21:27:19.582192 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2799/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:19 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:19.799698 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fc846a-44e2-4064-9007-002ef4236e6d", "name": "network-vif-deleted", "tag": "3550e5e9-a8fe-4b68-9472-804bc508e4c3"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:19.817583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:19.818187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:19.818643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:19.833820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] Creating event network-vif-deleted:3550e5e9-a8fe-4b68-9472-804bc508e4c3 for instance 30fc846a-44e2-4064-9007-002ef4236e6d on nch1-master-1 Sep 03 21:27:19.864156 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d6379d00-8912-4ec7-b088-9f192925bfec req-92b64c4e-2963-44dd-ba5c-22466120e090 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068775 Sep 03 21:27:19.865490 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3030/5829] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:27:20.608204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:20.608823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:20.615974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:20.616463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:20.616943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:20.617646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:20.618107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:20.618533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:20.670727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:20.671221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:20.671664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:20.672124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lazy-loading 'fault' on Instance uuid 30fc846a-44e2-4064-9007-002ef4236e6d {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:27:20.723619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e7d53f6ce49c6ac44ade281e1309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9efdb2b0cd4585bb5d48040c46cdf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:20.733026 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6bbdcf9d-c6ca-42d8-8f8c-5d299efd83aa tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 200 len: 1305 microversion: 2.1 time: 0.129123 Sep 03 21:27:20.733742 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2800/5830] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:20 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:21.767321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:21.768817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] [instance: 30fc846a-44e2-4064-9007-002ef4236e6d] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:21.780320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:21.781398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:21.782544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:21.783306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:21.783778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:21.784583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:21.808734 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] HTTP exception thrown: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Request method failure captured: Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d HTTP/1.1 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8abbj26nPXaT5FrgE3ny0KIFJPQslseiVGSvkObTXhA-LltIpK0lPidHud_8ZXPdlPCh40MnuDS5OwxOdlZ68Onq3Sc-KCnzBtMoGNn0UKSHZkOZwjUsi0AOIXGpRBEEiITmznUF0mVjLcrA4gfIr7LV8uR249FQ1Ez0LVGo6nr6K8 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: ef9efdb2b0cd4585bb5d48040c46cdf0 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestServerAdvancedOps-619472108 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef9efdb2b0cd4585bb5d48040c46cdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ef9efdb2b0cd4585bb5d48040c46cdf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ef9efdb2b0cd4585bb5d48040c46cdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ef9efdb2b0cd4585bb5d48040c46cdf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestServerAdvancedOps-619472108 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: ef9efdb2b0cd4585bb5d48040c46cdf0 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestServerAdvancedOps-619472108 Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestServerAdvancedOps-619472108-project Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4f8e7d53f6ce49c6ac44ade281e1309e Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestServerAdvancedOps-619472108-project Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '30fc846a-44e2-4064-9007-002ef4236e6d'} Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:21.811620 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. Sep 03 21:27:21.817371 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:21.818892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] Returning 404 to user: Instance 30fc846a-44e2-4064-9007-002ef4236e6d could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:21.819860 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91d25520-7c87-497c-ae9e-d3a78804341c tempest-TestServerAdvancedOps-619472108 tempest-TestServerAdvancedOps-619472108-project] 10.222.0.16 "GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d" status: 404 len: 111 microversion: 2.1 time: 0.066248 Sep 03 21:27:21.820542 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3031/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:21 2022] GET /compute/v2.1/servers/30fc846a-44e2-4064-9007-002ef4236e6d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:27:40.829345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=15 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:40.830090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:40.940618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1426530235", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:40.994061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] validate_networks() for None {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:27:41.266001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:27:41.267050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:27:41.267593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:27:41.268006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:27:41.268423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:27:41.277346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:41.277852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:41.278373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:41.279102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:41.279556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:41.279987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:41.296267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Getting quotas for project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:27:41.301488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Getting quotas for user 75a909287112419fab8c2bb8735d6913 and project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:27:41.313971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:27:41.316223 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:27:41.359146 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a5f86bac-c520-44cb-8f37-ede26d6e07ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535256 Sep 03 21:27:41.360031 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2801/5832] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:27:41.372875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f6a251be-0d92-4ce3-9424-43a34a34e81f tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:41.373516 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f6a251be-0d92-4ce3-9424-43a34a34e81f tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:41.378207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:41.378867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:41.441173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f6a251be-0d92-4ce3-9424-43a34a34e81f tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:41.452211 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f6a251be-0d92-4ce3-9424-43a34a34e81f tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1222 microversion: 2.1 time: 0.083379 Sep 03 21:27:41.452730 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3032/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:41 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:42.477148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:42.477771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:42.485046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:42.485594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:42.486043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:42.486749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:42.487214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:42.487649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:42.581521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:42.589411 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4311a99d-f539-4221-8183-bca63ba94dee tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1280 microversion: 2.1 time: 0.117003 Sep 03 21:27:42.589914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2802/5834] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:42 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:43.615702 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:43.616403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:43.623742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:43.624236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:43.625492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:43.627096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:43.627569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:43.628004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:43.768371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465e55db-a56d-4125-8e6e-3720b4cc400e", "tag": "b488edfa-4ce6-4f30-b680-e231675f8aef"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:43.769857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:43.783012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-af270d3e-17a4-4d9e-b6e7-583f22428c21 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.173226 Sep 03 21:27:43.785259 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3033/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:43 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:43.802940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:43.803437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:43.803912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:43.818451 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] Creating event network-changed:b488edfa-4ce6-4f30-b680-e231675f8aef for instance 465e55db-a56d-4125-8e6e-3720b4cc400e on nch2-master-1 Sep 03 21:27:43.823370 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-60538485-ab78-4ed2-a0b1-d34ee15fa123 req-f953a14a-9143-47b5-a83f-9d0fa2bf7e00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059636 Sep 03 21:27:43.824053 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2803/5836] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:44.808377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:44.809031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:44.816547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:44.817067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:44.817510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:44.818214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:44.818675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:44.819109 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:44.945179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:44.952808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0834c4de-c518-4a59-b598-e0316303cfe8 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.148497 Sep 03 21:27:44.953398 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3034/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:44 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:45.977279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:45.977981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:45.984456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:45.985245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:45.985756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:45.986514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:45.987151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:45.987742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:46.118820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:46.127659 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6039faed-52f5-40b5-a7e4-37da1ea9980c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.155199 Sep 03 21:27:46.128216 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2804/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:45 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:47.150546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:47.151166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:47.158035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:47.159149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:47.159592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:47.160292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:47.160752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:47.161218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:47.292159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:47.300250 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d9ad37f7-0c35-4d48-a523-4a7679e4156b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.153666 Sep 03 21:27:47.300817 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3035/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:47 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:48.323762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:48.324336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:48.331610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:48.332099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:48.332544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:48.333276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:48.333739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:48.334172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:48.467140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:48.475383 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f07a1b08-4cf1-4343-b5c3-b2fb442a2c2c tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.155615 Sep 03 21:27:48.476146 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2805/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:48 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:48.547368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465e55db-a56d-4125-8e6e-3720b4cc400e", "name": "network-vif-plugged", "status": "completed", "tag": "b488edfa-4ce6-4f30-b680-e231675f8aef"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:48.557863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:48.558427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:48.558868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:48.570073 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] Creating event network-vif-plugged:b488edfa-4ce6-4f30-b680-e231675f8aef for instance 465e55db-a56d-4125-8e6e-3720b4cc400e on nch2-master-1 Sep 03 21:27:48.575078 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-21570d01-3631-49ad-8504-f7f3f2d0fa42 req-5d9c2c26-1be0-4feb-994b-665c53e35fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Sep 03 21:27:48.575669 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3036/5841] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:49.498515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:49.499162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:49.506098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:49.506593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:49.507043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:49.507743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:49.508220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:49.508644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:49.640699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:49.649749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-097c2333-e6cd-4b86-9c32-11a5fa6653b9 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1322 microversion: 2.1 time: 0.155139 Sep 03 21:27:49.650317 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2806/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:49 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:50.675132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:50.675877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:50.682238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:50.682736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:50.683194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:50.684051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:50.684517 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:50.684998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:50.819270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:50.827335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ef00c40-ca45-4602-b221-e67568bac9ca tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1471 microversion: 2.1 time: 0.157691 Sep 03 21:27:50.827914 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3037/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:50 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:50.910154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0a953be0-d9fe-4da0-86d9-2f5d7494101f tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '.version_select at 0x7fae65aceaf0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:50.976255 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0a953be0-d9fe-4da0-86d9-2f5d7494101f tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/239da9b5cb54407399dc57c618206624" status: 200 len: 371 microversion: 2.1 time: 0.126771 Sep 03 21:27:50.977046 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2807/5844] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 21:27:50 2022] GET /compute/v2.1/os-quota-sets/239da9b5cb54407399dc57c618206624 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:50.990001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d40be422-a3d7-46d3-987b-9b07f123e94d tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1169318825", "id": 910086175, "os-flavor-access:is_public": "True"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:51.007865 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d40be422-a3d7-46d3-987b-9b07f123e94d tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021798 Sep 03 21:27:51.008547 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3038/5845] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:27:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:51.021479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "910086175"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:51.023817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:51.030172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.030668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.031159 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.031874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.032339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.032774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.230765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7b2d3d471ac246a18005f7388bbe3914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239da9b5cb54407399dc57c618206624', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:51.237673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1169318825 {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:27:51.244374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.244851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.245310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.246035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.246523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.246969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.267429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Getting quotas for project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:27:51.272506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Getting quotas for user 75a909287112419fab8c2bb8735d6913 and project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:27:51.284863 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] ram quota exceeded for 239da9b5cb54407399dc57c618206624, tried to resize instance. Sep 03 21:27:51.285433 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Request method failure captured: Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action HTTP/1.1 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 38 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8bMCX_vzjS-zGfb5jQ9xA_eXN-7f9GkCdEzxcHB1AAJo_xrLWeUWxXDC1EsDdwohLRImIjP05JqwnyTU8mvYOR3_k9G4j5VDnrLokukFCdr46SFYzJ-uxlMgXkFRHj_XCZ8_uQ3ARirDDQxoXnh3B6qZuz_C8pTbB4y5V4qSzCBLmw Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 239da9b5cb54407399dc57c618206624 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Role: admin,member,reader Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: admin,member,reader Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/239da9b5cb54407399dc57c618206624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_239da9b5cb54407399dc57c618206624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/239da9b5cb54407399dc57c618206624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/239da9b5cb54407399dc57c618206624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 239da9b5cb54407399dc57c618206624 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAdminNegativeTestJSON-1367276198-project-admin Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 7b2d3d471ac246a18005f7388bbe3914 Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1367276198-project-admin Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: {"resize": {"flavorRef": "910086175"}} Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '465e55db-a56d-4125-8e6e-3720b4cc400e', 'body': {'resize': {'flavorRef': '910086175'}}} Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.287504 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63fb6ae8-cef8-471c-b12d-4092aacc4c02 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action" status: 403 len: 118 microversion: 2.1 time: 0.272044 Sep 03 21:27:51.290850 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2808/5846] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:51 2022] POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action => generated 118 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:27:51.297976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1091700e-df68-4787-83bb-84c1530a5b75 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.316199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1091700e-df68-4787-83bb-84c1530a5b75 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/910086175" status: 202 len: 0 microversion: 2.1 time: 0.022020 Sep 03 21:27:51.316758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3039/5847] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 21:27:51 2022] DELETE /compute/v2.1/flavors/910086175 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:51.324412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32f4c8aa-b934-47d0-b0ba-a20d8dc004f3 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.344437 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32f4c8aa-b934-47d0-b0ba-a20d8dc004f3 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023614 Sep 03 21:27:51.344990 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2809/5848] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:51.366944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ed05ff0c-636f-449d-96a3-a8b99a824003 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '.version_select at 0x7fae65fe5c10>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.453284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ed05ff0c-636f-449d-96a3-a8b99a824003 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/239da9b5cb54407399dc57c618206624" status: 200 len: 371 microversion: 2.1 time: 0.090388 Sep 03 21:27:51.453867 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3040/5849] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Sep 3 21:27:51 2022] GET /compute/v2.1/os-quota-sets/239da9b5cb54407399dc57c618206624 => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:51.466157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21c12d63-eb95-4803-bb5b-8dc8cb4a7d1b tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1525156416", "id": 197221321, "os-flavor-access:is_public": "True"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:51.484556 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21c12d63-eb95-4803-bb5b-8dc8cb4a7d1b tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022097 Sep 03 21:27:51.485421 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2810/5850] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:27:51 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:51.498133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "197221321"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:51.500506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:51.507588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.508086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.508540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.509283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.509752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.510189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.651885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7b2d3d471ac246a18005f7388bbe3914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239da9b5cb54407399dc57c618206624', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:51.658549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1525156416 {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:27:51.665132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.665630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.666074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.666821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.667284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.667716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.690885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Getting quotas for project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:27:51.696037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Getting quotas for user 75a909287112419fab8c2bb8735d6913 and project 621154db31a744688409d362a5a51d2d. Resources: {'cores', 'ram'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:27:51.707921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.compute.api [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] cores quota exceeded for 239da9b5cb54407399dc57c618206624, tried to resize instance. Sep 03 21:27:51.708473 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Request method failure captured: Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action HTTP/1.1 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 38 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8bMCX_vzjS-zGfb5jQ9xA_eXN-7f9GkCdEzxcHB1AAJo_xrLWeUWxXDC1EsDdwohLRImIjP05JqwnyTU8mvYOR3_k9G4j5VDnrLokukFCdr46SFYzJ-uxlMgXkFRHj_XCZ8_uQ3ARirDDQxoXnh3B6qZuz_C8pTbB4y5V4qSzCBLmw Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 239da9b5cb54407399dc57c618206624 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Role: admin,member,reader Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: admin,member,reader Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/239da9b5cb54407399dc57c618206624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_239da9b5cb54407399dc57c618206624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/239da9b5cb54407399dc57c618206624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/239da9b5cb54407399dc57c618206624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 239da9b5cb54407399dc57c618206624 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1367276198 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersAdminNegativeTestJSON-1367276198-project-admin Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 7b2d3d471ac246a18005f7388bbe3914 Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1367276198-project-admin Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: {"resize": {"flavorRef": "197221321"}} Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '465e55db-a56d-4125-8e6e-3720b4cc400e', 'body': {'resize': {'flavorRef': '197221321'}}} Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.710644 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b1582b6-4664-4622-b214-6c2880d7d259 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action" status: 403 len: 113 microversion: 2.1 time: 0.218091 Sep 03 21:27:51.713852 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3041/5851] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:27:51 2022] POST /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e/action => generated 113 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:27:51.721213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a3858efe-de26-4cb0-8937-cb765f9ca240 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.738690 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a3858efe-de26-4cb0-8937-cb765f9ca240 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/197221321" status: 202 len: 0 microversion: 2.1 time: 0.021647 Sep 03 21:27:51.739408 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2811/5852] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Sep 3 21:27:51 2022] DELETE /compute/v2.1/flavors/197221321 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:27:51.747190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ab6d35df-8985-4432-907e-ac9240d29563 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.768374 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ab6d35df-8985-4432-907e-ac9240d29563 tempest-ServersAdminNegativeTestJSON-1367276198 tempest-ServersAdminNegativeTestJSON-1367276198-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024897 Sep 03 21:27:51.768958 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3042/5853] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Sep 3 21:27:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:51.789699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.790212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:51.796257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.796753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.797266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.798009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.798478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.798975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.824256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:27:51.899093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-58be0ec0-3fe1-4ee1-99f1-7133f8303136 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "DELETE /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 204 len: 0 microversion: 2.1 time: 0.112936 Sep 03 21:27:51.899643 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2812/5854] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:27:51 2022] DELETE /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:27:51.907605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:51.908228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:51.914243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.914734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.915175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:51.915895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:51.916352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:51.916784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:52.048725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:52.056680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fbee9f29-d618-4ea0-9808-68e55683347b tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1477 microversion: 2.1 time: 0.152968 Sep 03 21:27:52.057278 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3043/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:51 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:53.080725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:53.081466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:53.089023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:53.089520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:53.089967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:53.090672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:53.091134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:53.091570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:53.300101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a909287112419fab8c2bb8735d6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621154db31a744688409d362a5a51d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:27:53.308093 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a74aeb4-e81d-4f99-9374-77b257739744 tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 200 len: 1477 microversion: 2.1 time: 0.232196 Sep 03 21:27:53.308866 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2813/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:53 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:27:53.676042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465e55db-a56d-4125-8e6e-3720b4cc400e", "name": "network-vif-deleted", "tag": "b488edfa-4ce6-4f30-b680-e231675f8aef"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:27:53.687633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:53.688125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:53.688566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:53.702129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] Creating event network-vif-deleted:b488edfa-4ce6-4f30-b680-e231675f8aef for instance 465e55db-a56d-4125-8e6e-3720b4cc400e on nch2-master-1 Sep 03 21:27:53.707873 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-bd26ea09-cf5b-48e1-9b1c-d803e01f7431 req-da322e9f-ec20-48e7-aaef-eeae764c2b10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Sep 03 21:27:53.708796 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3044/5857] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:27:54.331733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:27:54.332353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] [instance: 465e55db-a56d-4125-8e6e-3720b4cc400e] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:27:54.339467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:54.339988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:54.340440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:54.341181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:27:54.341642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:27:54.342092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:27:54.356152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] HTTP exception thrown: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Request method failure captured: Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e HTTP/1.1 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8bMwLhBsbgENuq9oi0SKk1t5p3thnED4IMbMoTITrbTZn45cNRiWLH1P7Ab3CtauPDftG53YFO7Aodjax9BdTdOQstyU74Vd_o9GHMS4ZGTw6xztBWxviUHqnpnecWMrcvsjC3bV9l5_XEgboj1BNqLLBZc7-b8ch0L7XYP2oMCJ-4 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 621154db31a744688409d362a5a51d2d Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1445866464 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/621154db31a744688409d362a5a51d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_621154db31a744688409d362a5a51d2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/621154db31a744688409d362a5a51d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/621154db31a744688409d362a5a51d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1445866464 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 621154db31a744688409d362a5a51d2d Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1445866464 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersAdminNegativeTestJSON-1445866464-project Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 75a909287112419fab8c2bb8735d6913 Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1445866464-project Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '465e55db-a56d-4125-8e6e-3720b4cc400e'} Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:54.357850 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] Returning 404 to user: Instance 465e55db-a56d-4125-8e6e-3720b4cc400e could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-43119bb9-1f03-4c7c-b573-31ffd211959e tempest-ServersAdminNegativeTestJSON-1445866464 tempest-ServersAdminNegativeTestJSON-1445866464-project] 10.222.0.16 "GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e" status: 404 len: 111 microversion: 2.1 time: 0.031609 Sep 03 21:27:54.361875 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2814/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:27:54 2022] GET /compute/v2.1/servers/465e55db-a56d-4125-8e6e-3720b4cc400e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:28:00.700921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-862032658", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "ee18f262-10a7-4585-94ed-79dff8244d9f"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:00.758846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] validate_networks() for [('ee18f262-10a7-4585-94ed-79dff8244d9f', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:28:01.139833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:28:01.140313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:28:01.140815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:28:01.141252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:28:01.141669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:28:01.150610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:01.151095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:01.151563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:01.152298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:01.152762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:01.153221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:01.171611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Getting quotas for project 896d00e971ae41bd9a93fe68df8abc5e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:28:01.179697 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Getting quotas for user 045d6e2cb47c40c3b84895b0d472ddc0 and project 896d00e971ae41bd9a93fe68df8abc5e. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:28:01.192837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:28:01.195284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:28:01.241492 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d0e3f098-303d-4ca8-be6a-3270854e3870 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663721 Sep 03 21:28:01.242258 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3045/5859] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:28:01.255509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-03b7c747-4652-41c2-9470-7372b75cdddd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:01.256198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-03b7c747-4652-41c2-9470-7372b75cdddd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:01.259126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:01.259962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=5 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:01.316811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-03b7c747-4652-41c2-9470-7372b75cdddd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:01.324655 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-03b7c747-4652-41c2-9470-7372b75cdddd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1214 microversion: 2.1 time: 0.075069 Sep 03 21:28:01.325275 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2815/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:01 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:02.349300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:02.349845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:02.357117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:02.357615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:02.358080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:02.358773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:02.359251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:02.359967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:02.423532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:02.432148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2cb72c34-8766-493e-a104-f35b08096bbd tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1266 microversion: 2.1 time: 0.088359 Sep 03 21:28:02.432718 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3046/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:02 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:28:03.457719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:03.458975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:03.466940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:03.467857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:03.468453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:03.469860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:03.470355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:03.470795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:03.765721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:03.776348 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0333ea07-8e40-4ecf-9e0c-51be59693863 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.323453 Sep 03 21:28:03.777952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2816/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:03 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:04.045951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:04.072575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:04.073102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:04.073540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:04.086193 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] Creating event network-changed:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch2-master-1 Sep 03 21:28:04.092355 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-58841648-c5c6-435a-b77e-075f91940b3b req-d01bb3ce-9cbb-4197-a714-c3c06f286dd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056061 Sep 03 21:28:04.092991 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3047/5863] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:28:04.800276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:04.800829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:04.807624 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:04.808109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:04.808548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:04.809265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:04.809724 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:04.810151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:04.939368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:04.947277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0cda0bc-3613-47ef-929e-28b67d66897b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.151648 Sep 03 21:28:04.947838 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2817/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:04 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:05.971730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:05.972534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:05.979253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:05.979747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:05.980195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:05.980915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:05.981382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:05.981814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:06.119199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:06.127082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-510f80cf-1fc1-48a2-9eb4-bb1bf11c6349 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.159827 Sep 03 21:28:06.128159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3048/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:05 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:07.151490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:07.152115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:07.159653 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:07.160145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:07.160593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:07.161334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:07.161800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:07.162234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:07.302125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:07.310546 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4fc2e171-99cf-4ae3-8f2d-f20f3da75720 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.162980 Sep 03 21:28:07.311115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2818/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:07 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:08.334457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:08.335107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:08.342271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:08.342764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:08.343210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:08.343917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:08.344384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:08.344819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:08.473335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:08.481189 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1520049e-0021-4544-a8fa-6dec8b2e8784 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.151060 Sep 03 21:28:08.481771 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3049/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:08 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:08.784228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "name": "network-vif-plugged", "status": "completed", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:08.795053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:08.795545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:08.795990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:08.807826 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] Creating event network-vif-plugged:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch2-master-1 Sep 03 21:28:08.812781 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bb719b70-6ae9-4caf-8f35-c5d4e0dcfaed req-b0ed0315-ae24-4a7c-b6ae-d559e1193278 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 Sep 03 21:28:08.813398 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2819/5868] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:28:09.510003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:09.510624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:09.517508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:09.518493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:09.518936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:09.519646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:09.520105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:09.520540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:09.651110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:09.659392 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5d8d6ac-37bf-462d-8e2c-b25cac3c72e4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1314 microversion: 2.1 time: 0.153737 Sep 03 21:28:09.659960 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3050/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:09 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:10.683779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:10.684425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:10.691336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:10.691846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:10.692388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:10.693012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:10.693473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:10.693904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:10.827757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:10.836573 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c70f562-1520-4e70-8092-bc789331d03f tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1501 microversion: 2.1 time: 0.158350 Sep 03 21:28:10.837164 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2820/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:10 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:10.858882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:10.862167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:10.869074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:10.869571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:10.870011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:10.870719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:10.871190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:10.871629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:10.945988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:10.951823 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Old instance type m1.heat2, new instance type m1.heat {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:28:10.958349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:28:10.958783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:28:10.959269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:28:10.959688 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:28:10.960137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:28:11.074906 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-81f6677f-4f63-41f1-ab16-863a0355e7f7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "POST /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72/action" status: 202 len: 0 microversion: 2.1 time: 0.219944 Sep 03 21:28:11.077953 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3051/5871] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:28:10 2022] POST /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:28:11.084169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:11.084788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:11.087077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:11.092458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:11.092987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:11.093441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:11.094167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:11.094633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:11.095070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:11.101054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:11.255406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:11.264107 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ab67a4ae-1e0f-480a-91f3-d3ebef1d8717 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1510 microversion: 2.1 time: 0.184334 Sep 03 21:28:11.264675 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2821/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:11 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:12.284343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:12.285172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:12.289911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:12.290524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:12.292610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:12.298754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:12.299244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:12.299690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:12.300389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:12.300847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:12.301303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:12.305729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:12.450049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:12.458192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b274e3d2-2d71-4e10-b43f-da32f6d20237 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1510 microversion: 2.1 time: 0.174744 Sep 03 21:28:12.458775 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3052/5873] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:12 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:13.482043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:13.482775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:13.485027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:13.491379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:13.491878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:13.492328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:13.493073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:13.493544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:13.493979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:13.634524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:13.642333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b947b346-f6fe-4a86-a062-fac7a39b2e3c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.164471 Sep 03 21:28:13.642823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2822/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:13 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:14.665735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:14.666381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:14.673771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:14.674195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:14.674643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:14.675353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:14.675818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:14.676254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:14.806010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:14.813823 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8fccc59-a848-4eaa-ada0-38e58d5566ac tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.152047 Sep 03 21:28:14.814436 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3053/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:14 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:15.837186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:15.837730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:15.844646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:15.845176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:15.846121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:15.846821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:15.847288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:15.847719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:15.987358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:15.999347 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2be28bf8-2a2b-4b55-a9ea-7ea344019e80 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.166171 Sep 03 21:28:15.999925 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2823/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:15 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:17.023067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:17.023725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:17.030700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:17.031202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:17.031654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:17.032366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:17.032836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:17.033302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:17.173310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:17.181669 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67f87623-d642-40d7-bb20-29cd87361552 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.162571 Sep 03 21:28:17.182251 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3054/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:17 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:28:18.205766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:18.206421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:18.213357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:18.213853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:18.214299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:18.215001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:18.215461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:18.215895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:18.351738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:18.359472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-18960ece-dc34-424d-9b56-4f42ecefe474 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.157664 Sep 03 21:28:18.360292 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2824/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:18 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:19.383590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:19.384187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:19.391161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:19.391587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:19.392028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:19.392743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:19.393229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:19.393665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:19.523929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:19.531693 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-306e88dd-87fc-4598-b7ce-36ff5b18af21 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.152001 Sep 03 21:28:19.532271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3055/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:19 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:20.558561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:20.559222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:20.567114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:20.567634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:20.568092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:20.568826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:20.569325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:20.569792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:20.701609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:20.709885 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-04650675-a60f-4f0b-99aa-793898d04931 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.158015 Sep 03 21:28:20.710441 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2825/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:20 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:21.733804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:21.734353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:21.741932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:21.742420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:21.742863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:21.743561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:21.744019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:21.744447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:21.881619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:21.889361 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2f663f97-7e31-4a72-90de-cec9f81fd5b7 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.159486 Sep 03 21:28:21.889933 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3056/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:21 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:22.912919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:22.913565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:22.921259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:22.921761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:22.922238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:22.922951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:22.923437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:22.923854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:23.054085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:23.061913 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-925f025f-dab4-4df5-b14d-ce4f879d4c0c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.153677 Sep 03 21:28:23.062480 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2826/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:22 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:24.085898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:24.086521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:24.093508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:24.094001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:24.094451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:24.095152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:24.096159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:24.096595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:24.226462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:24.234169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-caa480a5-9b0c-4927-9bf3-3a18aa9e533c tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.152295 Sep 03 21:28:24.235003 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3057/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:24 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:25.258480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:25.259107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:25.266184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:25.266680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:25.267629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:25.268344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:25.268839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:25.269303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:25.401193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:25.409893 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-26ead424-b868-4d00-887a-6f3eb76a2bce tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.155387 Sep 03 21:28:25.410464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2827/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:25 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:26.433667 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:26.434277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:26.441765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:26.442289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:26.442738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:26.443447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:26.443911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:26.444348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:26.578143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:26.586508 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-373cec34-ba60-4fc4-87e6-fac5a723fa07 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.157022 Sep 03 21:28:26.587070 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3058/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:26 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:28:27.609995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:27.610620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:27.617954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:27.618448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:27.618890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:27.619598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:27.620058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:27.620489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:27.747245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:27.755488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4a15f247-46a4-4cca-96af-329fd7d3ac65 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.149732 Sep 03 21:28:27.756059 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2828/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:27 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:28.779740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:28.780406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:28.787906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:28.788407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:28.788856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:28.789681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:28.790149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:28.790589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:28.921910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:28.929859 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c65c1806-9e47-4431-be9d-18302a23fb3b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.154171 Sep 03 21:28:28.930470 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3059/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:28 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:29.953227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:29.953945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:29.961819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:29.962317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:29.962768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:29.963475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:29.963941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:29.964393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:30.099687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:30.107371 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62562e82-6635-4d63-966d-5078efda4b64 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.158092 Sep 03 21:28:30.107939 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2829/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:29 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:31.131198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:31.131818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:31.138878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:31.139368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:31.139837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:31.140541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:31.141034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:31.141468 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:31.273924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:31.281841 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-54cb355f-ac9b-4a0c-b6b5-9c673d0569d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.154508 Sep 03 21:28:31.282419 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3060/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:31 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:32.306696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:32.307330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:32.314972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:32.315516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:32.315996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:32.316709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:32.317206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:32.317644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:32.451025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:32.458729 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f328b4a4-6420-46ad-9fff-6912eb7165b3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.156273 Sep 03 21:28:32.459314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2830/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:32 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:33.482625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:33.483271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:33.491180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:33.491713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:33.492132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:33.492841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:33.493324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:33.493754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:33.628463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:33.636300 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8cc7a8c-8a49-4e57-9f5a-9669fb94be5d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.157544 Sep 03 21:28:33.636855 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3061/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:33 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:34.659822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:34.660480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:34.667065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:34.667561 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:34.668011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:34.668717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:34.669205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:34.669643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:34.797405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:34.805295 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-12293eb9-5afb-4946-b11b-c95ba1ecbfc3 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.149590 Sep 03 21:28:34.805868 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2831/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:34 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:35.829083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:35.829728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:35.836486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:35.837003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:35.837445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:35.838170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:35.838629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:35.839058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:35.968460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:35.976673 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7674c66-9edc-4a57-9774-b15533586723 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.151572 Sep 03 21:28:35.977275 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3062/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:35 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:37.000660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:37.001799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:37.008985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:37.009431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:37.009879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:37.010591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:37.011059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:37.011524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:37.145855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:37.153688 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e88c3d33-8763-4b1d-934d-8459051d90ea tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.156959 Sep 03 21:28:37.154262 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2832/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:36 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:38.176504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:38.177147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:38.184719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:38.185234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:38.185669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:38.186362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:38.186816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:38.187246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:38.321799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:38.331282 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7c0eb7e9-eaf8-42cd-9109-faba9430305b tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.158723 Sep 03 21:28:38.331980 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3063/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:38 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:39.354787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:39.355416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:39.362665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:39.363165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:39.363618 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:39.364330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:39.364800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:39.365262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:39.494871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:39.502747 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0bbf3201-3988-4dd2-8f58-ff9d0dccac8d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1515 microversion: 2.1 time: 0.151876 Sep 03 21:28:39.503321 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2833/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:39 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:40.183282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "name": "network-vif-unplugged", "status": "completed", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:40.194256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:40.194746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:40.195218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:40.207314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Creating event network-vif-unplugged:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch1-master-1 Sep 03 21:28:40.212829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:28:40.223835 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0f902945-dc50-4f5d-b193-2f56cc02f0b4 req-869d9691-bded-44b8-88c3-b57c56c53726 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044093 Sep 03 21:28:40.224450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3064/5897] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:28:40.526979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:40.527643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:40.535500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:40.536028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:40.536480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:40.537233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:40.537700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:40.538172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:40.917920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:40.925982 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-98da1c6e-44bd-4b54-a858-ea470e27c87d tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1514 microversion: 2.1 time: 0.402992 Sep 03 21:28:40.926562 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2834/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:40 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:41.950932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:41.951637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:41.958459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:41.958945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:41.959385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:41.960079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:41.960536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:41.960985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:42.090581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:42.098493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3bcaaede-ced7-47d4-bd4c-8bbc9f3a2c19 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1512 microversion: 2.1 time: 0.152704 Sep 03 21:28:42.099063 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3065/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:41 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:42.250864 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:42.256988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=28 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:42.262906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:42.263391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:42.263836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:42.268182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=84 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:42.276736 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Creating event network-changed:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch1-master-1 Sep 03 21:28:42.282205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:28:42.292951 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c1f49847-7d2e-4216-8e35-5c33ab81ff63 req-6bd04c66-d34a-4eba-8735-85aaf96e2c18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045847 Sep 03 21:28:42.293536 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2835/5900] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:28:43.121552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:43.122177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:43.125022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=28 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:43.130659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:43.131159 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:43.131606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:43.132314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:43.132790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:43.133245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:43.135919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=82 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:43.264156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:43.272499 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-71980033-5e06-48aa-b426-35a4d647c989 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1512 microversion: 2.1 time: 0.154915 Sep 03 21:28:43.273096 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3066/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:43 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:44.298176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:44.299511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:44.305816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:44.306304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:44.306748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:44.307446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:44.307907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:44.308340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:44.536949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:44.544853 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a9b8515-7dc6-4c13-a207-36e4ff6469bc tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1509 microversion: 2.1 time: 0.251751 Sep 03 21:28:44.545466 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2836/5902] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:44 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:44.567895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:44.568535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:44.575738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:44.576239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:44.576689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:44.577605 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:44.578132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:44.578709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:44.606748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:28:44.662504 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.compute.api [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Found an unconfirmed migration during delete, id: 16, status: finished Sep 03 21:28:45.974199 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f93203ed-e9d6-46ab-bf35-261e2e8073d4 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 204 len: 0 microversion: 2.1 time: 1.409660 Sep 03 21:28:45.974996 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3067/5903] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:28:44 2022] DELETE /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 0 bytes in 1412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:28:45.983489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:45.984111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:45.991941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:45.992443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:45.992887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:45.993615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:45.994076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:45.994509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:46.126420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:46.139291 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8b60a85-f8e8-4225-904a-6df258dd7c72 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1501 microversion: 2.1 time: 0.159821 Sep 03 21:28:46.139884 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2837/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:45 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:46.169672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "name": "network-vif-plugged", "status": "completed", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:46.180946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:46.181897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:46.182400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:46.196754 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] Creating event network-vif-plugged:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch1-master-1 Sep 03 21:28:46.201621 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3c325b11-df3f-4d8d-89a7-823434896cf8 req-ab219bbc-24eb-4a30-9a79-043977a21883 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037771 Sep 03 21:28:46.202229 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3068/5905] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:28:47.163850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:47.164478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:47.172869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:47.173403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:47.173857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:47.174567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:47.175035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:47.175481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:47.311445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045d6e2cb47c40c3b84895b0d472ddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896d00e971ae41bd9a93fe68df8abc5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:47.319905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4dfcef35-d3ec-4e91-a630-c36e5c012ea1 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 200 len: 1501 microversion: 2.1 time: 0.160691 Sep 03 21:28:47.320480 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2838/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:47 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:48.006621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291274e-23e3-4b34-b121-1fc10dcf9c72", "name": "network-vif-deleted", "tag": "1666e06b-3717-4476-a3e2-66e1e3a1258e"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:48.017197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.017700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.018145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.030315 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] Creating event network-vif-deleted:1666e06b-3717-4476-a3e2-66e1e3a1258e for instance d291274e-23e3-4b34-b121-1fc10dcf9c72 on nch1-master-1 Sep 03 21:28:48.035984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0a0632f7-8636-49e9-bf6e-f6ebe4d527fa req-216afa38-71da-4b78-a3e8-894fda9e5de5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034546 Sep 03 21:28:48.036741 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3069/5907] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:28:48.343898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:48.344486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:48.352072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.352568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.353072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.353785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.354253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.354693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.368305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] HTTP exception thrown: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Request method failure captured: Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 HTTP/1.1 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8bgJAOPmIq_qf_fD0GtNWTh6P3euTlegXoxp6rrRx24YbKQtOfhhH1RNd5Jmipo4pVjpFH6lopXgbJ65qQvZEnQI6ZXeKAlJV2U_wOSGTZuVkAsIo4jHRX7T7XVxd4f3fnE0sePwNl9UUUe9zZf9pZphq9S3xjr2hIZGka9FZOCld8 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 045d6e2cb47c40c3b84895b0d472ddc0 Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd291274e-23e3-4b34-b121-1fc10dcf9c72'} Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.370042 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Returning 404 to user: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e816841b-ff59-45e2-a469-1ccd7da20d22 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 404 len: 111 microversion: 2.1 time: 0.031673 Sep 03 21:28:48.373719 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2839/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:48 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:28:48.385130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:48.385733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:48.392277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.392774 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.393260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.394454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.394921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.395357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.408493 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] HTTP exception thrown: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Request method failure captured: Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 HTTP/1.1 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8bgJAOPmIq_qf_fD0GtNWTh6P3euTlegXoxp6rrRx24YbKQtOfhhH1RNd5Jmipo4pVjpFH6lopXgbJ65qQvZEnQI6ZXeKAlJV2U_wOSGTZuVkAsIo4jHRX7T7XVxd4f3fnE0sePwNl9UUUe9zZf9pZphq9S3xjr2hIZGka9FZOCld8 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 045d6e2cb47c40c3b84895b0d472ddc0 Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'd291274e-23e3-4b34-b121-1fc10dcf9c72'} Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:28:48.410727 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Returning 404 to user: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-690d906b-76f5-4329-96e4-308f0662afaa tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 404 len: 111 microversion: 2.1 time: 0.031801 Sep 03 21:28:48.414607 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3070/5909] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:28:48 2022] DELETE /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:28:48.420959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:48.421597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] [instance: d291274e-23e3-4b34-b121-1fc10dcf9c72] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:48.427845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.428341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.428786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.429531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:48.429995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:48.430515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:48.444555 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] HTTP exception thrown: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Request method failure captured: Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 HTTP/1.1 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8bgJAOPmIq_qf_fD0GtNWTh6P3euTlegXoxp6rrRx24YbKQtOfhhH1RNd5Jmipo4pVjpFH6lopXgbJ65qQvZEnQI6ZXeKAlJV2U_wOSGTZuVkAsIo4jHRX7T7XVxd4f3fnE0sePwNl9UUUe9zZf9pZphq9S3xjr2hIZGka9FZOCld8 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/896d00e971ae41bd9a93fe68df8abc5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 896d00e971ae41bd9a93fe68df8abc5e Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-DeleteServersTestJSON-204266869 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 045d6e2cb47c40c3b84895b0d472ddc0 Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-DeleteServersTestJSON-204266869-project Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'd291274e-23e3-4b34-b121-1fc10dcf9c72'} Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:28:48.446146 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] Returning 404 to user: Instance d291274e-23e3-4b34-b121-1fc10dcf9c72 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1cadd87-a1e9-4958-a0b1-8c35c75e1c06 tempest-DeleteServersTestJSON-204266869 tempest-DeleteServersTestJSON-204266869-project] 10.222.0.16 "GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72" status: 404 len: 111 microversion: 2.1 time: 0.030626 Sep 03 21:28:48.449952 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2840/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:48 2022] GET /compute/v2.1/servers/d291274e-23e3-4b34-b121-1fc10dcf9c72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:28:56.721658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1354520814", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "cb3a96ef-1f60-474f-8b8b-a7ee15195217"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:56.778613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] validate_networks() for [('cb3a96ef-1f60-474f-8b8b-a7ee15195217', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:28:57.167175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:28:57.167610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:28:57.168211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:28:57.168964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:28:57.169607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:28:57.179573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:57.180005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:57.180449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:57.181228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:57.181700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:57.182135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:57.200236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for project 90775ee27e9d462aaf236e95d95d5512. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:28:57.205932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for user d4a6118a9f10425c9a95842105534ea0 and project 90775ee27e9d462aaf236e95d95d5512. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:28:57.218588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:28:57.220965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:28:57.265982 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5960bb1a-7456-4e58-b6f3-2355febf650c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669594 Sep 03 21:28:57.267406 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3071/5911] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:28:57.278523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-146a2571-f1ce-4885-b915-c60c3e405508 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:57.279725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-146a2571-f1ce-4885-b915-c60c3e405508 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:57.334201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-146a2571-f1ce-4885-b915-c60c3e405508 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:57.341200 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-146a2571-f1ce-4885-b915-c60c3e405508 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1218 microversion: 2.1 time: 0.066556 Sep 03 21:28:57.341772 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2841/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:57 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:58.366157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:58.367486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:58.375494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:58.376239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:58.376828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:58.377883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:58.378495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:58.379125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:58.459732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:58.468728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20f91466-bd3d-4917-a52d-1e32a7567201 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1278 microversion: 2.1 time: 0.106935 Sep 03 21:28:58.469461 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3072/5913] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:58 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:59.500859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:28:59.501566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:28:59.511856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=25 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:59.513791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:59.514711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:59.515372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:59.516446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:59.517321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:59.517938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:59.760870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:28:59.772881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e567310-365d-4470-a5ff-c609435c871a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1318 microversion: 2.1 time: 0.281433 Sep 03 21:28:59.774437 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2842/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:28:59 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:28:59.876714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:28:59.891694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:28:59.893603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:28:59.894336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:28:59.912181 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] Creating event network-changed:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch1-master-1 Sep 03 21:28:59.932034 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a068c5ca-d095-4a39-a465-816890442798 req-50cbd3ba-2a64-4fa6-9ff3-1f57871e3e3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060249 Sep 03 21:28:59.934088 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3073/5915] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:00.796152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:00.796800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:00.803700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:00.804188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:00.804633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:00.805362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:00.805826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:00.806258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:00.936528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:00.944700 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d519b3bb-da3b-449e-bdb5-ce0a741ec760 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1318 microversion: 2.1 time: 0.152506 Sep 03 21:29:00.945299 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2843/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:00 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:01.968099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:01.968808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:01.976505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:01.977027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:01.977470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:01.978168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:01.978626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:01.979056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:02.420250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:02.429143 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-396c573f-c166-4f8a-95cf-81aecde37363 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1318 microversion: 2.1 time: 0.465171 Sep 03 21:29:02.429716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3074/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:01 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:03.453301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:03.453924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:03.460961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:03.461456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:03.461898 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:03.462605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:03.463069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:03.463508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:03.603134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:03.611390 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1f82b44a-d346-4d28-9615-4bc1cd09b060 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1318 microversion: 2.1 time: 0.162149 Sep 03 21:29:03.611987 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2844/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:03 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:04.245622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "name": "network-vif-plugged", "status": "completed", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:04.256663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:04.257186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:04.257632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:04.268828 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] Creating event network-vif-plugged:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch1-master-1 Sep 03 21:29:04.273580 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-1336b063-60b1-47a5-b45b-eecb16ef122f req-b936ee0d-6a52-46b9-855a-81890a6f1677 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 Sep 03 21:29:04.274337 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3075/5919] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:04.635307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:04.635851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:04.642712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:04.643200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:04.643649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:04.644349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:04.644811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:04.645270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:04.777031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:04.784832 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77361286-c952-44f7-92f9-4ed4d591a2f6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1318 microversion: 2.1 time: 0.153642 Sep 03 21:29:04.786101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2845/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:04 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:05.809634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:05.810317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:05.817111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:05.817617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:05.818058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:05.818806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:05.819356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:05.819742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:05.952357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:05.960796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24f6d425-482e-4a19-8946-dfa45fc2b5c3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1508 microversion: 2.1 time: 0.156579 Sep 03 21:29:05.961424 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3076/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:05 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:05.983492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:05.984121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:05.991919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:05.992424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:05.992877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:05.993609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:05.994076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:05.994515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.121863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:06.130042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c0c5dee-37ca-4e15-9ce1-c585f20c9113 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1508 microversion: 2.1 time: 0.150577 Sep 03 21:29:06.130621 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2846/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:05 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:06.152085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:06.154539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:06.161281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.161770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.162211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.162916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.163371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.163798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.226394 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ff699e7-020f-46aa-8104-189129d657c0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "PUT /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1080 microversion: 2.1 time: 0.078098 Sep 03 21:29:06.227038 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3077/5923] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Sep 3 21:29:06 2022] PUT /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:06.246929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:06.247553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:06.253689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.254260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.254711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.255426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.255893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.256331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.382960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:06.390802 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f83f5c9-7be9-42c4-8a4f-3e3c58d094e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1506 microversion: 2.1 time: 0.147869 Sep 03 21:29:06.391370 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2847/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:06 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:06.414014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:06.414640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:06.420712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.421273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.421724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.422429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.422894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.423331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.553426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:06.561112 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12bfa414-5281-4330-91b2-1ad3405da80e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1506 microversion: 2.1 time: 0.151614 Sep 03 21:29:06.561681 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3078/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:06 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:06.584022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:06.586383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:06.592381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.592874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.593392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.594101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.594566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.595004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.623410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:06.629713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:29:06.636138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:29:06.636568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:29:06.637088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:29:06.637509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:29:06.637928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:29:06.698989 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83db7c85-feaa-4350-83bc-a58ff1c7aa15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b/action" status: 202 len: 0 microversion: 2.1 time: 0.119516 Sep 03 21:29:06.699598 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2848/5926] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:29:06 2022] POST /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:29:06.708493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:06.709221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:06.716215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.716708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.717188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.717923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:06.718387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:06.718814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:06.852787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:06.861581 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4aebc06a-4e84-4674-ae9d-68e746e74816 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1517 microversion: 2.1 time: 0.157706 Sep 03 21:29:06.862396 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3079/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:06 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:07.883471 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:07.888078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:07.888776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:07.896828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:07.897358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:07.897805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:07.898518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:07.898982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:07.899419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:08.032162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:08.040105 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c0669e83-1487-4f76-874e-963deea700c2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1517 microversion: 2.1 time: 0.158486 Sep 03 21:29:08.040669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2849/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:07 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:09.063725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:09.064296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:09.066818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:09.067490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:09.074531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:09.075032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:09.075480 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:09.076188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:09.076653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:09.077123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:09.210165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:09.217921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53067127-7da4-4446-92b9-c16f86dcbcf4 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.158259 Sep 03 21:29:09.218500 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3080/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:09 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:10.241394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:10.242053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:10.249046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:10.249541 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:10.249989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:10.250691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:10.251186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:10.251620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:10.389387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:10.397725 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ce496eef-b66e-4c98-ae13-3e65278b5d47 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.160320 Sep 03 21:29:10.398297 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2850/5930] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:10 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:11.421810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:11.422354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:11.429995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:11.430481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:11.430928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:11.431631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:11.432088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:11.432522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:11.559573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:11.567327 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a14e072b-3039-4316-86b1-e1fe90baa530 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.149535 Sep 03 21:29:11.567897 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3081/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:11 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:12.591137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:12.591790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:12.594616 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=38 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:12.600602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:12.601094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:12.601544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:12.602250 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:12.602718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:12.603151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:12.730002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:12.738881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0c888da3-382c-4b3d-8dbd-7c172f81c514 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.151015 Sep 03 21:29:12.739453 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2851/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:12 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:13.762190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:13.762841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:13.765598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:13.771201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:13.771700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:13.772154 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:13.772874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:13.773383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:13.773824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:13.778857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:13.908653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:13.916478 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73f12606-d335-4adc-a3e0-79580ff31611 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.158296 Sep 03 21:29:13.917078 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3082/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:13 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:14.940741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:14.941903 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:14.948339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:14.948826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:14.949295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:14.949990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:14.950447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:14.950878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:15.078958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:15.087280 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-712776f9-ec91-452f-bebe-4626d8a9b33f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.150690 Sep 03 21:29:15.087860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2852/5934] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:14 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:16.110041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:16.110666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:16.117734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:16.118228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:16.118676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:16.119392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:16.119858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:16.120296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:16.254244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:16.262051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73ce23b3-ad36-4e8d-bc33-c0a8dbb4915e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.156228 Sep 03 21:29:16.262624 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3083/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:16 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:17.286456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:17.287107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:17.293799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:17.294299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:17.294749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:17.295456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:17.295920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:17.296364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:17.426943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:17.434890 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-78bcbb5a-1e0a-4589-af62-82c42843cd9c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.152889 Sep 03 21:29:17.435464 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2853/5936] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:17 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:18.458161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:18.458820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:18.466073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:18.466565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:18.467009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:18.467709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:18.468193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:18.468626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:18.603940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:18.611947 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5f9c043f-eb5f-4f24-96e2-c2683f4d5b02 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.157681 Sep 03 21:29:18.612510 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3084/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:18 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:19.636039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:19.636658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:19.643670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:19.644792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:19.645266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:19.645966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:19.646427 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:19.646860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:19.774058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:19.781882 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e600c91-fe55-4941-a6da-1d77c8694ebe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.149822 Sep 03 21:29:19.782447 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2854/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:19 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:20.805173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:20.805809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:20.812613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:20.813152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:20.813599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:20.814307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:20.814772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:20.815209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:20.942949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:20.950726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53404728-600b-43f2-8000-b8711700bcfe tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.149588 Sep 03 21:29:20.951294 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3085/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:20 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:21.975249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:21.975884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:21.983194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:21.983691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:21.984146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:21.985154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:21.985623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:21.986063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:22.120117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:22.128005 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6eb6bd0-7309-48fd-b03d-3650888b9cdd tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.157192 Sep 03 21:29:22.128832 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2855/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:21 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:23.150882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:23.151515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:23.158835 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:23.159323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:23.160254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:23.161003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:23.161460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:23.161888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:23.288002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:23.295709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-22215546-eebd-4555-bc79-fa51543d6283 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.149141 Sep 03 21:29:23.296271 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3086/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:23 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:29:24.320091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:24.320717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:24.327747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:24.329694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:24.330218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:24.330975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:24.331610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:24.332180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:24.469060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:24.476998 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-be13d548-c1d6-4afb-a6e9-660d729129d6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.161426 Sep 03 21:29:24.477887 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2856/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:24 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:25.504530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:25.505179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:25.512061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:25.512581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:25.513057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:25.513766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:25.514230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:25.514672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:25.648289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:25.656093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a39ee0f7-2dfe-4a2d-bc26-add44d97cf8f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.156034 Sep 03 21:29:25.656659 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3087/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:25 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:26.681142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:26.681773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:26.688748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:26.689276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:26.689728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:26.690443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:26.690909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:26.691350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:26.695449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:26.821822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:26.829584 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91d2d80a-76b3-49b1-857e-e78af15c7a76 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.152409 Sep 03 21:29:26.830160 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2857/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:26 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:27.854133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:27.854666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:27.861996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:27.862489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:27.863499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:27.864209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:27.864673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:27.865133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:27.992486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:28.000211 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50863682-824b-4554-9a1b-ef3c71c4b0a9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.150074 Sep 03 21:29:28.000779 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3088/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:27 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:29:29.023442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:29.024095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:29.031084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:29.031578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:29.032034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:29.032741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:29.033232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:29.033669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:29.166410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:29.175884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3f39da2-1488-4a4d-a6dc-316ac98b405a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.155532 Sep 03 21:29:29.176557 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2858/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:29 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:30.199277 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:30.199900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:30.207936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:30.208481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:30.208951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:30.209660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:30.210130 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:30.210590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:30.349005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:30.357604 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-59e7ba8c-3dc8-4a2d-91c6-67759cefde52 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.162208 Sep 03 21:29:30.358182 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3089/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:30 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:31.382432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:31.383107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:31.390241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:31.390679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:31.391127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:31.391834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:31.392300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:31.392734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:31.521170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:31.529147 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6a37ebd-ad0b-4123-ab7c-eabd7e67c408 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.151104 Sep 03 21:29:31.529722 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2859/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:31 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:32.552416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:32.553098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:32.560062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:32.560555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:32.561030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:32.561736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:32.562198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:32.562632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:32.690720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:32.698445 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7fe154d4-aa58-420f-83b2-1ac9597b3984 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.149934 Sep 03 21:29:32.699015 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3090/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:32 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:33.723009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:33.723634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:33.730200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:33.730674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:33.731119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:33.731826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:33.732316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:33.732778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:33.867369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:33.875140 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f7287193-e3b5-4138-9dc8-26d39deae5ab tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.156747 Sep 03 21:29:33.875707 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2860/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:33 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:34.898627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:34.899259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:34.906239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:34.906739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:34.907189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:34.907894 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:34.908360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:34.908797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:35.035400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:35.043232 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-067fb1d7-8beb-4c57-b5d7-6908cc29dca1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1522 microversion: 2.1 time: 0.148519 Sep 03 21:29:35.044159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3091/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:34 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:36.067880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:36.068698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:36.076242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:36.076748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:36.077390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:36.078114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:36.078613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:36.079081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:36.286981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:36.294792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2025656-6cd3-4757-8df3-9988266610b3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1521 microversion: 2.1 time: 0.231384 Sep 03 21:29:36.295371 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2861/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:36 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:36.380805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "name": "network-vif-unplugged", "status": "completed", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:36.393059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:36.393612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:36.394352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:36.407680 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Creating event network-vif-unplugged:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch2-master-1 Sep 03 21:29:36.413484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] Instance 7066d8b8-7132-4e4f-8103-46d54c58509b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:29:36.425284 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-81c6602e-e7c4-486f-b4a6-3e43a65b83a7 req-f86078ff-5262-4b28-aaad-b24ab9c43e1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048480 Sep 03 21:29:36.426094 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3092/5953] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:37.318161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:37.318783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:37.325700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:37.326189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:37.326635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:37.327338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:37.327796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:37.328231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:37.459754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:37.467604 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6de81b70-dc11-400f-81f2-94c1546fbe9b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1519 microversion: 2.1 time: 0.153380 Sep 03 21:29:37.468188 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2862/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:37 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:38.451895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:38.461981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:38.462462 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:38.462901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:38.474905 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Creating event network-changed:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch2-master-1 Sep 03 21:29:38.480091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] Instance 7066d8b8-7132-4e4f-8103-46d54c58509b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:29:38.490822 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-3ce35a9f-ed4f-4b48-a87d-d7445a0677fa req-327c8919-db48-44db-a5d8-7ed112bcbcd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043761 Sep 03 21:29:38.491407 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3093/5955] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:38.492145 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:38.492837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:38.499892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:38.500388 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:38.500831 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:38.501573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:38.502034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:38.502469 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:38.824707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:38.833624 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-adf646cc-0672-49af-bceb-637849d362ce tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1519 microversion: 2.1 time: 0.345328 Sep 03 21:29:38.834427 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2863/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:38 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:29:39.858992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:39.859967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:39.866282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:39.866805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:39.867250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:39.867980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:39.868444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:39.868879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:40.001992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:40.010303 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a293c29d-2801-46e8-b58e-e9aa84c89b1d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1516 microversion: 2.1 time: 0.156385 Sep 03 21:29:40.010879 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3094/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:39 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:40.032786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:40.033379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:40.040240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:40.040730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:40.041208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:40.041914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:40.042378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:40.042817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:40.101456 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7cb1e797-257b-4251-aa4b-107d72df54b7 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b/action" status: 204 len: 0 microversion: 2.1 time: 0.072426 Sep 03 21:29:40.102103 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2864/5958] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:29:40 2022] POST /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:29:40.110537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:40.111111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:40.117961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:40.118303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:40.118750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:40.119596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:40.120145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:40.120614 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:40.258679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:40.266912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-afbf185d-4a4d-4b8a-af80-eeec59c06ec9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1516 microversion: 2.1 time: 0.160618 Sep 03 21:29:40.267663 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3095/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:40 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:41.291674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:41.292397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:41.298664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:41.299164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:41.299631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:41.300739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:41.301239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:41.301701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:41.437012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:41.445401 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1a10509f-35b1-4671-bf77-24166ffc7fb1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1516 microversion: 2.1 time: 0.158906 Sep 03 21:29:41.445969 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2865/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:41 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:42.469021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:42.469680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:42.477176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:42.477668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:42.478114 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:42.478820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:42.479283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:42.479718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:42.616092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:42.623912 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e3b41359-eb5e-460a-aa04-736c2248d195 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1508 microversion: 2.1 time: 0.158842 Sep 03 21:29:42.624484 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3096/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:42 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:42.647436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:42.648064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:42.650944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=30 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:42.656315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:42.656815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:42.657296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:42.658006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:42.658475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:42.658913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:42.785905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:42.793753 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bccd5fc6-afea-45dc-a8d1-9b7980ba57fa tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1508 microversion: 2.1 time: 0.150842 Sep 03 21:29:42.794318 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2866/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:42 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:42.819790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-65f51632-ed98-4111-af18-39ef21e1f57f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'create', calling method: .version_select at 0x7fae6711b670>, body: {"keypair": {"name": "tempest-keypair-1181314722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg7AcGupsjp3B+vgUt/GyQ2VyFCCCjPmLbs+j5LMRXrjl1McmfTy91cZFRPwz6Hx3eglYxuRajKBtzsj6YjPnBEHmI+QEQiwtvEPEPD+S5m18iMSwwc4xwrCi4AYQRwbw=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:42.835908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-65f51632-ed98-4111-af18-39ef21e1f57f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for project 90775ee27e9d462aaf236e95d95d5512. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:29:42.841132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-65f51632-ed98-4111-af18-39ef21e1f57f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for user d4a6118a9f10425c9a95842105534ea0 and project 90775ee27e9d462aaf236e95d95d5512. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:29:42.866748 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-65f51632-ed98-4111-af18-39ef21e1f57f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051419 Sep 03 21:29:42.867352 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3097/5963] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:29:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:43.051262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "name": "network-vif-plugged", "status": "completed", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:43.061847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:43.062419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:43.063262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:43.077708 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] Creating event network-vif-plugged:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch2-master-1 Sep 03 21:29:43.083855 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-00d1cb3e-33d0-4e56-9f94-459e9f6e7602 req-45810104-450b-4b68-b073-3aacdb1c87ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037379 Sep 03 21:29:43.084564 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2867/5964] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:29:44.055399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:44.056588 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:44.058573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:44.065426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.065893 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.066345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.067062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.067536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.067977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.072552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=86 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:44.198875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:44.207250 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f8108a98-2432-414c-ae77-04591fdc4613 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 200 len: 1508 microversion: 2.1 time: 0.156621 Sep 03 21:29:44.207812 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3098/5965] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:44 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:44.230702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:44.231273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:44.237960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.238497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.239019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.239646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.240110 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.240547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.269904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:29:44.344505 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff3f39f0-efa7-41ce-aac9-8337c9cac05b tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 204 len: 0 microversion: 2.1 time: 0.118640 Sep 03 21:29:44.345334 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2868/5966] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:29:44 2022] DELETE /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:29:44.401563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1238053861", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "cb3a96ef-1f60-474f-8b8b-a7ee15195217"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:44.453981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] validate_networks() for [('cb3a96ef-1f60-474f-8b8b-a7ee15195217', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:29:44.827541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:29:44.827977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:29:44.828496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:29:44.828939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:29:44.829368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:29:44.838298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.838793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.839244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.839994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:44.840461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:44.840917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:44.858207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for project 90775ee27e9d462aaf236e95d95d5512. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:29:44.864390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Getting quotas for user d4a6118a9f10425c9a95842105534ea0 and project 90775ee27e9d462aaf236e95d95d5512. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:29:44.876787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:29:44.879119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:29:44.924513 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c40f3fad-9c72-44e6-9bdd-f4ea8e6a3528 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526666 Sep 03 21:29:44.925753 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3099/5967] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:29:44.937585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a08a33e6-6b0f-4141-bb9d-2c9d9a70c4fb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:44.938294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a08a33e6-6b0f-4141-bb9d-2c9d9a70c4fb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:44.996115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a08a33e6-6b0f-4141-bb9d-2c9d9a70c4fb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:45.003289 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a08a33e6-6b0f-4141-bb9d-2c9d9a70c4fb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1218 microversion: 2.1 time: 0.070025 Sep 03 21:29:45.004024 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2869/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:44 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:46.026906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:46.027531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:46.035091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:46.035786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:46.036232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:46.037133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:46.037602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:46.038186 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:46.135967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:46.154335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9efd6cf1-abb0-4a18-92e4-466cea5027b9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1270 microversion: 2.1 time: 0.132155 Sep 03 21:29:46.171106 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3100/5969] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:46 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:46.246014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7066d8b8-7132-4e4f-8103-46d54c58509b", "name": "network-vif-deleted", "tag": "7892e4ae-1f6c-45a7-a400-2a5ac306696d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:46.264735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:46.265899 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:46.266527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:46.281891 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] Creating event network-vif-deleted:7892e4ae-1f6c-45a7-a400-2a5ac306696d for instance 7066d8b8-7132-4e4f-8103-46d54c58509b on nch2-master-1 Sep 03 21:29:46.289744 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-42d60ec2-d82e-42f8-afd5-a56934d7b4b0 req-ac165f63-2b7d-4be3-a9f0-23646e3e8b90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048684 Sep 03 21:29:46.294004 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2870/5970] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:29:47.178785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:47.179411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:47.186474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:47.186971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:47.187408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:47.188115 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:47.188573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:47.189031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:47.417872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:47.425820 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d1b7768b-9eb0-4d56-bceb-b7af535688c8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.250993 Sep 03 21:29:47.426388 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3101/5971] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:47 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:47.601534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:47.611505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:47.611991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:47.612939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:47.623806 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] Creating event network-changed:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch2-master-1 Sep 03 21:29:47.629227 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-c3aa2935-fd74-4bbb-8ec0-f937c47d1239 req-143b8621-047c-4d35-9639-d52dc6825b75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102500 Sep 03 21:29:47.629823 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2871/5972] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:48.448862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:48.449510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:48.456467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:48.456986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:48.457440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:48.458155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:48.458618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:48.459052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:48.589640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:48.597901 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9a52b02-9639-4f69-a1ab-2e48a764b8cb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.153030 Sep 03 21:29:48.598468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3102/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:48 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:49.622175 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:49.622881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:49.629176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:49.629669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:49.630115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:49.630814 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:49.631280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:49.631718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:49.763913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:49.772247 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-47a159dd-5e1d-4ff6-b281-67c7d3fce65d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.155252 Sep 03 21:29:49.772810 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2872/5974] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:49 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:50.795758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:50.796371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:50.802912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:50.803397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:50.803839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:50.804545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:50.805027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:50.805461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:50.939127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:50.947387 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5e36983-8c04-40dd-80f7-675a73243f95 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.155671 Sep 03 21:29:50.947968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3103/5975] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:50 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:51.971184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:51.971965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:51.978996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:51.979487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:51.979930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:51.980625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:51.981127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:51.981560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:52.115033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:52.122880 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4ccda2c-5e16-4a8c-841f-3b31984a1016 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.155625 Sep 03 21:29:52.123460 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2873/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:51 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:53.053128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:53.063587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:53.064080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:53.064509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:53.080335 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] Creating event network-vif-plugged:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch2-master-1 Sep 03 21:29:53.086287 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b778e499-02d6-44c8-ba86-e6a95325aad6 req-3f8cf754-8d4d-4ba1-b704-ea2fbc11c285 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037397 Sep 03 21:29:53.086902 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3104/5977] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:29:53.147272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:53.148002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:53.155444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:53.155870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:53.156527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:53.157314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:53.157772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:53.158201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:53.162966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:53.291179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:53.298920 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4affe02-742e-4054-80e4-cd5e9df31902 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1318 microversion: 2.1 time: 0.156418 Sep 03 21:29:53.299497 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2874/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:53 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:54.322995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:54.323615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:54.329813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.330306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.330748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.331456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.332412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.332869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.465079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:54.473529 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-17848da0-cfd4-40e1-9f8b-30703f949b15 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1508 microversion: 2.1 time: 0.155773 Sep 03 21:29:54.474102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3105/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:54 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:54.496109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:54.496807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:54.503925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.504425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.504877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.505615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.506086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.506529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.635172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:54.642818 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac5c8f79-9a30-4ff8-a56e-badf5495929f tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1508 microversion: 2.1 time: 0.150693 Sep 03 21:29:54.643394 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2875/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:54 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:54.665946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:29:54.668304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:54.674446 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.674938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.675389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.676091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.676556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.677026 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.704821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:54.711181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:29:54.717548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:29:54.717988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:29:54.718474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:29:54.718891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:29:54.719311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:29:54.781567 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a0109ae-ac66-460b-92bb-b38654741ede tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6/action" status: 202 len: 0 microversion: 2.1 time: 0.119537 Sep 03 21:29:54.782183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3106/5981] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:29:54 2022] POST /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:29:54.790449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:54.791074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:54.797051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.797543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.797983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.798694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:54.799143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:54.799573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:54.963476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:54.971417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-79e352cb-e8b6-4fa0-8eb9-ebea6110b2b8 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1515 microversion: 2.1 time: 0.184861 Sep 03 21:29:54.972057 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2876/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:54 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:29:55.994915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:55.995540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:55.998238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:55.998908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:56.007622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:56.008118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:56.008572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:56.009314 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:56.009778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:56.010213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:56.226554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:56.234577 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7f64d3dc-48ab-4786-a84a-f4fa77e49ffc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1515 microversion: 2.1 time: 0.243306 Sep 03 21:29:56.235154 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3107/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:55 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:57.258713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:57.259339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:57.261263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:57.267408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:57.267904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:57.268356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:57.269594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:57.270061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:57.270497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:57.409003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:57.417384 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f5cefa7a-0f19-49ca-992d-7128e1cc9001 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.162634 Sep 03 21:29:57.417953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2877/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:57 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:58.440750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:58.441421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:58.448438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:58.448960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:58.449477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:58.450217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:58.450687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:58.451123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:58.583561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:58.591333 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-93c7dc60-c6bd-489e-8269-367ced181178 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.154518 Sep 03 21:29:58.591894 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3108/5985] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:58 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:29:59.615165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:29:59.615780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:29:59.622882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:59.623367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:59.623807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:59.624499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:29:59.624981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:29:59.625430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:29:59.751927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:29:59.760298 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-139a761e-e70e-46cd-b3fa-47197d857772 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.149576 Sep 03 21:29:59.760870 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2878/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:29:59 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:00.783674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:00.784330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:00.791806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:00.792304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:00.792748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:00.793525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:00.793986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:00.794420 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:00.922800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:00.931403 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f50d1c2a-fa07-4388-9fdc-0df7401ef182 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.151651 Sep 03 21:30:00.932115 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3109/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:00 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:01.955098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:01.955732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:01.962846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:01.963347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:01.963801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:01.964519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:01.965021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:01.965465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:02.092642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:02.100973 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24ff934b-0e86-4906-a882-902bb0c4d2e0 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.149812 Sep 03 21:30:02.101541 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2879/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:01 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:03.125128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:03.125746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:03.133276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:03.133770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:03.134216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:03.134922 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:03.135813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:03.135813 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:03.271646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:03.279323 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-252a5dc5-c4d2-4778-958d-2c40c5c65d56 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.158218 Sep 03 21:30:03.279910 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3110/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:03 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:04.302294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:04.302955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:04.305177 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:30:04.305321 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:30:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 (ip 10.222.0.16) !!! Sep 03 21:30:04.318683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:04.319176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:04.319623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:04.320340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:04.320800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:04.321261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:04.458217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:04.467757 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8165b7e5-88e5-45c7-9c4e-66b29ceafb0d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.169682 Sep 03 21:30:04.468108 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2880/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:04 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:05.492532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:05.493191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:05.499926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:05.500425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:05.500875 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:05.501607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:05.502074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:05.502512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:05.631947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:05.639675 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc3189f3-604a-4223-9f4c-8d970efb40e3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.151033 Sep 03 21:30:05.640252 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3111/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:05 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:06.662980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:06.663606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:06.670636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:06.671130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:06.671581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:06.672289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:06.672757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:06.673232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:06.803160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:06.811163 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bf125028-91e7-46fe-8136-60c24870c7ac tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.152148 Sep 03 21:30:06.811906 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2881/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:06 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:07.835452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:07.836001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:07.842994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:07.843482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:07.843926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:07.844623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:07.845112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:07.845545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:07.973286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:07.981050 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-aafd0b96-7674-4472-bc82-feb7810a01a3 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.149571 Sep 03 21:30:07.981678 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3112/5993] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:07 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:09.005190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:09.005819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:09.012809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:09.013335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:09.013782 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:09.014491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:09.014959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:09.015394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:09.151089 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:09.158830 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1e6fb175-e735-4999-918a-0d2bfec04d00 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.157624 Sep 03 21:30:09.159897 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2882/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:09 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:10.183298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:10.183924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:10.191617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:10.192107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:10.192565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:10.193324 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:10.193792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:10.195353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:10.325067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:10.332774 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb972cc6-c5cb-4885-b077-86cd999ab978 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.153474 Sep 03 21:30:10.333378 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3113/5995] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:10 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:11.356664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:11.357347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:11.365200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:11.365568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:11.366023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:11.366733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:11.367198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:11.367633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:11.498830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:11.506854 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48af63a3-a4b9-4ac0-88fe-74237daa8a37 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.154125 Sep 03 21:30:11.507431 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2883/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:11 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:12.530393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:12.531014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:12.538149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:12.538643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:12.539090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:12.539790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:12.540250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:12.540683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:12.667563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:12.669788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:12.677977 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7eed163f-272f-48a7-9ee5-18f1a8fe50a1 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.151461 Sep 03 21:30:12.678545 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3114/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:12 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:13.701378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:13.701998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:13.704391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:13.710293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:13.710772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:13.711210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:13.711904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:13.712363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:13.712793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:13.846691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:13.854465 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5923f9a7-150f-46e9-a778-d1ab6f9a9681 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.157259 Sep 03 21:30:13.855032 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2884/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:13 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:14.878747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:14.879317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:14.882069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:14.889188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:14.889680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:14.890129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:14.890832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:14.891288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:14.891719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:15.019410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:15.027111 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a497499d-e0d5-475a-a167-e2dc37c35da6 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.152726 Sep 03 21:30:15.027678 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3115/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:14 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:16.051019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:16.051647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:16.058593 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:16.059087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:16.059539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:16.060245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:16.060712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:16.061176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:16.191583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:16.199447 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d30b28ad-75da-4fc3-970d-9c0593760890 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.152451 Sep 03 21:30:16.200016 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2885/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:16 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:17.223921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:17.224524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:17.231430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:17.231918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:17.232362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:17.233119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:17.233580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:17.234014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:17.431942 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:17.439739 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-32baf3da-4528-43d8-95d5-5e01469569bf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.220254 Sep 03 21:30:17.440325 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3116/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:17 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:18.463611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:18.464267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:18.471305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:18.471797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:18.472242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:18.473571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:18.474040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:18.474505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:18.658605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:18.666875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9a0dc2cf-2154-4c2e-80b5-74e73bacc554 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.207253 Sep 03 21:30:18.667452 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2886/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:18 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:19.690814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:19.691433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:19.698939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:19.699427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:19.699869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:19.700566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:19.701056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:19.701487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:19.828610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:19.836849 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7fe1db0d-45e2-484f-8ea1-8d870cf1a700 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.149924 Sep 03 21:30:19.837438 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3117/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:19 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:20.861048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:20.861690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:20.869201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:20.869682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:20.870119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:20.870813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:20.871269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:20.871699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:21.004785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:21.012691 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e1b2290-f95c-4dda-b4ce-d12486c87b5a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.155787 Sep 03 21:30:21.013294 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2887/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:20 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:22.036286 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:22.036923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:22.043792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:22.044276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:22.044716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:22.045444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:22.045900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:22.046328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:22.179300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:22.187229 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7314a7bb-78ed-4ae5-9c4d-d6f174efe45c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.155055 Sep 03 21:30:22.187878 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3118/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:22 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:23.211378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:23.212002 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:23.219025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:23.219519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:23.219971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:23.220703 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:23.221199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:23.221639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:23.226141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=84 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:23.355307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:23.364219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbe2bd14-c392-4361-917d-3353334ed77d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1520 microversion: 2.1 time: 0.155990 Sep 03 21:30:23.364820 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2888/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:23 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:23.943176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "name": "network-vif-unplugged", "status": "completed", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:23.953925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:23.954416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:23.954869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:23.973815 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Creating event network-vif-unplugged:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch1-master-1 Sep 03 21:30:23.980763 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] Instance 19528466-80b1-4717-bef2-fb80ec2622e6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:30:23.992867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cb1818cf-59a6-421b-92cf-e50eff3ec104 req-1af75922-7a1d-497c-9c4b-46bc0ee4836a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054078 Sep 03 21:30:23.993666 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3119/6007] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:30:24.387803 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:24.388508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:24.395671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:24.396168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:24.396617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:24.397359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:24.397824 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:24.398261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:24.617738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:24.626194 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83ca8045-5089-419e-82a6-c9c10a6f391d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1519 microversion: 2.1 time: 0.242341 Sep 03 21:30:24.626782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2889/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:24 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:25.651548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:25.652276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:25.658503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:25.658991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:25.659433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:25.660632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:25.661133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:25.661565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:25.789814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:25.797729 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7111f275-3a80-4538-ae7b-f894048249b5 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1517 microversion: 2.1 time: 0.151270 Sep 03 21:30:25.798314 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3120/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:25 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:26.015887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:26.026696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:26.027185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:26.027628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:26.039799 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Creating event network-changed:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch1-master-1 Sep 03 21:30:26.045291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] Instance 19528466-80b1-4717-bef2-fb80ec2622e6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:30:26.059033 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-70828127-fef3-4388-ad27-45a41228f6ab req-46455e36-f4c0-4ec2-aede-eff186691a3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046291 Sep 03 21:30:26.059221 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2890/6010] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:30:26.821842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:26.822463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:26.829361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:26.829860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:26.830310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:26.831031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:26.831494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:26.832526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:26.973921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:26.983220 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-24408309-ef96-4056-8b69-8cdf0044dd4d tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1517 microversion: 2.1 time: 0.164639 Sep 03 21:30:26.983395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3121/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:26 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:28.007772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:28.008484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:28.014766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:28.015264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:28.015712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:28.016422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:28.016882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:28.017340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:28.146226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:28.154035 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3da82e52-452a-4fc2-97df-50e705eaa5eb tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1517 microversion: 2.1 time: 0.151375 Sep 03 21:30:28.154603 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2891/6012] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:28 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:29.179014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:29.179648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:29.186714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.187220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.187672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.188384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.188854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.189320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.317646 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:29.325651 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-36c1c02f-edce-4bdd-9c54-2f19adeb59db tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1514 microversion: 2.1 time: 0.151592 Sep 03 21:30:29.326231 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3122/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:29 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:29.349084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:29.349631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:29.356440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.356961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.357409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.358103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.358562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.358990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.416964 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff91dcda-5953-4118-9728-85278a3fb22a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "POST /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6/action" status: 204 len: 0 microversion: 2.1 time: 0.072004 Sep 03 21:30:29.417519 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2892/6014] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:30:29 2022] POST /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:30:29.427135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:29.427789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:29.434202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.434760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.435208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.435975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:29.436431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:29.436929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:29.679961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:29.687811 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4af438ee-9372-4b54-a701-fd1616bf3622 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1514 microversion: 2.1 time: 0.265908 Sep 03 21:30:29.688388 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3123/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:29 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:30.712294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:30.713418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:30.725069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:30.726047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:30.726499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:30.727777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:30.728448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:30.729084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:30.866268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:30.874124 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f27b911f-de72-4e83-80f6-82d078a22741 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1506 microversion: 2.1 time: 0.167019 Sep 03 21:30:30.874714 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2893/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:30 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:30.896315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:30.896970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:30.903850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:30.904335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:30.904773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:30.905499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:30.905954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:30.906381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.040096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:31.047804 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8bac17db-31c4-4451-a1f5-3166735ef1bc tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1506 microversion: 2.1 time: 0.155376 Sep 03 21:30:31.048371 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3124/6017] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:30 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:31.069925 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:31.070505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:31.076677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.077215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.077688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.078393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.078879 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.079311 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.209609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:31.217417 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-078479e8-02a2-433b-b230-807e4e96435a tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1506 microversion: 2.1 time: 0.151531 Sep 03 21:30:31.217999 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2894/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:31 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:31.240484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:31.241012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:31.246983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.247469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.247915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.248615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.249127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.249661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.274838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:30:31.350347 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-62a3d023-3f46-4728-a274-15a9dc3a6c78 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 204 len: 0 microversion: 2.1 time: 0.113353 Sep 03 21:30:31.350848 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3125/6019] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:30:31 2022] DELETE /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:30:31.364304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:31.364816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:31.370912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.371407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.371855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.372560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.373051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.373488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.402757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:30:31.448053 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.compute.api [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Instance is already in deleting state, ignoring this request Sep 03 21:30:31.448884 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-409ebb07-ac24-460f-bf41-913439d19bd2 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 204 len: 0 microversion: 2.1 time: 0.088527 Sep 03 21:30:31.449474 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2895/6020] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:30:31 2022] DELETE /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:30:31.458143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:31.458855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:31.464816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.465348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.465795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.466497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:31.466965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:31.467430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:31.596482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:31.605070 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a34282fd-d73b-4d3a-8019-b16e7b661eec tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1512 microversion: 2.1 time: 0.151149 Sep 03 21:30:31.605589 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3126/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:31 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:32.628479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:32.629203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:32.636241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:32.636613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:32.637099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:32.637993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:32.638120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:32.638647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:32.639019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:32.649136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:32.649625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:32.650064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:32.662725 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] Creating event network-vif-plugged:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch1-master-1 Sep 03 21:30:32.667992 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ffafa3c2-437f-4ca9-81ba-65835e01d838 req-31a3a863-98a2-4c44-ba69-abcb2df820e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Sep 03 21:30:32.668588 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3127/6022] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:30:32.781136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:32.789738 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-700adc55-2caf-494d-814d-17a58ce5288e tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1512 microversion: 2.1 time: 0.165238 Sep 03 21:30:32.790325 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2896/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:32 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:33.309361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19528466-80b1-4717-bef2-fb80ec2622e6", "name": "network-vif-deleted", "tag": "5d74f262-5717-4b10-8a3e-77292d4a7d15"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:33.322054 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:33.322574 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:33.323209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:33.335159 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] Creating event network-vif-deleted:5d74f262-5717-4b10-8a3e-77292d4a7d15 for instance 19528466-80b1-4717-bef2-fb80ec2622e6 on nch1-master-1 Sep 03 21:30:33.341710 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fe4d586c-ccc5-479d-82a5-817eb9401d5c req-213415af-dcb7-4b89-be6f-31d9a4e7a4d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036315 Sep 03 21:30:33.342825 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3128/6024] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:30:33.813048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:33.813701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:33.820634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:33.821158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:33.821634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:33.822345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:33.822807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:33.823243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:33.856509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:33.857028 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:33.857475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:33.857944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lazy-loading 'fault' on Instance uuid 19528466-80b1-4717-bef2-fb80ec2622e6 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:30:33.904227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a6118a9f10425c9a95842105534ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90775ee27e9d462aaf236e95d95d5512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:33.912662 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6fea2ff8-7185-44f5-89c3-16b92c5161d9 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 200 len: 1306 microversion: 2.1 time: 0.103691 Sep 03 21:30:33.913771 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2897/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:33 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:30:34.938263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:34.938970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 19528466-80b1-4717-bef2-fb80ec2622e6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:34.945824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:34.946312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:34.946756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:34.947458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:34.947917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:34.948350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:34.961750 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] HTTP exception thrown: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Request method failure captured: Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 HTTP/1.1 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8cYX3CVC4UDd1CZZjH8lEfaZxuY0A42r7JMJFIQhfi3zXWfN_Ny6xSBGRknIOQBmJDIG0FSHBf8gasfZo7J0ASfT9WQeuhblRoNb6_lGiJuK4YWnESBYAhq3sWrVi9Jw4gYVglAq4IeL8rReZGcBoOQZ-1ryB7Ew50ABXsyLHP5VWw Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d4a6118a9f10425c9a95842105534ea0 Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '19528466-80b1-4717-bef2-fb80ec2622e6'} Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:34.963344 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Returning 404 to user: Instance 19528466-80b1-4717-bef2-fb80ec2622e6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e439b73d-a189-4f8e-bd24-507b03b22d72 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6" status: 404 len: 111 microversion: 2.1 time: 0.031657 Sep 03 21:30:34.967450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3129/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:34 2022] GET /compute/v2.1/servers/19528466-80b1-4717-bef2-fb80ec2622e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:30:34.973574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb307332-3daa-404c-bd49-c43b3e764e0c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '.version_select at 0x7fae6b7d5d30>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:34.997387 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb307332-3daa-404c-bd49-c43b3e764e0c tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181314722" status: 202 len: 0 microversion: 2.1 time: 0.027683 Sep 03 21:30:34.997954 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2898/6027] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181314722 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:30:35.595721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:35.596228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:35.603062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:35.603549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:35.603989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:35.604682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:35.605168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:35.605600 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:35.619174 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] HTTP exception thrown: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Request method failure captured: Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b HTTP/1.1 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8cYX3CVC4UDd1CZZjH8lEfaZxuY0A42r7JMJFIQhfi3zXWfN_Ny6xSBGRknIOQBmJDIG0FSHBf8gasfZo7J0ASfT9WQeuhblRoNb6_lGiJuK4YWnESBYAhq3sWrVi9Jw4gYVglAq4IeL8rReZGcBoOQZ-1ryB7Ew50ABXsyLHP5VWw Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: d4a6118a9f10425c9a95842105534ea0 Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '7066d8b8-7132-4e4f-8103-46d54c58509b'} Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:30:35.620729 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Returning 404 to user: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2100226b-8d84-42fc-8efc-4c7d6f28bacf tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 404 len: 111 microversion: 2.1 time: 0.030301 Sep 03 21:30:35.623990 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3130/6028] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:30:35 2022] DELETE /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:30:35.630749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:35.631544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] [instance: 7066d8b8-7132-4e4f-8103-46d54c58509b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:35.638332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:35.638826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:35.639274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:35.639971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:35.640455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:35.640890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:35.654559 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] HTTP exception thrown: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Request method failure captured: Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b HTTP/1.1 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8cYX3CVC4UDd1CZZjH8lEfaZxuY0A42r7JMJFIQhfi3zXWfN_Ny6xSBGRknIOQBmJDIG0FSHBf8gasfZo7J0ASfT9WQeuhblRoNb6_lGiJuK4YWnESBYAhq3sWrVi9Jw4gYVglAq4IeL8rReZGcBoOQZ-1ryB7Ew50ABXsyLHP5VWw Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/90775ee27e9d462aaf236e95d95d5512"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 90775ee27e9d462aaf236e95d95d5512 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-203707329 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: d4a6118a9f10425c9a95842105534ea0 Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerDiskConfigTestJSON-203707329-project Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '7066d8b8-7132-4e4f-8103-46d54c58509b'} Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:30:35.656214 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] Returning 404 to user: Instance 7066d8b8-7132-4e4f-8103-46d54c58509b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-969e7ee5-dcf0-4b46-afc4-576670125e86 tempest-ServerDiskConfigTestJSON-203707329 tempest-ServerDiskConfigTestJSON-203707329-project] 10.222.0.16 "GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b" status: 404 len: 111 microversion: 2.1 time: 0.030885 Sep 03 21:30:35.661015 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2899/6029] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:35 2022] GET /compute/v2.1/servers/7066d8b8-7132-4e4f-8103-46d54c58509b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:30:43.981590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7ab0386b-57bb-4732-93dc-9e929635dc57 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'create', calling method: .version_select at 0x7fae6718f040>, body: {"keypair": {"name": "tempest-keypair-1725513400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ8NT+kGmnEpDdRi2CAhP89furceAlM71ccIq089BLRtpKU16fhVVWJkctk+XP9ZJRWBvgxu8l5B3vVIWmT/BtUdCa/FJ/TdZWNFHGnkzrvTYj1knZNqmlCV3b2LeDuCA=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:43.998222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7ab0386b-57bb-4732-93dc-9e929635dc57 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:30:44.003609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7ab0386b-57bb-4732-93dc-9e929635dc57 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:30:44.032314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7ab0386b-57bb-4732-93dc-9e929635dc57 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205316 Sep 03 21:30:44.032940 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3131/6030] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:30:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:30:45.335784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1168820827", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2863566-e394-4d19-b550-3669ef4769e6"}], "security_groups": [{"name": "tempest-securitygroup--243687592"}], "key_name": "tempest-keypair-1725513400", "user_data": "}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:45.345390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:45.446021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] validate_networks() for [('f2863566-e394-4d19-b550-3669ef4769e6', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:30:45.645876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:45.837106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:30:45.837875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:30:45.838360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:30:45.838780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:30:45.839347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:30:45.848590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:45.849115 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:45.849695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:45.850433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:45.851102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:45.851536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:45.870093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:30:45.875999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:30:45.889883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:30:45.892320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:30:45.942001 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c9906d24-fb93-439f-827c-18625e1fb1b5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.610648 Sep 03 21:30:45.948741 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2900/6031] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:30:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:30:45.954243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2f6758aa-1d52-4ea7-b922-359507a458dd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:45.954963 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2f6758aa-1d52-4ea7-b922-359507a458dd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:45.969427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:45.970350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:46.049046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2f6758aa-1d52-4ea7-b922-359507a458dd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:46.056936 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2f6758aa-1d52-4ea7-b922-359507a458dd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1239 microversion: 2.1 time: 0.106739 Sep 03 21:30:46.065992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3132/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:45 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:47.085384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:47.086949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:47.096769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:47.098623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:47.099413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:47.100406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:47.101121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:47.101771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:47.207360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:47.218870 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-661452af-624c-4004-8267-a49d8328ab2e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1299 microversion: 2.1 time: 0.142223 Sep 03 21:30:47.219459 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2901/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:47 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:48.243101 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:48.243735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:48.253562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:48.254121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:48.254583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:48.255304 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:48.255776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:48.256230 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:48.387108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:48.395455 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7366a353-8ae5-4642-917c-3ef14d356e47 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.155857 Sep 03 21:30:48.396029 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3133/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:48 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:48.592045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:48.604941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:48.605435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:48.605886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:48.618368 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] Creating event network-changed:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch1-master-1 Sep 03 21:30:48.623466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fc9284c1-4989-4777-ad95-b06ba6faa6a3 req-dfcc1204-3919-4a34-a9a3-75ffb8788a08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035353 Sep 03 21:30:48.624285 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2902/6035] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:30:49.419631 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:49.420878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:49.427895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:49.428391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:49.428839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:49.429572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:49.430038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:49.430476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:49.560057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:49.568363 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f9e90da0-3a19-4ffc-b54e-c2cc1b6dc230 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.152674 Sep 03 21:30:49.568989 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3134/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:49 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:50.593072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:50.593811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:50.600071 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:50.600567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:50.601042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:50.601747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:50.602214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:50.602677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:50.737085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:50.745440 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-40a893e6-b732-4643-b079-08fa2dedf0a0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.157593 Sep 03 21:30:50.746019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2903/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:50 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:51.769201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:51.770443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:51.777139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:51.777637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:51.778087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:51.778804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:51.779270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:51.779715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:51.919488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:51.927714 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bbc8a6d8-2501-4ada-9fcb-2ad6cbd8fd7a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.162719 Sep 03 21:30:51.928285 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3135/6038] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:51 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:52.951596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:52.952249 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:52.959652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:52.960139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:52.960579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:52.961305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:52.961763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:52.962195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:53.095540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:53.103560 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57af0b89-7dcb-42ab-83a0-3b8a48eab534 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.155933 Sep 03 21:30:53.104136 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2904/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:52 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:54.127548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:54.128067 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:54.135100 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:54.135572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:54.136020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:54.136726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:54.137215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:54.137645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:54.266991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:54.275484 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5bbd83ad-f136-4de2-a1c4-6db6d81a4c21 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.151947 Sep 03 21:30:54.276057 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3136/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:54 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:55.299301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:55.299989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:55.307573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:55.308077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:55.308533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:55.309276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:55.309746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:55.310184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:55.439454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:55.447220 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3c052f2-575b-4090-b5b4-350c17530276 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.151911 Sep 03 21:30:55.447800 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2905/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:55 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:56.471501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:56.472123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:56.475460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:56.480885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:56.481398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:56.481837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:56.482543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:56.483002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:56.483433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:56.619541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:56.627336 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-97aa6953-b28b-4c00-a598-071c532a99fa tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.159736 Sep 03 21:30:56.628402 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3137/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:56 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:56.718140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "name": "network-vif-plugged", "status": "completed", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:30:56.724948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:56.725751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:56.734524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:56.735013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:56.735463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:56.747199 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] Creating event network-vif-plugged:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch1-master-1 Sep 03 21:30:56.752570 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0fffeb0a-a58f-448f-8407-83001a34a87e req-18d53f85-adb3-4850-8752-c69f8cbe2b3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Sep 03 21:30:56.753389 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2906/6043] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:30:57.650177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:57.650796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:57.657657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:57.658145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:57.658587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:57.659284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:57.659750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:57.660672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:57.785679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:57.793384 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fc2cf257-54b4-4518-a6f9-83f343e1f07d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1364 microversion: 2.1 time: 0.147138 Sep 03 21:30:57.793946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3138/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:57 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:30:58.818765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:58.819470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:58.825718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:58.826202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:58.826644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:58.827336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:58.827804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:58.828222 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:58.962483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:30:58.970233 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f4ddcc98-684d-4745-9c39-12297b77e289 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1552 microversion: 2.1 time: 0.157315 Sep 03 21:30:58.970794 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2907/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:30:58 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:30:58.993321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:30:58.993861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:30:59.000791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:59.001345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:59.001796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:59.002504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:30:59.002970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:30:59.003410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:30:59.081428 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b718d1a5-ec5e-4582-8a53-d957f5ef9e91 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092129 Sep 03 21:30:59.082055 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3139/6046] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:30:58 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:31:00.007131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:31:00.017379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:31:00.017863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:31:00.018301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:31:00.029223 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] Creating event network-changed:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch1-master-1 Sep 03 21:31:00.034418 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5d4f58bb-4b69-4629-a7f9-ca8d83414404 req-0ddea7fa-6aa9-466d-87a4-beeda3131432 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030972 Sep 03 21:31:00.035577 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2908/6047] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:04.706639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=17 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:04.707405 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=40 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:04.713558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:04.714180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:04.720778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:04.721301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:04.721748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:04.722456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:04.722919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:04.723356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:04.854815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:04.862989 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4ccdd9dd-a94c-428c-8344-37bd60b63186 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.159324 Sep 03 21:32:04.863559 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3140/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:04 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:04.885318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:04.886443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=38 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:04.891530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:04.892239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:04.900313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:04.900807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:04.901283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:04.901989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:04.902454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:04.902892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.031401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:05.039858 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a50c71b5-9e9b-4fa3-8884-7a555aed1d37 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.157263 Sep 03 21:32:05.040426 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2909/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:04 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:05.062686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:05.063311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:05.069929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.070433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.070888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.071637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.072107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.072549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.206732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:05.214635 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0a4c1b6c-38e2-4551-b947-cfdded32e744 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.155813 Sep 03 21:32:05.215210 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3141/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:05 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:05.237929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:05.240802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:05.246812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.247306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.247752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.248456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.248927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.249366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.279752 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:05.285494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Old instance type m1.heat2, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:32:05.292374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:32:05.292797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:32:05.293294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:32:05.293709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:32:05.294122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:32:05.356570 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-948b7db4-4ed2-4646-96b4-3253a99b1d51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/action" status: 202 len: 0 microversion: 2.1 time: 0.122870 Sep 03 21:32:05.357420 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2910/6051] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:32:05 2022] POST /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:32:05.366940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:05.367565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:05.373844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.374474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.374928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.375650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:05.376119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:05.376560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:05.818857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:05.826847 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-889ef338-c029-47a7-a280-e8064d2ff372 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1680 microversion: 2.1 time: 0.465129 Sep 03 21:32:05.827411 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3142/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:05 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1680 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:06.853001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:06.853672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:06.859940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:06.860429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:06.860866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:06.861586 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:06.862052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:06.862484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:06.992415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:07.000241 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b746e6eb-ee0a-4ff9-af65-59cbaf222dac tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1680 microversion: 2.1 time: 0.152785 Sep 03 21:32:07.000831 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2911/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:06 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:08.025425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:08.026055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:08.033118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:08.033622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:08.034069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:08.034782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:08.035263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:08.035683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:08.168113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:08.176234 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1998e8e9-65cc-4df0-b608-e65e08a0a79d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1680 microversion: 2.1 time: 0.155331 Sep 03 21:32:08.176746 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3143/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:08 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:09.202442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:09.203207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:09.210697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:09.211199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:09.211652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:09.212363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:09.212828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:09.213294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:09.339230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:09.347018 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13ccbcc2-c8b6-474b-9c93-9e2c8dfbb235 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.148676 Sep 03 21:32:09.347599 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2912/6055] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:09 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:10.372143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:10.372807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:10.379731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:10.380228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:10.381627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:10.382347 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:10.382814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:10.383252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:10.518078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:10.525741 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f57c319c-f31b-4569-b5f1-f3b30613c86b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.157541 Sep 03 21:32:10.526308 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3144/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:10 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:11.549812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:11.550439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:11.557852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:11.558350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:11.558797 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:11.559502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:11.559965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:11.560399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:11.691472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:11.699973 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f229be57-9308-4847-a3a3-b2bf7fde781e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.154149 Sep 03 21:32:11.700553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2913/6057] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:11 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:12.723356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:12.724008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:12.730857 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:12.731354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:12.731793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:12.732499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:12.732990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:12.733425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:12.860336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:12.868600 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c21ea57b-dcdc-4ce2-a5c7-d03dbea99856 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.149151 Sep 03 21:32:12.869200 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3145/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:12 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:13.892716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:13.893359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:13.900528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:13.901060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:13.901503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:13.902199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:13.902657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:13.903087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:14.030964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:14.038724 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16045d24-3417-44e1-bf63-0074ead1da40 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.149952 Sep 03 21:32:14.039290 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2914/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:13 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:15.061934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:15.062561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:15.069619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:15.070106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:15.070551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:15.071252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:15.071712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:15.072140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:15.207385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:15.215763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-045ec9a0-4e15-4101-b80d-14bbf65423e7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.157747 Sep 03 21:32:15.216326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3146/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:15 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:16.239959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:16.240514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:16.247643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:16.248142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:16.248589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:16.249325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:16.249790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:16.250225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:16.384642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:16.392465 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-45962474-a7d2-4120-9b33-a53df46979d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.156515 Sep 03 21:32:16.393059 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2915/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:16 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:17.416594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:17.417247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:17.424268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:17.424766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:17.425260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:17.425976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:17.426443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:17.426882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:17.555166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:17.563029 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9861c657-e65e-4e59-8795-80a01708371c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.150371 Sep 03 21:32:17.563619 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3147/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:17 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:18.587035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:18.587689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:18.594662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:18.595157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:18.595602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:18.596309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:18.596801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:18.597264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:18.724983 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:18.732808 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9c4542d7-0c7d-46b8-9905-f0fe45e0876a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.149702 Sep 03 21:32:18.733404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2916/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:18 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:19.756714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:19.757366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:19.764234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:19.764717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:19.765202 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:19.765896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:19.766356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:19.766784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:19.899004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:19.906764 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3e920538-784e-46c7-8977-e2b2c35a0885 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1685 microversion: 2.1 time: 0.154019 Sep 03 21:32:19.907340 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3148/6064] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:19 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:20.931777 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:20.932408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:20.939581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:20.940076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:20.940523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:20.941267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:20.941734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:20.942199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:21.077704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "name": "network-vif-unplugged", "status": "completed", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:21.079052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:21.088995 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a2a2315a-6fdd-43c6-823b-3531e3121ef6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1684 microversion: 2.1 time: 0.161640 Sep 03 21:32:21.089350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:21.089768 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2917/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:20 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:21.089886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:21.090260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:21.104484 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Creating event network-vif-unplugged:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch2-master-1 Sep 03 21:32:21.110283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] Instance 1045be5b-cdc5-480a-ae94-0050656e506c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:32:21.124621 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-16dae6a0-4ce8-40f2-bb51-4d85b4996ede req-605045ae-3d94-4c9c-8431-77220179bc9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050545 Sep 03 21:32:21.125348 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3149/6066] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:22.114042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:22.115132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:22.121960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:22.122453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:22.122896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:22.123605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:22.124062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:22.124494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:22.254841 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:22.262949 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-49dc1cde-d17f-45f2-9266-18301f98ea4f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1682 microversion: 2.1 time: 0.152949 Sep 03 21:32:22.263534 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2918/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:22 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:23.161576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:23.171375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:23.171863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:23.172307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:23.185184 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Creating event network-changed:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch2-master-1 Sep 03 21:32:23.190553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] Instance 1045be5b-cdc5-480a-ae94-0050656e506c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:32:23.201483 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-87285e12-0057-4f73-93af-dffdeb90fa6e req-01413cc7-8f35-4ef5-97c0-6781e9f1b4e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 Sep 03 21:32:23.202142 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3150/6068] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:23.286822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:23.288438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:23.295544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:23.296269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:23.296716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:23.297463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:23.298094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:23.298682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:23.529164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:23.537113 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2385f928-0f53-422c-b6e6-98cfa054b7fc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1682 microversion: 2.1 time: 0.254120 Sep 03 21:32:23.537690 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2919/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:23 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:24.563099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:24.563804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:24.570119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.570619 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.571061 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.571760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.572218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.572648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.705248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:24.712979 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-53dc40ab-3612-4d71-a605-13c8b865404d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1679 microversion: 2.1 time: 0.154968 Sep 03 21:32:24.713554 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3151/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:24 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:24.736965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:24.737508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:24.744908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.745415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.745865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.746567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.747024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.747452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.804761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c4c7ca01-f3a5-459a-acf3-803a1f578359 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/action" status: 204 len: 0 microversion: 2.1 time: 0.071720 Sep 03 21:32:24.805449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2920/6071] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:32:24 2022] POST /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:32:24.813849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:24.814436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:24.821079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.821589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.822042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.822769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:24.823413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:24.823854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:24.966197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:24.973991 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-73cdf16a-bc3a-44cb-a9ea-6d61b36840bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1679 microversion: 2.1 time: 0.164248 Sep 03 21:32:24.975128 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3152/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:24 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:25.999895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:26.000642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:26.007000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:26.007528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:26.007978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:26.008685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:26.009192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:26.009627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:26.149372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:26.157409 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6f075d4-9d66-43d3-9bd5-bf0960f03c74 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1679 microversion: 2.1 time: 0.162620 Sep 03 21:32:26.158012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2921/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:25 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:27.182009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:27.182595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:27.189663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.190152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.190602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.191504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.191839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.192272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.324087 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:27.331871 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4c1d5f67-f2f1-42ef-9cbd-56d4f88fc78a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.153877 Sep 03 21:32:27.332438 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3153/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:27 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:27.355836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:27.356464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:27.363759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.364259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.364710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.365443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.365911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.366346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.492279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:27.500283 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6c9d5e38-31f2-4da6-bc10-c222b058cd39 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.148291 Sep 03 21:32:27.500847 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2922/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:27 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:27.523584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:27.524201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:27.530227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.530716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.531160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.531881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.532343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.532772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.658121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:27.665882 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c5641f01-50f2-4767-886a-2763763a709a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1671 microversion: 2.1 time: 0.146749 Sep 03 21:32:27.666452 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3154/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:27 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:27.688329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:27.688835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:27.695700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.696130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.696575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.697313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.697776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.698204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.702667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:27.726452 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:32:27.803507 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6680665c-9801-4c82-b078-d04aa03a4d69 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 204 len: 0 microversion: 2.1 time: 0.118382 Sep 03 21:32:27.804102 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2923/6077] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:32:27 2022] DELETE /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:32:27.812525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:27.813171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:27.819670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.820158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.820601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.821336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.821793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.822226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.930974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "name": "network-vif-plugged", "status": "completed", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:27.941476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:27.942379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:27.942894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:27.955696 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] Creating event network-vif-plugged:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch2-master-1 Sep 03 21:32:27.960548 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-dc211db8-8e61-4193-a4ad-bb92f8d8dfa0 req-547ecee7-4e4f-4110-9497-b0fb41eb9531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120823 Sep 03 21:32:27.961182 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2924/6078] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:32:27.972428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:27.980252 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8cebe1e0-7fd4-464d-ace7-7b6dab4f29dc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1677 microversion: 2.1 time: 0.171738 Sep 03 21:32:27.980824 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3155/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:27 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:29.006938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:29.007674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:29.014334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:29.014839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:29.015294 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:29.016065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:29.016483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:29.016945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:29.146906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:29.154674 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d1f1811e-f969-472b-b633-1fc2653ea714 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1677 microversion: 2.1 time: 0.153521 Sep 03 21:32:29.155457 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2925/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:28 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:32:30.047147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1045be5b-cdc5-480a-ae94-0050656e506c", "name": "network-vif-deleted", "tag": "87ee268c-58af-4fa3-99ab-32f1336bb08a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:30.064117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:30.064887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:30.065504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:30.079187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] Creating event network-vif-deleted:87ee268c-58af-4fa3-99ab-32f1336bb08a for instance 1045be5b-cdc5-480a-ae94-0050656e506c on nch2-master-1 Sep 03 21:32:30.086470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8623ad72-3e2d-4ae2-8f27-4f5d83d2ac88 req-91f67423-6fed-46b5-961f-c28bef71911e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043486 Sep 03 21:32:30.087085 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3156/6081] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:30.178155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:30.178778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:30.185835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:30.186331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:30.186779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:30.187487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:30.188112 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:30.188546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:30.221914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:30.222404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:30.222843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:30.223589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lazy-loading 'fault' on Instance uuid 1045be5b-cdc5-480a-ae94-0050656e506c {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:32:30.281536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:30.292227 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-de088907-76a6-4fee-9373-b5b2d37cecd4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 200 len: 1329 microversion: 2.1 time: 0.117839 Sep 03 21:32:30.293003 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2926/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:30 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 1329 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:31.316285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:31.316931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:31.324570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.325098 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.325543 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.326239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.326696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.327126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.340972 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c HTTP/1.1 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1045be5b-cdc5-480a-ae94-0050656e506c'} Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:32:31.342607 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cd98d6ca-cace-43a3-8437-8577970b2e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 404 len: 111 microversion: 2.1 time: 0.032069 Sep 03 21:32:31.346879 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3157/6083] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:31 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:32:31.356701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:31.357357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:31.364465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.364988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.365432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.366134 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.366596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.367031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.380218 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c HTTP/1.1 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '1045be5b-cdc5-480a-ae94-0050656e506c'} Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:32:31.382396 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-499e5be1-b034-4b66-a4c1-b5c00ac1edf1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 404 len: 111 microversion: 2.1 time: 0.030927 Sep 03 21:32:31.390019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2927/6084] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:31 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:32:31.432397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-439421457", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "f2863566-e394-4d19-b550-3669ef4769e6"}], "security_groups": [{"name": "tempest-securitygroup--243687592"}], "key_name": "tempest-keypair-1725513400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:31.536466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] validate_networks() for [('f2863566-e394-4d19-b550-3669ef4769e6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:32:31.911634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:32:31.912062 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:32:31.912597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:32:31.913042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:32:31.913458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:32:31.922424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.922910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.923357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.924089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:31.924547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:31.925005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:31.942123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:32:31.948168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:32:31.960601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:32:31.962949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:32:32.009895 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf1ee654-c3ec-4602-8575-b36f690cafbb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.581325 Sep 03 21:32:32.010606 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3158/6085] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:32:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:32:32.021865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8c955a1a-2dc7-4906-9738-428617c2ffd3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:32.022484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8c955a1a-2dc7-4906-9738-428617c2ffd3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:32.080722 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8c955a1a-2dc7-4906-9738-428617c2ffd3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:32.089337 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8c955a1a-2dc7-4906-9738-428617c2ffd3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1238 microversion: 2.1 time: 0.071235 Sep 03 21:32:32.089947 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2928/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:32 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:33.115018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:33.116333 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:33.126550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:33.127076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:33.127508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:33.128240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:33.128714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:33.129187 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:33.133625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=100 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:33.192268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:33.200169 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07ee5df0-41e3-44ec-87f1-f3226dd1a808 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1308 microversion: 2.1 time: 0.090024 Sep 03 21:32:33.200737 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3159/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:33 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:34.226694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:34.227481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:34.238885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:34.239448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:34.240549 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:34.241297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:34.241905 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:34.242440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:34.452753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:34.460707 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-784cca8c-5468-4a51-b2f7-546a443a0db8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.239911 Sep 03 21:32:34.461306 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2929/6088] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:34 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:34.690831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:34.700349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:34.700843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:34.701312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:34.712848 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] Creating event network-changed:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch1-master-1 Sep 03 21:32:34.718219 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-656878ec-b349-49a9-b94b-c58f858d9875 req-3c61c20e-4b92-413c-a526-3e92aba825e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098465 Sep 03 21:32:34.718817 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3160/6089] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:32:35.485613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:35.486267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:35.489105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:35.494857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:35.495332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:35.495781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:35.496480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:35.496994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:35.497430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:35.631559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:35.639219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3866af8d-93b1-45db-93fd-dfae34c6fb24 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.157898 Sep 03 21:32:35.639788 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2930/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:35 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:36.664579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:36.665305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:36.667238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:36.673216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:36.673703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:36.674145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:36.674838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:36.675292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:36.675717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:36.808625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:36.816308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b1d00ece-6fbb-4382-9f8c-250dabe358a4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.157350 Sep 03 21:32:36.816875 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3161/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:36 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:37.839732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:37.840381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:37.847637 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:37.848131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:37.848577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:37.849309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:37.849774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:37.850207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:37.982515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:37.991239 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22e29e8e-56f2-4312-a867-742923f116fe tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.155431 Sep 03 21:32:37.991818 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2931/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:37 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:39.014972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:39.015595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:39.023253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:39.023747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:39.024196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:39.025010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:39.025401 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:39.025836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:39.156050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:39.164075 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b62bee6b-cabc-4a4f-a8a7-d87119b28cdb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.153104 Sep 03 21:32:39.169267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3162/6093] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:39 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:40.189713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:40.190338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:40.197793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:40.198286 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:40.198755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:40.199450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:40.199912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:40.200349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:40.332885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:40.341332 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1da1b59-055b-4fd0-9c7a-d9d55fc87e02 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.156265 Sep 03 21:32:40.341907 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2932/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:40 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:41.267034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "name": "network-vif-plugged", "status": "completed", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:41.279572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:41.280092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:41.280538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:41.292089 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] Creating event network-vif-plugged:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch1-master-1 Sep 03 21:32:41.297135 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-721a6145-eae3-48ba-9c63-03226012f47a req-4a91eebb-ec4f-4965-a0e6-dae0342c0e68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Sep 03 21:32:41.297703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3163/6095] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:41.365884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:41.367081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:41.374581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:41.375083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:41.375537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:41.376255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:41.376717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:41.377180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:41.553858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:41.561544 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a57c3058-b2f3-444b-b07c-957ce54fb66b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.200428 Sep 03 21:32:41.562116 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2933/6096] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:41 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:42.587088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:42.587791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:42.589786 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:42.590540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:42.597490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:42.597984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:42.598425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:42.599127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:42.599583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:42.600014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:42.735024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:42.742924 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2e33949e-75dd-41b0-a93e-d6f817a4745c tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1363 microversion: 2.1 time: 0.160753 Sep 03 21:32:42.743506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3164/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:42 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:43.767031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:43.767658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:43.769584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:43.776104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:43.776607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:43.777092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:43.777807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:43.778280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:43.778725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:43.906812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:32:43.916243 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20a89028-1317-4c70-bafe-e0bb4527b82b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1551 microversion: 2.1 time: 0.153307 Sep 03 21:32:43.916822 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2934/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:32:43 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:32:43.939465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:32:43.939980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:32:43.947599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:43.948085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:43.948525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:43.949255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:43.949715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:43.950145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:44.030506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-749dfa7b-fb71-4050-8f47-cbedf8841c79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094889 Sep 03 21:32:44.031104 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3165/6099] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:32:43 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:32:44.941051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:32:44.952466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:32:44.953082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:32:44.953532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:32:44.968979 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] Creating event network-changed:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch1-master-1 Sep 03 21:32:44.973987 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-681f51f9-3b08-4b85-9bc0-313aa1a88a5d req-97658c7e-d074-46b0-b019-0f290f9906ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036724 Sep 03 21:32:44.975133 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2935/6100] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:33:48.326713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:48.327404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=30 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:48.328226 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:33:48.328365 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action (ip 10.222.0.16) !!! Sep 03 21:33:48.334904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:33:48.343025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:48.343521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:48.343967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:48.366807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:33:48.407729 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-74aef34f-0c82-4a15-ad22-10f8d275b5b1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action" status: 202 len: 0 microversion: 2.1 time: 0.083266 Sep 03 21:33:48.408330 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3166/6101] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:33:48 2022] POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:33:48.416518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=11 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:48.417389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:48.418950 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:33:48.419119 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 (ip 10.222.0.16) !!! Sep 03 21:33:48.425180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:48.426530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:48.440148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:48.440639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:48.441122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:48.441833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:48.442289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:48.442718 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:48.574784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:48.582607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-576946c8-9d12-4fa4-ad0f-3af342b8bf05 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.169442 Sep 03 21:33:48.583109 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2936/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:48 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:49.608448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:49.609549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:49.615781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:49.616271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:49.616719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:49.617457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:49.617927 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:49.618390 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:49.747295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:49.755082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9712ac31-2b4d-4720-80e7-17ef8884c031 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.152531 Sep 03 21:33:49.755660 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3167/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:49 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:50.780526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:50.781186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:50.788148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:50.788644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:50.789129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:50.789836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:50.790306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:50.790746 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:51.224213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:51.232047 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8a091b8d-c378-4d8c-a67f-f486e381546f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.455563 Sep 03 21:33:51.232606 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2937/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:50 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:52.256427 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:52.257077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:52.263974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:52.264461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:52.264923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:52.265625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:52.266083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:52.266515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:52.397057 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:52.405779 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-30da7ee7-ebb6-44bb-8241-cd14e95c1521 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.153474 Sep 03 21:33:52.406344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3168/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:52 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:53.429554 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:53.430181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:53.437678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:53.438177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:53.438634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:53.439340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:53.439806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:53.440246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:53.568615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:53.576926 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a95ee4c-dd92-4f2d-99aa-1c692eccbe51 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.151353 Sep 03 21:33:53.577517 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2938/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:53 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:54.601088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:54.601711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:54.608570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:54.609499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:54.609979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:54.610681 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:54.611143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:54.611577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:54.737751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:54.746082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-02e9bbec-0146-4e10-b631-16f00acd0869 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.148920 Sep 03 21:33:54.746701 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3169/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:54 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:55.769739 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:55.770400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:55.777839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:55.778336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:55.778788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:55.779523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:55.779993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:55.780433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:55.909566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:55.917360 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e68cc0b-c573-4673-b7b4-a6caff3c8da4 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.151489 Sep 03 21:33:55.917933 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2939/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:55 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:56.940745 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:56.941412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:56.948941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:56.949413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:56.949849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:56.950542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:56.951000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:56.951430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:57.082073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:57.089943 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf48e24e-736b-4ef5-a8d3-244f3d79fd96 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.153116 Sep 03 21:33:57.090518 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3170/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:56 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:58.113272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:58.113887 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:58.121726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:58.122233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:58.122685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:58.123408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:58.124005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:58.124539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:58.259051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:58.267343 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41b5fcc6-b6fe-4dec-925d-c137bd9bcc22 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.158360 Sep 03 21:33:58.267916 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2940/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:58 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:59.291526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:59.292744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:59.299789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.300274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.300717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.301442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.301898 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.302326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.432241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:59.440007 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ea5f7c3b-e0e6-4e28-857b-a5bb1196c116 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1657 microversion: 2.1 time: 0.152405 Sep 03 21:33:59.440582 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3171/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:59 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:33:59.464465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:33:59.466851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:59.473860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.474350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.474796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.475504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.475968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.476403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.507773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:59.514083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Old instance type m1.heat2, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:33:59.520582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:33:59.521043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:33:59.521525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:33:59.521940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:33:59.522357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:33:59.586474 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dd98f647-6301-49e4-aa13-a1c19239aec5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action" status: 202 len: 0 microversion: 2.1 time: 0.126420 Sep 03 21:33:59.587381 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2941/6112] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:33:59 2022] POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:33:59.595829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:33:59.596476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:33:59.602755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.603256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.603703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.604510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:33:59.605127 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:33:59.605566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:33:59.736993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:33:59.745441 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ce0b0ac-e557-4957-a60a-0e9a76668125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.153368 Sep 03 21:33:59.746368 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3172/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:33:59 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:00.770228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:00.771468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:00.778118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:00.778628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:00.779124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:00.779806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:00.780325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:00.780756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:01.005205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:01.013635 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-44b73b62-33c9-43cb-a8df-305abc0d2f85 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1680 microversion: 2.1 time: 0.248127 Sep 03 21:34:01.014206 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2942/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:00 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:02.037983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:02.038637 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:02.045503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:02.045990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:02.046431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:02.047138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:02.047599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:02.048031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:02.186048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:02.194408 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca8af605-b5d0-4a9f-b251-184494d8efc1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1685 microversion: 2.1 time: 0.160296 Sep 03 21:34:02.194979 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3173/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:02 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:03.219296 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:03.219919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:03.226433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:03.226926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:03.227375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:03.228081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:03.228547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:03.229018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:03.356883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:03.364980 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6472366a-49d0-41cf-b19c-f888bf9beb82 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1685 microversion: 2.1 time: 0.149837 Sep 03 21:34:03.365549 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2943/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:03 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:04.387850 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:04.388449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:04.395435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:04.395939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:04.396396 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:04.397141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:04.397612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:04.398053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:04.429337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "name": "network-vif-unplugged", "status": "completed", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:04.440367 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:04.440859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:04.441330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:04.453859 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Creating event network-vif-unplugged:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch2-master-1 Sep 03 21:34:04.459566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:34:04.471473 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6eb60921-be78-4399-a417-b3f6fa9188f1 req-397fcb99-f338-487e-a2ff-afefaa7e3cd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046597 Sep 03 21:34:04.472097 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2944/6117] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:34:04.647756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:04.656119 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-83c02dd2-2221-42f6-bf20-09fc16abfd8d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1684 microversion: 2.1 time: 0.272351 Sep 03 21:34:04.656694 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3174/6118] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:04 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1684 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:05.682895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:05.683631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:05.690045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:05.690545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:05.690993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:05.691699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:05.692162 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:05.692602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:05.821166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:05.828992 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0fcf5d02-d1a5-4a31-b32f-88068a648d07 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1682 microversion: 2.1 time: 0.151795 Sep 03 21:34:05.829561 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2945/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:05 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:06.491671 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:06.501780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:06.502336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:06.502728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:06.515318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Creating event network-changed:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch2-master-1 Sep 03 21:34:06.520700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:34:06.531794 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7055a156-f476-4ffa-9d29-53f76c8064cc req-46cfaef4-04bb-4adf-8d85-4463f5687587 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043848 Sep 03 21:34:06.532725 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3175/6120] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:34:06.852961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:06.853723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:06.861418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:06.861921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:06.862540 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:06.863780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:06.864288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:06.864731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:07.078792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:07.087538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-129df2ac-0476-4d08-8139-a7881798e6f0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1678 microversion: 2.1 time: 0.238569 Sep 03 21:34:07.088119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2946/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:06 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:07.111664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:07.112299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:07.121461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:07.121461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:07.121461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:07.121461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:07.121461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:07.121908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:07.180638 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4fb171b5-6580-4338-8538-42be551dfd2f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action" status: 204 len: 0 microversion: 2.1 time: 0.073315 Sep 03 21:34:07.181354 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3176/6122] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:34:07 2022] POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:34:07.192564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:07.193304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:07.201165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:07.201733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:07.202242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:07.203121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:07.203671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:07.204137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:07.420796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:07.428646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d0cab1c4-8320-4ee8-b937-49a141215585 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1678 microversion: 2.1 time: 0.242269 Sep 03 21:34:07.429245 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2947/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:07 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:08.455597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:08.457180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:08.467221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.467759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.468215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.469235 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.469890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.470676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.624294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:08.633902 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-075dd86f-98b8-4256-a0ec-7937f130ece8 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1657 microversion: 2.1 time: 0.184528 Sep 03 21:34:08.634709 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3177/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:08 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1657 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:08.658167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:08.658816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:08.666921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.667424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.667873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.668582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.669638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.670086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.804021 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:08.812549 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa6f3c98-35c5-4f40-a295-218e1de6b3f7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1657 microversion: 2.1 time: 0.158792 Sep 03 21:34:08.813150 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2948/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:08 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:08.835024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:08.841162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.841660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.842108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.866051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Going to try to start instance {{(pid=140520) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 21:34:08.907510 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92c10464-acf4-4ef7-ad22-f696f6334c11 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action" status: 202 len: 0 microversion: 2.1 time: 0.076100 Sep 03 21:34:08.908187 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3178/6126] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:34:08 2022] POST /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:34:08.917216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:08.917894 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:08.924212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.924705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.925179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:08.926432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:08.927192 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:08.927651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:09.066106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:09.074313 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3eac5a1f-4bca-44d7-9158-9d74125df012 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1666 microversion: 2.1 time: 0.161541 Sep 03 21:34:09.074893 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2949/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:08 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:10.099824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:10.100567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:10.107297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.107795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.108239 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.109211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.109683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.110118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.244494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:10.247615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:10.255418 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82331639-03de-4487-8ee1-b95bdb683e99 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1670 microversion: 2.1 time: 0.160746 Sep 03 21:34:10.256216 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3179/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:10 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:10.279906 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:10.280480 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:10.287307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.287890 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.288395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.289200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.289735 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.290270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.318016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:34:10.345000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:10.397693 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5d3a8e27-ece6-4f48-8359-7598b5f64023 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 204 len: 0 microversion: 2.1 time: 0.121449 Sep 03 21:34:10.398673 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2950/6129] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:34:10 2022] DELETE /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:34:10.410491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:10.411134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:10.414565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "name": "network-vif-plugged", "status": "completed", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:10.419598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.420111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.420843 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.421701 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.422215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.422711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.425863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:10.426078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:10.426531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:10.438231 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] Creating event network-vif-plugged:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch2-master-1 Sep 03 21:34:10.443268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-80f5804a-8979-446e-97dc-9eff4bbc8df6 req-9644531c-a62e-4d24-8790-e49ff7e6a624 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Sep 03 21:34:10.444014 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2951/6130] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:34:10.561965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:10.569769 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9099b495-fa89-464f-bb04-11e698aa77f3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1676 microversion: 2.1 time: 0.166003 Sep 03 21:34:10.570329 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3180/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:10 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:34:11.597118 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:11.597820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:11.604281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:11.604788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:11.605255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:11.605960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:11.606422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:11.606853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:11.739132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:11.749556 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d10ea959-210c-408b-82d2-31ae4b44076e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1676 microversion: 2.1 time: 0.157102 Sep 03 21:34:11.750149 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2952/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:11 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:34:12.774040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:12.777491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:12.793717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:12.794225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:12.794662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:12.797279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:12.797829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:12.799281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:12.807177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b02329-6cc3-4a15-a246-ad5464cd3028", "name": "network-vif-deleted", "tag": "ed272813-34b3-441c-8837-c51cd62a47d8"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:12.828740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:12.829386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:12.830085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:12.844452 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] Creating event network-vif-deleted:ed272813-34b3-441c-8837-c51cd62a47d8 for instance c1b02329-6cc3-4a15-a246-ad5464cd3028 on nch2-master-1 Sep 03 21:34:12.849897 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9877ef37-9ad8-473d-aeff-c72260e12d0c req-f2dd1500-bb7a-47b3-a54e-496a20ffc4c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046515 Sep 03 21:34:12.850586 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2953/6133] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:34:12.894448 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:12.904003 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-07d3cae3-5f08-46c2-acce-6f648899671e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 200 len: 1609 microversion: 2.1 time: 0.133963 Sep 03 21:34:12.905357 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3181/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:12 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 1609 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:13.930361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:13.931088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:13.937938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:13.938426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:13.938871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:13.939575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:13.940037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:13.940466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:13.953538 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 HTTP/1.1 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c1b02329-6cc3-4a15-a246-ad5464cd3028'} Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:34:13.955176 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-142dfb2a-3b98-4db8-ac5e-50be4486a316 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 404 len: 111 microversion: 2.1 time: 0.031420 Sep 03 21:34:13.961957 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2954/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:13 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:34:13.971964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:13.972582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:13.979897 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:13.980382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:13.980826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:13.981576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:13.982033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:13.982461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:13.997171 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 HTTP/1.1 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c1b02329-6cc3-4a15-a246-ad5464cd3028'} Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:34:13.998855 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-638408de-162f-4d87-ae34-dceed1d0ff84 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 404 len: 111 microversion: 2.1 time: 0.032330 Sep 03 21:34:14.002996 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3182/6136] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:13 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:34:14.060947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-804332520", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "f2863566-e394-4d19-b550-3669ef4769e6"}], "security_groups": [{"name": "tempest-securitygroup--243687592"}], "key_name": "tempest-keypair-1725513400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:14.173196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] validate_networks() for [('f2863566-e394-4d19-b550-3669ef4769e6', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:34:14.600339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:34:14.600772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:34:14.601291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:34:14.601707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:34:14.602131 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:34:14.611425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:14.611911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:14.612353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:14.613119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:14.613580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:14.614014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:14.630690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:34:14.636409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:34:14.648999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:34:14.651933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:34:14.699791 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9500dd83-c870-4cb9-8981-5f2cfab00da5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.644617 Sep 03 21:34:14.700573 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2955/6137] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:34:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:34:14.711863 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e4318d0-246d-4795-99db-ea8d6a077ffd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:14.712494 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e4318d0-246d-4795-99db-ea8d6a077ffd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:14.766337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e4318d0-246d-4795-99db-ea8d6a077ffd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:14.773695 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e4318d0-246d-4795-99db-ea8d6a077ffd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1238 microversion: 2.1 time: 0.065669 Sep 03 21:34:14.774268 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3183/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:14 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:15.798522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:15.799181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:15.807177 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:15.808187 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:15.808647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:15.809482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:15.809981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:15.810395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:15.873354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:15.881343 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b9bdd035-2a5f-4388-8458-4abbcdbf740f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1296 microversion: 2.1 time: 0.087236 Sep 03 21:34:15.881924 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2956/6139] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:15 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:34:16.906174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:16.907125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:16.917050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:16.917652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:16.918204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:16.918885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:16.919359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:16.919791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:16.947747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:16.959390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:16.959895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:16.961136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:16.973305 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] Creating event network-changed:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:34:16.978570 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-6aa1f57b-7342-46c8-b01a-4a2138480784 req-36b5f148-b0e7-411a-99a1-331fa0fd3f39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040939 Sep 03 21:34:16.980112 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2957/6140] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:34:17.181398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:17.189372 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-46bc7b72-45a3-453f-a2d0-e9785a58e110 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.287207 Sep 03 21:34:17.189946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3184/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:16 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:18.214913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:18.216207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:18.224034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:18.224544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:18.225027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:18.225771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:18.226371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:18.226818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:18.360095 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:18.367839 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-60098318-6473-4e20-b7ee-963899fc81fb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.158361 Sep 03 21:34:18.368438 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2958/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:18 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:19.391615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:19.392165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:19.394930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=41 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:19.401449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:19.401944 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:19.402386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:19.403088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:19.403551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:19.403986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:19.533377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:19.541127 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0be9d3ff-e2cc-4fef-afe3-c12267ad5ad3 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.153456 Sep 03 21:34:19.542395 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3185/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:19 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:20.564846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:20.565494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:20.568422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:20.574264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:20.574762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:20.575210 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:20.575920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:20.576382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:20.576820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:20.708855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:20.716797 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2abfc607-336d-4154-967d-aac669469cf7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.155893 Sep 03 21:34:20.717405 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2959/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:20 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:21.740828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:21.741473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:21.749105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:21.749630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:21.750075 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:21.750792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:21.751253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:21.751687 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:21.882505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:21.891126 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d212f8b-a746-46a6-a091-59a3c14831bc tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.154145 Sep 03 21:34:21.891628 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3186/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:21 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:22.461728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "name": "network-vif-plugged", "status": "completed", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:22.473193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:22.473702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:22.474150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:22.486596 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] Creating event network-vif-plugged:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:34:22.491861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bc79de3a-98c9-4be3-b6ae-94bec8238cea req-d517256d-5231-44c0-af7d-45348e43a42e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033769 Sep 03 21:34:22.492427 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2960/6146] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:34:22.914756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:22.915299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:22.922195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:22.922686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:22.923128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:22.923838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:22.924303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:22.924739 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:23.057096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:23.065431 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-48820e92-7f86-4ef8-8e57-26a9fba3486f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1363 microversion: 2.1 time: 0.154653 Sep 03 21:34:23.065999 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3187/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:22 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:24.090868 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:24.092060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:24.098275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:24.098764 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:24.099208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:24.099908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:24.100369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:24.100802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:24.234648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:24.243213 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7e183c56-dceb-43ee-9072-b60ab81d2fa0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1550 microversion: 2.1 time: 0.157492 Sep 03 21:34:24.243800 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2961/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:24 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:24.267521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:24.268016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:24.274937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:24.275432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:24.275879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:24.276583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:24.277085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:24.277523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:24.353690 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-503b3eda-25b2-471f-a035-804c43888ac1 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090650 Sep 03 21:34:24.354288 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3188/6149] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:34:24 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:34:25.268685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:25.273676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:25.274352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:25.283163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:25.283663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:25.284100 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:25.295205 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] Creating event network-changed:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:34:25.300493 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-07a0808d-985b-4b2a-8a44-b4c9a73acded req-00561c90-c72a-4520-ad8d-f0b33215d2a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Sep 03 21:34:25.301121 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2962/6150] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:34:58.200141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:58.202345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=7 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:58.202996 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=43 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:58.207531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:34:58.209812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:58.217077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:58.217573 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:58.218024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:58.218729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:58.219219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:58.219660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:58.248290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:58.254639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=140520) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:34:58.261189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:34:58.261623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:34:58.262107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:34:58.262570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:34:58.262945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:34:58.326187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f60f07ee-fcd6-451a-aa54-1c8a62b4751e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/action" status: 202 len: 0 microversion: 2.1 time: 0.126686 Sep 03 21:34:58.326819 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3189/6151] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:34:58 2022] POST /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:34:58.333601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=7 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:58.334451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:58.338683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:58.339378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:58.352310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:58.353031 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:58.353487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:58.354271 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:58.354742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:58.355179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:58.532355 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:58.540413 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8086f2e3-2134-4d95-abc8-5c395883d27b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1678 microversion: 2.1 time: 0.208990 Sep 03 21:34:58.541051 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2963/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:58 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:34:59.565783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:34:59.566410 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:34:59.573532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:59.574031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:59.574487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:59.575197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:34:59.575673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:34:59.576104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:34:59.722091 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:34:59.733944 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-68773c60-51d8-4f5f-9a45-45bdf868ba8f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1678 microversion: 2.1 time: 0.172573 Sep 03 21:34:59.735181 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3190/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:34:59 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:00.767143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:00.767766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:00.774679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:00.775171 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:00.775620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:00.776333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:00.776798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:00.777265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:00.904043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:00.912350 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c80e6ead-8384-4c29-87bc-7c2470113944 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.149198 Sep 03 21:35:00.912941 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2964/6154] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:00 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:01.935943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:01.937143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:01.944089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:01.944571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:01.945045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:01.945746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:01.946199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:01.946629 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:02.081891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:02.089990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5c8d7b2c-c700-44b0-9c08-be4727dc910b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.157894 Sep 03 21:35:02.090660 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3191/6155] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:01 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:03.115743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:03.116400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:03.123277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:03.123774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:03.124809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:03.125547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:03.126026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:03.126448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:03.259396 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:03.267204 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-546a8938-b293-4035-a7ac-ee4948f7ef19 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.155481 Sep 03 21:35:03.267779 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2965/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:03 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:35:04.290726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:04.291341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:04.298236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:04.298718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:04.299157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:04.299848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:04.300307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:04.300736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:04.428764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:04.437099 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-389a1767-e035-4de3-91d7-5a6df5f16386 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.149829 Sep 03 21:35:04.437662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3192/6157] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:04 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:05.461346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:05.462003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:05.468942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:05.469436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:05.469882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:05.470584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:05.471047 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:05.471483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:05.598813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:05.606775 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f98079c4-d237-4660-b113-02dac7747ada tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.149404 Sep 03 21:35:05.607358 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2966/6158] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:05 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:06.630523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:06.631140 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:06.637854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:06.638346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:06.638785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:06.639478 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:06.639933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:06.640359 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:06.771244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:06.779014 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bbfa3ba5-a19a-47cc-965b-bef23b35eb88 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.152403 Sep 03 21:35:06.779590 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3193/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:06 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:07.803262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:07.803921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:07.810940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:07.812122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:07.812579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:07.813329 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:07.813798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:07.814240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:07.943454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:07.951346 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02efdb0a-38c2-4d3b-8496-019b5915c12a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.152029 Sep 03 21:35:07.951960 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2967/6160] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:07 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:08.974943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:08.975561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:08.982665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:08.983158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:08.983603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:08.984558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:08.985050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:08.985486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:09.119024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:09.128182 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bc51af03-5de8-4249-ab97-1ecbfecc5b58 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.157061 Sep 03 21:35:09.128946 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3194/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:08 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:10.151744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:10.152378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:10.160081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:10.160577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:10.161133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:10.161845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:10.162308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:10.162747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:10.290372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:10.298208 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fe76c78d-0fb2-498a-9b16-cec5ff5a1c35 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.150409 Sep 03 21:35:10.298782 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2968/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:10 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:11.322243 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:11.322862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:11.330387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:11.330877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:11.331321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:11.332025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:11.332486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:11.332936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:11.465102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:11.472913 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-be154f08-dd51-46cf-8f9a-35442bd0da94 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.154531 Sep 03 21:35:11.473499 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3195/6163] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:11 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:12.497583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:12.498144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:12.505556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:12.506042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:12.506482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:12.507179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:12.507638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:12.508069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:12.640254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:12.648152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3c31c12c-967e-4273-8e45-5918ca3ed804 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.154567 Sep 03 21:35:12.648713 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2969/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:12 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:13.670821 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:13.671361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:13.678317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:13.678809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:13.679263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:13.679964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:13.680430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:13.680869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:13.812221 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:13.820056 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ffd67590-86b2-428a-944b-0599dc655040 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.153319 Sep 03 21:35:13.820617 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3196/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:13 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:14.843658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:14.844343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:14.851120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:14.851615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:14.852059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:14.852760 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:14.853284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:14.853716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:15.290726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:15.299410 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-30e7b0d2-bb28-4480-ba06-afba6c353c3d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.459696 Sep 03 21:35:15.299934 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2970/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:14 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:16.324278 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:16.324834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:16.331743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:16.332242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:16.332686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:16.333413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:16.333874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:16.334305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:16.464102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:16.472875 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56f3cb3e-9315-4bb3-9538-bb9b02343125 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1683 microversion: 2.1 time: 0.152832 Sep 03 21:35:16.473703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3197/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:16 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:17.497768 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:17.498423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:17.505955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:17.506456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:17.506908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:17.507623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:17.508090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:17.508532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:17.565454 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "name": "network-vif-unplugged", "status": "completed", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:17.575790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:17.576266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:17.576767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:17.588940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Creating event network-vif-unplugged:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch1-master-1 Sep 03 21:35:17.594536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] Instance c9a600b2-5693-4b36-805a-8252525449f6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:35:17.605471 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8e17ab82-192a-43ca-8911-eb5b88cc0dd8 req-111a04e2-0dc9-4f35-977b-1496446b6fda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044329 Sep 03 21:35:17.606135 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3198/6168] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:35:17.743283 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:17.752333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba6f0504-dfb0-411f-baa2-540d1dcfa511 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1682 microversion: 2.1 time: 0.258508 Sep 03 21:35:17.752942 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2971/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:17 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:18.776853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:18.777580 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:18.783828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:18.784315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:18.784754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:18.785469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:18.785928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:18.786354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:18.983397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:18.991377 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-373d0381-24a9-4951-a491-b3ce5084a70f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1680 microversion: 2.1 time: 0.219527 Sep 03 21:35:18.991948 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3199/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:18 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:19.629560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:19.639965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:19.640457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:19.640920 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:19.652681 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Creating event network-changed:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch1-master-1 Sep 03 21:35:19.658272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] Instance c9a600b2-5693-4b36-805a-8252525449f6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:35:19.669172 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5ca06a1d-efec-4b27-8ec2-18a31dba9a24 req-2fa8405b-4ee9-44d4-b3fa-19d5604d9324 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043333 Sep 03 21:35:19.669762 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2972/6171] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:20.015661 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:20.016309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:20.022947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:20.023443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:20.023887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:20.024586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:20.025083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:20.025509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:20.243911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:20.251842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b916dde-348f-41d8-842d-8a34683ae3d0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1680 microversion: 2.1 time: 0.240082 Sep 03 21:35:20.252635 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3200/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:20 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:21.277677 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:21.278387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:21.284725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:21.285265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:21.285715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:21.286429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:21.286896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:21.287342 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:21.536856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:21.544680 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7369b214-2b59-49a2-aea1-8e53adaf6ea5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1680 microversion: 2.1 time: 0.273014 Sep 03 21:35:21.545937 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2973/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:21 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:22.569370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:22.569985 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:22.576860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.577424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.577860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.578553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.579012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.579441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.707779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:22.715399 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-00c29484-3a7d-43b1-b112-087e7d356889 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1677 microversion: 2.1 time: 0.149901 Sep 03 21:35:22.715967 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3201/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:22 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:22.739113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:22.739655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:22.746531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.747017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.747458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.748156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.748614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.749073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.786090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.786571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.787009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.787732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.788215 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.788643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.808640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:35:22.813799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:35:22.911961 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-eb53d4dc-c3a1-46ee-8aad-fdc3de6c03eb tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/action" status: 202 len: 0 microversion: 2.1 time: 0.176451 Sep 03 21:35:22.912568 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2974/6175] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:35:22 2022] POST /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:35:22.920760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:22.921485 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:22.927523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.928059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.928565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:22.929411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:22.929887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:22.930289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:23.060153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:23.068745 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7cae88c2-8284-4ab0-9823-e233129cdfda tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1676 microversion: 2.1 time: 0.151866 Sep 03 21:35:23.069343 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3202/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:22 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:23.931878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "name": "network-vif-plugged", "status": "completed", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:23.946333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:23.946804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:23.947243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:23.959367 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Creating event network-vif-plugged:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch1-master-1 Sep 03 21:35:23.964721 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] Instance c9a600b2-5693-4b36-805a-8252525449f6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:35:23.975225 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d8b34cb2-b8f9-4a86-a7da-adbe671cbb72 req-4e219895-6201-4f79-8988-6c72ad03f9a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048203 Sep 03 21:35:23.975831 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2975/6177] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:24.092685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:24.093373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:24.100246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:24.100741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:24.101219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:24.101924 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:24.102392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:24.102834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:24.239027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:24.246893 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ae4c40ac-b902-488d-8c9a-6ea3df4d69a2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1676 microversion: 2.1 time: 0.158275 Sep 03 21:35:24.247468 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3203/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:24 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:25.271949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:25.272755 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:25.279872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:25.280443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:25.280881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:25.281615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:25.282076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:25.282503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:25.414900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:25.422869 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6b813b76-2745-4222-bcad-9b73da71024d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1676 microversion: 2.1 time: 0.155100 Sep 03 21:35:25.423442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2976/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:25 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:26.296021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "name": "network-vif-unplugged", "status": "completed", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:26.305548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:26.306025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:26.306455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:26.318548 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Creating event network-vif-unplugged:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:35:26.321056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:26.324578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] Instance c9a600b2-5693-4b36-805a-8252525449f6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:35:26.336245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-d2c509ba-62ff-4da8-8b87-3fd0b010f448 req-b02d5d8a-259b-447f-b1a5-20df1166c54a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108107 Sep 03 21:35:26.336878 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3204/6180] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:26.449854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:26.451025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:26.459191 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:26.459688 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:26.460139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:26.460851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:26.461346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:26.461781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:26.466054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:26.595704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:26.615519 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-023b638d-d87f-4b16-b507-4eac247fdad2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1676 microversion: 2.1 time: 0.172840 Sep 03 21:35:26.616404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2977/6181] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:26 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:27.642255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:27.643085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:27.649753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:27.650238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:27.650678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:27.651377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:27.651831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:27.652259 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:27.785217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:27.792990 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-feb3d575-3d33-4b17-89b3-f08355ebfe5f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1676 microversion: 2.1 time: 0.157021 Sep 03 21:35:27.793569 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3205/6182] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:27 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:28.350801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:28.356578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:28.362863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:28.363351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:28.363796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:28.376506 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Creating event network-changed:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:35:28.381809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] Instance c9a600b2-5693-4b36-805a-8252525449f6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:35:28.393064 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ba0c34fe-b781-415a-a9d3-0d565f478055 req-1468f822-289a-4364-9df9-cd32f5e4bf0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045898 Sep 03 21:35:28.393595 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2978/6183] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:28.816519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:28.817471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:28.821285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=39 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:28.827481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:28.828119 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:28.828653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:28.829490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:28.830049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:28.830570 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.062351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:29.070217 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f93668e8-6ca7-40ce-aae1-4d07013799fd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1669 microversion: 2.1 time: 0.257856 Sep 03 21:35:29.070891 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3206/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:28 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1669 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:29.095433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:29.096140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:29.102828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.103320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.103775 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.104479 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.104962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.105500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.238723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:29.246534 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bad1246d-eae6-4b6d-a248-5e6e65ac2932 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1669 microversion: 2.1 time: 0.156621 Sep 03 21:35:29.247112 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2979/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:29 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:29.270552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:29.271529 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:29.278085 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.278575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.279019 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.279726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.280220 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.280655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.412121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:29.419921 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3387d37f-f312-4d02-bf66-6bb657af72ee tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1669 microversion: 2.1 time: 0.153352 Sep 03 21:35:29.420494 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3207/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:29 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:29.443212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:29.443710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:29.450590 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.451088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.451538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.452277 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.452740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.453212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.477861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:35:29.552971 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-73ecc01e-4c25-40cb-9f22-00529188c450 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 204 len: 0 microversion: 2.1 time: 0.112989 Sep 03 21:35:29.553657 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2980/6187] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:35:29 2022] DELETE /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:35:29.562713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:29.563380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:29.569466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.569954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.570393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.571083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:29.571542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:29.571970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:29.706519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:29.714563 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da6b70b1-9e0a-4328-b621-d9bd0e2a5122 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1675 microversion: 2.1 time: 0.156404 Sep 03 21:35:29.715148 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3208/6188] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:29 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:30.740459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:30.741206 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:30.748133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:30.748563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:30.749041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:30.749769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:30.750238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:30.750673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:30.898037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:30.907856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5e84805-539d-4e32-8fd6-d41c82249ac5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1675 microversion: 2.1 time: 0.171185 Sep 03 21:35:30.908493 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2981/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:30 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:31.901218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a600b2-5693-4b36-805a-8252525449f6", "name": "network-vif-deleted", "tag": "f10cfd36-ea02-4611-ae3b-ea324e09ca39"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:31.912891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:31.913492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:31.913937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:31.927216 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] Creating event network-vif-deleted:f10cfd36-ea02-4611-ae3b-ea324e09ca39 for instance c9a600b2-5693-4b36-805a-8252525449f6 on nch2-master-1 Sep 03 21:35:31.934356 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:31.935797 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-32ffe209-a13a-4f2f-9f24-ab32b1aeb905 req-00dbfdf9-0c38-439e-9c03-d205b211091f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038343 Sep 03 21:35:31.937035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:31.937771 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3209/6190] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:35:31.946019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:31.946950 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:31.947767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:31.948945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:31.949629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:31.950282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:32.044373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:32.055021 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e597614d-dda8-42dd-8ef9-7fd53758a228 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 200 len: 1323 microversion: 2.1 time: 0.126790 Sep 03 21:35:32.056410 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2982/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:31 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 1323 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:33.080207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:33.081000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:33.087753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.088279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.088742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.089491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.089947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.090375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.107915 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 HTTP/1.1 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c9a600b2-5693-4b36-805a-8252525449f6'} Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:35:33.110276 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ca711cef-15fa-47fd-ba74-b56144894a1e tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 404 len: 111 microversion: 2.1 time: 0.036797 Sep 03 21:35:33.117595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3210/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:33 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:35:33.127432 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:33.128051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:33.130819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:33.137425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.137931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.138383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.139247 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.140251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.140689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.156853 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 HTTP/1.1 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c9a600b2-5693-4b36-805a-8252525449f6'} Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:35:33.158550 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41e392ea-9158-4aad-b046-e4b8442a1e1d tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 404 len: 111 microversion: 2.1 time: 0.036727 Sep 03 21:35:33.162888 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2983/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:33 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:35:33.210279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-306444987", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "f2863566-e394-4d19-b550-3669ef4769e6"}], "security_groups": [{"name": "tempest-securitygroup--243687592"}], "key_name": "tempest-keypair-1725513400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:33.314309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] validate_networks() for [('f2863566-e394-4d19-b550-3669ef4769e6', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:35:33.734892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:35:33.735323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:35:33.735803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:35:33.736218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:35:33.736636 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:35:33.745709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.746135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.746576 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.747312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:33.747772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:33.748207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:33.766941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:35:33.772228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Getting quotas for user 40161a00c7b64a359eb4124919b060ac and project 934cd0abe2484e06a909466637406e45. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:35:33.784769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:35:33.787147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:35:33.833395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8832d85-634f-44c1-bb7f-d8b8e62f632f tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.626927 Sep 03 21:35:33.834063 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3211/6194] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:35:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:35:33.845577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-95741821-53b9-4ac3-b573-563814f39169 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:33.846203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-95741821-53b9-4ac3-b573-563814f39169 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:33.902030 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-95741821-53b9-4ac3-b573-563814f39169 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:33.909054 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-95741821-53b9-4ac3-b573-563814f39169 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1238 microversion: 2.1 time: 0.067490 Sep 03 21:35:33.909898 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2984/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:33 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:34.934292 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:34.934830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:34.941805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:34.942501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:34.942950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:34.943655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:34.944112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:34.944544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:35.013113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:35.021845 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13ec83e5-6326-4b2f-85ea-cfccfb831eb6 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1298 microversion: 2.1 time: 0.092334 Sep 03 21:35:35.022645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3212/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:34 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:36.047036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:36.047681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:36.055507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:36.055994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:36.056435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:36.057165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:36.057629 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:36.058195 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:36.278789 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:36.287191 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-50da8e7e-4274-492d-97d6-b3a85e2278d5 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.244658 Sep 03 21:35:36.287901 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2985/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:36 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:35:36.370460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ce1370-107b-436e-92b3-4f9c532207fa", "tag": "591ea5b6-59b0-4302-83bc-0530a236415d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:36.381466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:36.382032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:36.382474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:36.393867 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] Creating event network-changed:591ea5b6-59b0-4302-83bc-0530a236415d for instance a7ce1370-107b-436e-92b3-4f9c532207fa on nch1-master-1 Sep 03 21:35:36.398554 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-317327e3-d949-48e0-bf1e-8f6f798ebe05 req-a0fc8a29-06fe-48f5-bd0b-6914e9d7a69c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Sep 03 21:35:36.399145 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3213/6198] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:35:37.310379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:37.310995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:37.318360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:37.318842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:37.319280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:37.319973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:37.320429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:37.320857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:37.447670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:37.456023 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b2123e4d-db99-4020-988d-1f544f5f0b79 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.149523 Sep 03 21:35:37.456587 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2986/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:37 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:38.480548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:38.481285 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:38.487870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:38.488366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:38.488808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:38.489537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:38.489999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:38.490435 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:38.625300 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:38.633011 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8da4de8-5521-4602-a477-3a036d718363 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.157546 Sep 03 21:35:38.633581 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3214/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:38 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:39.657564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:39.658182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:39.665188 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:39.665683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:39.666129 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:39.666884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:39.667343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:39.667781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:39.803929 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:39.811788 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e3b1b8d8-67eb-48ec-9c37-9c9b57afa0e2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.158715 Sep 03 21:35:39.812364 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2987/6201] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:39 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:40.835490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:40.836105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:40.843043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:40.843526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:40.843967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:40.844666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:40.845153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:40.845582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:40.972615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:40.980334 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85e736d8-60a1-43d6-a8ee-51bb98971d34 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.148793 Sep 03 21:35:40.980918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3215/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:40 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:35:42.005474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:42.006241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:42.013166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:42.013658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:42.014102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:42.015441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:42.016043 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:42.016577 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:42.028934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ce1370-107b-436e-92b3-4f9c532207fa", "name": "network-vif-plugged", "status": "completed", "tag": "591ea5b6-59b0-4302-83bc-0530a236415d"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:42.041297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:42.041817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:42.042381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:42.054052 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] Creating event network-vif-plugged:591ea5b6-59b0-4302-83bc-0530a236415d for instance a7ce1370-107b-436e-92b3-4f9c532207fa on nch1-master-1 Sep 03 21:35:42.058953 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-df3223b8-7b5d-4bbc-a5e4-24af52091208 req-4b43c877-7888-48a0-b4c3-ddaf49dff9df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033949 Sep 03 21:35:42.059783 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3216/6203] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:42.173938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:42.181769 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f6e6c190-b6c4-46b0-8676-4154a3e1e93b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.180220 Sep 03 21:35:42.182342 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2988/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:42 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:43.258200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:43.258908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:43.265226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:43.265716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:43.266160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:43.266860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:43.267337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:43.267792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:43.400301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:43.408612 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6c3d917d-e845-4e72-ba8f-1a14dd0bfae2 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1363 microversion: 2.1 time: 0.206093 Sep 03 21:35:43.409285 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3217/6205] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:43 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:44.433650 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:44.434166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:44.437438 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:44.443291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:44.443794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:44.444237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:44.444964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:44.445424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:44.445855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:44.579608 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:35:44.587352 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1b2f989b-e09b-4b67-b052-cc019dc17144 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1551 microversion: 2.1 time: 0.157758 Sep 03 21:35:44.587932 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2989/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:35:44 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:35:44.611171 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:35:44.611703 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:35:44.613721 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:44.614428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:44.621313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:44.621814 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:44.622263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:44.622974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:44.624053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:44.624524 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:44.700364 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b03b448b-1499-4495-a78b-32300282cf12 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093893 Sep 03 21:35:44.700992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3218/6207] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Sep 3 21:35:44 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:35:45.633772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ce1370-107b-436e-92b3-4f9c532207fa", "tag": "591ea5b6-59b0-4302-83bc-0530a236415d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:35:45.643937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:35:45.644426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:35:45.644866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:35:45.656999 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] Creating event network-changed:591ea5b6-59b0-4302-83bc-0530a236415d for instance a7ce1370-107b-436e-92b3-4f9c532207fa on nch1-master-1 Sep 03 21:35:45.662149 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-fae0f7be-a8b6-4114-8318-056ab15f3ae5 req-c447f30f-a0f0-4010-b540-e45fbef75e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Sep 03 21:35:45.662753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2990/6208] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:36:57.654063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:57.654923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=62 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:57.659587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:36:57.660199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:36:57.667310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:57.667803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:57.668246 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:57.668983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:57.669447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:57.669878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:57.800126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:36:57.807931 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c082229a-3340-46ae-8d87-2ae571527324 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1670 microversion: 2.1 time: 0.156269 Sep 03 21:36:57.808501 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3219/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:36:57 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:36:57.959737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:57.960485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:57.965141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:36:57.965767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:36:57.974185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:57.974715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:57.975166 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:57.975869 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:57.976334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:57.976769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:58.002843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:36:58.075436 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1fe45393-9af7-4951-857f-799fe8687957 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 204 len: 0 microversion: 2.1 time: 0.118062 Sep 03 21:36:58.076056 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2991/6210] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:36:57 2022] DELETE /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:36:58.085250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:36:58.085868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:36:58.092166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:58.092650 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:58.093144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:58.093838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:58.094294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:58.094716 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:58.231236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:36:58.239606 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-affe622a-e60d-468e-9126-1776d94101c0 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1676 microversion: 2.1 time: 0.158319 Sep 03 21:36:58.240179 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3220/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:36:58 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:36:59.264104 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:36:59.264829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:36:59.272157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:59.272644 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:59.273124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:59.273823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:36:59.274282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:36:59.274712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:36:59.406444 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:36:59.414875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e14288a-cdcc-4624-b34b-f3282234e777 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1676 microversion: 2.1 time: 0.155046 Sep 03 21:36:59.415449 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2992/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:36:59 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:00.438079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:00.438827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:00.446332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:00.446826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:00.447264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:00.447971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:00.448592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:00.449049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:00.492749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ce1370-107b-436e-92b3-4f9c532207fa", "name": "network-vif-deleted", "tag": "591ea5b6-59b0-4302-83bc-0530a236415d"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:00.504468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:00.505078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:00.505592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:00.518230 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] Creating event network-vif-deleted:591ea5b6-59b0-4302-83bc-0530a236415d for instance a7ce1370-107b-436e-92b3-4f9c532207fa on nch1-master-1 Sep 03 21:37:00.523787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40161a00c7b64a359eb4124919b060ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934cd0abe2484e06a909466637406e45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:00.524671 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-896f1ac1-5e4f-45a1-ae7f-125c183439fa req-a108d2b2-8c69-4b31-8e42-068a448f24ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036448 Sep 03 21:37:00.526239 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2993/6213] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:00.534245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c8bd6584-4017-43ae-bf1d-c0847de12fb7 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 200 len: 1609 microversion: 2.1 time: 0.100253 Sep 03 21:37:00.534864 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3221/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:00 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 1609 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:01.559375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.560077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: a7ce1370-107b-436e-92b3-4f9c532207fa] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.566284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.566786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.567225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.567952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.568389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.568823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.582766 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa HTTP/1.1 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'a7ce1370-107b-436e-92b3-4f9c532207fa'} Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.584470 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance a7ce1370-107b-436e-92b3-4f9c532207fa could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b8408e9b-eaed-4a24-8780-8abb6d592258 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa" status: 404 len: 111 microversion: 2.1 time: 0.031768 Sep 03 21:37:01.588333 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2994/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:01 2022] GET /compute/v2.1/servers/a7ce1370-107b-436e-92b3-4f9c532207fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.594680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.595859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.602805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.603295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.603740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.604442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.604962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.605354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.622324 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 HTTP/1.1 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c9a600b2-5693-4b36-805a-8252525449f6'} Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.624036 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.628252 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e0b3fce7-420c-4481-8a36-02343934c0df tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 404 len: 111 microversion: 2.1 time: 0.034758 Sep 03 21:37:01.629489 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3222/6216] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:01 2022] DELETE /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.635161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.635867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c9a600b2-5693-4b36-805a-8252525449f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.642948 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.643476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.643923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.644829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.645327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.645761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.660733 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 HTTP/1.1 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c9a600b2-5693-4b36-805a-8252525449f6'} Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.662376 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c9a600b2-5693-4b36-805a-8252525449f6 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b1035426-d6bf-4c66-ae8e-b1d6a2780193 tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6" status: 404 len: 111 microversion: 2.1 time: 0.033188 Sep 03 21:37:01.666714 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2995/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:01 2022] GET /compute/v2.1/servers/c9a600b2-5693-4b36-805a-8252525449f6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.672412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.672940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.679086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.679581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.680027 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.680728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.681219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.681656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.695070 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 HTTP/1.1 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c1b02329-6cc3-4a15-a246-ad5464cd3028'} Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.696602 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b3f119d-73f6-418e-8e56-99b0c2a69e4b tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 404 len: 111 microversion: 2.1 time: 0.029532 Sep 03 21:37:01.700878 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3223/6218] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:01 2022] DELETE /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.706922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.707587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: c1b02329-6cc3-4a15-a246-ad5464cd3028] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.713729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.714229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.714681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.715391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.715860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.716302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.730242 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 HTTP/1.1 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': 'c1b02329-6cc3-4a15-a246-ad5464cd3028'} Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.731820 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance c1b02329-6cc3-4a15-a246-ad5464cd3028 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ec75e0dc-46c4-4b5c-a42c-0b618c84bfff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028" status: 404 len: 111 microversion: 2.1 time: 0.030723 Sep 03 21:37:01.736061 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2996/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:01 2022] GET /compute/v2.1/servers/c1b02329-6cc3-4a15-a246-ad5464cd3028 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.741789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.742238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.748233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.748722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.749205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.749906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.750367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.750802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.764153 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c HTTP/1.1 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '1045be5b-cdc5-480a-ae94-0050656e506c'} Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.765719 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0ab99086-5fde-42e6-84aa-5f620bb6ebbd tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 404 len: 111 microversion: 2.1 time: 0.029202 Sep 03 21:37:01.770291 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3224/6220] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:01 2022] DELETE /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:01.775800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.776424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [instance: 1045be5b-cdc5-480a-ae94-0050656e506c] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:01.783228 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.783728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.784182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.784916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:01.785382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:01.785821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:01.799453 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] HTTP exception thrown: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Request method failure captured: Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c HTTP/1.1 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8eDxCWWBiFOB3HVpaj_IGN-025r4dNk2mzAiIkfCJ18jfKbMehmB45aTppzC0l4pjOAsB9BL_PzPrZbwSt_-9d7fYiEDTEZGVgxDd6PtcBF2x0qRPztJGR4wk4Gpnrugwkol0TN2U2PHJMs7-E8M79I2Pu9liNfz_6PL_lkpGegKhs Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_934cd0abe2484e06a909466637406e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/934cd0abe2484e06a909466637406e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/934cd0abe2484e06a909466637406e45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 934cd0abe2484e06a909466637406e45 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServerActionsTestJSON-857509781 Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 40161a00c7b64a359eb4124919b060ac Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServerActionsTestJSON-857509781-project Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '1045be5b-cdc5-480a-ae94-0050656e506c'} Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:01.801073 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Returning 404 to user: Instance 1045be5b-cdc5-480a-ae94-0050656e506c could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2c9a08dd-c984-47a0-ba75-69b18f7e7e5a tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c" status: 404 len: 111 microversion: 2.1 time: 0.030493 Sep 03 21:37:01.807314 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2997/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:01 2022] GET /compute/v2.1/servers/1045be5b-cdc5-480a-ae94-0050656e506c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:37:01.812164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-de8c19eb-8968-407e-997e-78d1897ef4ff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] Calling method '.version_select at 0x7fae67698430>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:01.816844 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de8c19eb-8968-407e-997e-78d1897ef4ff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:37:02.825694 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [None req-de8c19eb-8968-407e-997e-78d1897ef4ff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41920. Sep 03 21:37:02.849356 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-de8c19eb-8968-407e-997e-78d1897ef4ff tempest-ServerActionsTestJSON-857509781 tempest-ServerActionsTestJSON-857509781-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725513400" status: 202 len: 0 microversion: 2.1 time: 1.041575 Sep 03 21:37:02.849936 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3225/6222] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Sep 3 21:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725513400 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:37:11.717130 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:37:11.717696 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 03 21:37:11.718430 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:37:11.718555 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 03 21:37:11.782964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:11.790544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:11.863244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639452974", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8edaa493-6369-4861-bdac-fd70bdee439c"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:11.934224 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] validate_networks() for [('8edaa493-6369-4861-bdac-fd70bdee439c', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:37:12.625723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:37:12.626155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:37:12.626633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:37:12.627046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:37:12.627459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:37:12.636563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:12.637083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:12.637532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:12.638262 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:12.638719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:12.639152 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:12.656232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Getting quotas for project f173156588e346d481341b28d4594784. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:37:12.662429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Getting quotas for user 4cc1b001d6c14a4c8030d9682d7a3a95 and project f173156588e346d481341b28d4594784. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:37:12.676182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:37:12.678623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:37:12.728393 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d31c5407-fe73-4a7b-9db1-a77602789c9d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016905 Sep 03 21:37:12.736657 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2998/6223] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:37:12.742440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1194db8a-c964-4eac-ab17-d7739c0fab83 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:12.743640 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1194db8a-c964-4eac-ab17-d7739c0fab83 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:12.752353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:12.812386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1194db8a-c964-4eac-ab17-d7739c0fab83 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:12.819934 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1194db8a-c964-4eac-ab17-d7739c0fab83 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1216 microversion: 2.1 time: 0.081784 Sep 03 21:37:12.820641 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3226/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:12 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:13.846035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:13.847585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:13.855794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:13.856384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:13.856842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:13.857614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:13.858258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:13.858853 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:13.936334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:13.945572 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5acf8060-4602-4110-843e-566a9d6f828c tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1268 microversion: 2.1 time: 0.105668 Sep 03 21:37:13.946803 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 2999/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:13 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1268 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:14.971915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:14.973824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:14.982527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:14.983527 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:14.984749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:14.987379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:14.988256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:14.994033 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:15.251799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:15.260012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-737f97f3-1f41-46e9-ad8e-2aa11f801328 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.292929 Sep 03 21:37:15.260601 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3227/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:14 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:15.378302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d282b38-4b4b-4de7-a947-0885d8551629", "tag": "7d335d3a-4146-4a37-bd83-c7508d034b42"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:15.389800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:15.390214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:15.390666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:15.404938 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] Creating event network-changed:7d335d3a-4146-4a37-bd83-c7508d034b42 for instance 0d282b38-4b4b-4de7-a947-0885d8551629 on nch2-master-1 Sep 03 21:37:15.411967 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-9500b33e-9653-4592-93d3-1ac54561dd93 req-01a285f2-784b-4d5b-a17f-76398d44083a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038303 Sep 03 21:37:15.412987 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3000/6227] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:16.284357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:16.284873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:16.291749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:16.292236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:16.292674 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:16.293402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:16.293861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:16.294288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:16.424030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:16.431694 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f5f55b40-5127-4f3d-9a36-ecbbc2457e8f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.151944 Sep 03 21:37:16.432257 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3228/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:16 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:17.455181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:17.456000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:17.463383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:17.463880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:17.464325 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:17.465061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:17.465543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:17.466204 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:17.599692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:17.607396 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3d58826b-550f-499e-834c-4aea5c0899a4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.156584 Sep 03 21:37:17.607968 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3001/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:17 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:18.632212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:18.633009 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:18.639972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:18.640466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:18.640936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:18.642315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:18.642810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:18.643271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:18.774670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:18.782410 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3a0b8ff1-ed89-4fe8-99e9-81563e9d03f3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.154126 Sep 03 21:37:18.782984 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3229/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:18 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:19.805767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:19.806383 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:19.813327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:19.813811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:19.814255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:19.815450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:19.815909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:19.816339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:19.951741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:19.960430 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-abcc7947-b091-434f-a7b4-2a31eb4d25c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.158971 Sep 03 21:37:19.961013 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3002/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:19 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:20.983761 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:20.984378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:20.991472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:20.991972 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:20.992421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:20.993257 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:20.993801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:20.994271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:21.125400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:21.133925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-815594ed-b5f8-4499-8c9c-64b689e82a94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.154137 Sep 03 21:37:21.134703 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3230/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:20 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:21.188109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d282b38-4b4b-4de7-a947-0885d8551629", "name": "network-vif-plugged", "status": "completed", "tag": "7d335d3a-4146-4a37-bd83-c7508d034b42"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:21.200370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:21.201795 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:21.202238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:21.214495 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] Creating event network-vif-plugged:7d335d3a-4146-4a37-bd83-c7508d034b42 for instance 0d282b38-4b4b-4de7-a947-0885d8551629 on nch2-master-1 Sep 03 21:37:21.219801 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-d401886e-df2a-469b-9467-d680c6d1f8ad req-4588fc4d-039f-4393-b615-7dff11a8649a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035451 Sep 03 21:37:21.221553 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3003/6233] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:22.157248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:22.157812 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:22.165487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:22.165970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:22.166407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:22.167129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:22.167581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:22.168011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:22.297816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:22.307556 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f6b09c7-230c-4b10-838f-1b88cb638c6f tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1316 microversion: 2.1 time: 0.154247 Sep 03 21:37:22.308350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3231/6234] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:22 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:23.332024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:23.332730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:23.335613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:23.336281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:23.343128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:23.343621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:23.344069 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:23.344771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:23.345260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:23.345695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:23.474416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:23.482327 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-15bd8688-3d05-4f1b-b095-34326dfb18c9 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.154613 Sep 03 21:37:23.482890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3004/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:23 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:23.545377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-40303837", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "8edaa493-6369-4861-bdac-fd70bdee439c"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:23.553973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:23.602431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] validate_networks() for [('8edaa493-6369-4861-bdac-fd70bdee439c', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:37:23.972759 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:37:23.973255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:37:23.973747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:37:23.974182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:37:23.974630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:37:23.983685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:23.984177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:23.984878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:23.985644 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:23.986611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:23.987042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:24.004873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Getting quotas for project f173156588e346d481341b28d4594784. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:37:24.010760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Getting quotas for user 4cc1b001d6c14a4c8030d9682d7a3a95 and project f173156588e346d481341b28d4594784. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:37:24.023659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:37:24.026042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:37:24.070548 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9a9098ef-6be0-4253-9002-369bf9698353 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529025 Sep 03 21:37:24.071102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3232/6236] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:37:24.082655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-48df3c7e-b0d7-458a-be1a-66ea7524b95a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:24.083279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-48df3c7e-b0d7-458a-be1a-66ea7524b95a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:24.141382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-48df3c7e-b0d7-458a-be1a-66ea7524b95a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:24.149082 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-48df3c7e-b0d7-458a-be1a-66ea7524b95a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1215 microversion: 2.1 time: 0.070821 Sep 03 21:37:24.149650 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3005/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:24 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:25.174076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:25.174744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:25.181685 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:25.182182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:25.182630 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:25.183335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:25.183803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:25.184241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:25.247983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:25.266540 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cf31a2ee-2226-4cfa-b4d4-15c7c4f1d94a tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1267 microversion: 2.1 time: 0.097141 Sep 03 21:37:25.267125 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3233/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:25 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:26.292745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:26.293689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:26.313186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:26.313882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:26.314331 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:26.315054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:26.315847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:26.316290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:26.539053 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:26.546963 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-734fae9a-7f40-4fc4-a588-2259a0502289 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.260231 Sep 03 21:37:26.547548 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3006/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:26 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:26.774915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00302607-1fc2-44ad-a244-d289aa8bfe76", "tag": "b0e6a48d-9530-41f9-9387-021b1dbf4ac6"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:26.786925 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:26.787528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:26.787962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:26.799477 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] Creating event network-changed:b0e6a48d-9530-41f9-9387-021b1dbf4ac6 for instance 00302607-1fc2-44ad-a244-d289aa8bfe76 on nch1-master-1 Sep 03 21:37:26.804370 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-74862211-839e-4cff-80c4-f6a07bc92464 req-6acdabdd-eeb3-47c6-bfed-438a8deabbd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034299 Sep 03 21:37:26.804985 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3234/6240] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:37:27.570323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:27.570939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:27.577778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:27.578268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:27.578712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:27.579440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:27.579942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:27.580372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:27.707839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:27.715485 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c2dfa994-4012-43db-8b19-9e279e5ae0a0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.149196 Sep 03 21:37:27.716058 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3007/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:27 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:28.739419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:28.740137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:28.742999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:28.748856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:28.749369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:28.749808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:28.750509 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:28.750964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:28.751393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:28.886214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:28.893925 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6ed6e5f9-0310-475a-ab5e-cd01c9c3f588 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.159612 Sep 03 21:37:28.894524 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3235/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:28 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:29.917292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:29.917911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:29.925478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:29.925968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:29.926409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:29.927113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:29.927570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:29.928001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:30.054254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:30.061891 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9574b9dc-a922-4a92-9967-4c930aedbf94 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.148475 Sep 03 21:37:30.062450 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3008/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:29 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:31.086334 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:31.086979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:31.094394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:31.094909 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:31.099990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:31.099990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:31.099990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:31.099990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:31.234789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:31.243149 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-110a641a-8a15-4db3-abc3-329929611932 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.161899 Sep 03 21:37:31.243716 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3236/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:31 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:32.266018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:32.266656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:32.275715 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:32.276353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:32.276997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:32.277737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:32.278194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:32.278636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:32.434370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:32.443750 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a8ef33b2-e1b2-433e-9773-93fc634ae16e tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.181701 Sep 03 21:37:32.444930 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3009/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:32 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:32.817496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00302607-1fc2-44ad-a244-d289aa8bfe76", "name": "network-vif-plugged", "status": "completed", "tag": "b0e6a48d-9530-41f9-9387-021b1dbf4ac6"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:32.829175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:32.830282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:32.830738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:32.841897 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] Creating event network-vif-plugged:b0e6a48d-9530-41f9-9387-021b1dbf4ac6 for instance 00302607-1fc2-44ad-a244-d289aa8bfe76 on nch1-master-1 Sep 03 21:37:32.847116 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8c908c8f-8c56-47c8-b85a-dd50c569c6be req-4489ee41-1bd2-448b-ab25-70f2a4956dcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108421 Sep 03 21:37:32.847745 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3237/6246] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:33.469971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:33.471114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:33.477900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:33.478409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:33.478849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:33.479571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:33.480011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:33.480443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:33.610636 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:33.619105 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7d929bb8-9f8a-42bf-a105-75f883de90e3 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1315 microversion: 2.1 time: 0.153475 Sep 03 21:37:33.619677 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3010/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:33 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:34.640256 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:34.641145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:34.645596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:34.646305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:34.653535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.654029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.654500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:34.655205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.655665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.656102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:34.794112 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:34.803283 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-739702b7-7323-4b7c-9db0-b481af49c763 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1503 microversion: 2.1 time: 0.164796 Sep 03 21:37:34.804008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3238/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:34 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:34.826885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:34.827394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:34.829264 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:34.835572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.836068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.836508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:34.837235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.837693 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.838122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:34.864859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:37:34.942860 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-507827c4-97d3-43bf-9d98-17acca7ac790 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 204 len: 0 microversion: 2.1 time: 0.119511 Sep 03 21:37:34.943515 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3011/6249] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:34 2022] DELETE /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:37:34.953302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:34.953923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:34.959929 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.960419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.960862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:34.961582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:34.962039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:34.962470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:35.092719 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:35.101064 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f1662b2f-b7dd-4668-836e-27fc67d994f7 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1509 microversion: 2.1 time: 0.152003 Sep 03 21:37:35.101645 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3239/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:34 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:36.127079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:36.127679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:36.134668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:36.135318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:36.135583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:36.136279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:36.136734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:36.137190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:36.266756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:36.274641 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1ef43eb-a633-4481-9034-b0eded70d825 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1509 microversion: 2.1 time: 0.152537 Sep 03 21:37:36.275242 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3012/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:36 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:37.118874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00302607-1fc2-44ad-a244-d289aa8bfe76", "name": "network-vif-deleted", "tag": "b0e6a48d-9530-41f9-9387-021b1dbf4ac6"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:37.135995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:37.136760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:37.136951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:37.151395 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] Creating event network-vif-deleted:b0e6a48d-9530-41f9-9387-021b1dbf4ac6 for instance 00302607-1fc2-44ad-a244-d289aa8bfe76 on nch1-master-1 Sep 03 21:37:37.158560 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-bac2976e-182a-4005-9fbf-b751c81fc78d req-01d9fbab-3aed-40ef-aa82-bb5fd98b63b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137055 Sep 03 21:37:37.159183 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3240/6252] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:37.298169 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:37.299343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:37.306184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:37.306676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:37.307124 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:37.307829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:37.308292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:37.308726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:37.338938 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:37.339434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:37.339881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:37.340337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lazy-loading 'fault' on Instance uuid 00302607-1fc2-44ad-a244-d289aa8bfe76 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:37:37.382119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:37.389981 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6e705d73-cfda-4780-84e4-df5b4d9e8377 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 200 len: 1305 microversion: 2.1 time: 0.095788 Sep 03 21:37:37.390545 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3013/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:37 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:38.414242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:38.414948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.421986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.422474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.422912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.424107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.424562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.425018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.438272 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 HTTP/1.1 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '00302607-1fc2-44ad-a244-d289aa8bfe76'} Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:38.440513 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 404 to user: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b345ae59-9c89-4647-a852-d71aecc1f3c2 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 404 len: 111 microversion: 2.1 time: 0.032055 Sep 03 21:37:38.444999 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3241/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:38 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:38.451156 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:38.451786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.458713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.459211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.459657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.460362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.460837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.461300 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.588634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:38.597088 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d784317-13f8-4e29-9018-519146bc68f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.149757 Sep 03 21:37:38.597687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3014/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:38 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:38.620918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:38.623227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 02eba012-a3a0-4a0f-9d35-5936699176ea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.629260 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/02eba012-a3a0-4a0f-9d35-5936699176ea/action HTTP/1.1 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 32 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: {"resize": {"flavorRef": "452"}} Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '02eba012-a3a0-4a0f-9d35-5936699176ea', 'body': {'resize': {'flavorRef': '452'}}} Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:38.630800 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 404 to user: Instance 02eba012-a3a0-4a0f-9d35-5936699176ea could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c19d38ee-4403-47da-a343-13e5e0b76d50 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "POST /compute/v2.1/servers/02eba012-a3a0-4a0f-9d35-5936699176ea/action" status: 404 len: 111 microversion: 2.1 time: 0.015286 Sep 03 21:37:38.635059 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3242/6256] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:37:38 2022] POST /compute/v2.1/servers/02eba012-a3a0-4a0f-9d35-5936699176ea/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:38.640385 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:38.641150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.647834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.648332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.648785 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.649784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.650258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.650697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.668741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:38.785482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:38.793203 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2a840e31-078c-4af6-be11-08223dfd1836 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.156559 Sep 03 21:37:38.793805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3015/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:38 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:38.817232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:38.817869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.824734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.825253 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.825699 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.826385 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.826838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.827267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.954356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:38.962761 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3077088b-95fb-4952-a7a4-b0cb6f13d658 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.150001 Sep 03 21:37:38.963319 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3243/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:38 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:38.986354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bdad2168-873e-4f24-ab5f-9c4eee64481b"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:38.988655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:38.994712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.995200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.995641 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:38.996516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:38.997012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:38.997445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.025307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:39.030406 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: request: POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action HTTP/1.1 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 65 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: {"resize": {"flavorRef": "bdad2168-873e-4f24-ab5f-9c4eee64481b"}} Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: exception: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '0d282b38-4b4b-4de7-a947-0885d8551629', 'body': {'resize': {'flavorRef': 'bdad2168-873e-4f24-ab5f-9c4eee64481b'}}} Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:39.050687 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 400 to user: Flavor bdad2168-873e-4f24-ab5f-9c4eee64481b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00c653a6-3910-4cf5-bdda-c66835eab26d tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action" status: 400 len: 107 microversion: 2.1 time: 0.070632 Sep 03 21:37:39.055119 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3016/6259] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:37:38 2022] POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action => generated 107 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:37:39.061111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.061762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.068434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.068973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.069393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.070089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.070545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.070974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.205266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:39.213777 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3dbaa6c6-fd45-4373-a942-ba93102e5cb8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.156583 Sep 03 21:37:39.214344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3244/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:39 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:39.237628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.238248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.244270 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.244762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.245244 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.245949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.246409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.246845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.379936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:39.387678 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fcac2825-ce03-4ff4-b93d-d7465439b3d0 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.154683 Sep 03 21:37:39.388247 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3017/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:39 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:39.410615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0dd9d462-633e-4b7d-88d0-b0f0ba8c6391 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0dd9d462-633e-4b7d-88d0-b0f0ba8c6391 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: request: POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action HTTP/1.1 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 29 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: {"resize": {"flavorRef": ""}} Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '0d282b38-4b4b-4de7-a947-0885d8551629', 'body': {'resize': {'flavorRef': ''}}} Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise error Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi '' Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.414188 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0dd9d462-633e-4b7d-88d0-b0f0ba8c6391 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0dd9d462-633e-4b7d-88d0-b0f0ba8c6391 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action" status: 400 len: 113 microversion: 2.1 time: 0.009393 Sep 03 21:37:39.418664 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3245/6262] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:37:39 2022] POST /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 21:37:39.424712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.425357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.431269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.431757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.432203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.432944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.433395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.433826 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.566545 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:39.575133 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ff488231-e57e-4c93-96f0-e2fe0ad2c134 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1504 microversion: 2.1 time: 0.154331 Sep 03 21:37:39.575728 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3018/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:39 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:39.603272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.603783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.611801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.612294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.612738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.613469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.613931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.614365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.627521 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: request: DELETE /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 HTTP/1.1 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '00302607-1fc2-44ad-a244-d289aa8bfe76'} Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:39.629136 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 404 to user: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-771a6260-ccff-4eea-9c1d-87a1698642da tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 404 len: 111 microversion: 2.1 time: 0.031997 Sep 03 21:37:39.633350 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3246/6264] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:39 2022] DELETE /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:39.639555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.640208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 00302607-1fc2-44ad-a244-d289aa8bfe76] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.647375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.648013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.648520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.649260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.649728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.650213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.665020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 HTTP/1.1 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '00302607-1fc2-44ad-a244-d289aa8bfe76'} Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:39.666584 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 404 to user: Instance 00302607-1fc2-44ad-a244-d289aa8bfe76 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7080707f-143b-4c40-b480-fa66f7a849b8 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76" status: 404 len: 111 microversion: 2.1 time: 0.032576 Sep 03 21:37:39.670860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3019/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:39 2022] GET /compute/v2.1/servers/00302607-1fc2-44ad-a244-d289aa8bfe76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:37:39.677123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.677658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.683615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.684141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.684587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.685301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.685755 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.686180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.711271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:37:39.759376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:39.788226 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e860a577-fefc-4212-b701-51919b6e04f4 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 204 len: 0 microversion: 2.1 time: 0.115262 Sep 03 21:37:39.788754 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3247/6266] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:37:39 2022] DELETE /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:37:39.798354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:39.799211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:39.805880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.806376 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.806827 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.807556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:39.808026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:39.808488 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:39.939284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:39.947230 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1f86c945-63b5-45a4-926f-f293285aefae tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1510 microversion: 2.1 time: 0.154449 Sep 03 21:37:39.947843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3020/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:39 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:37:40.972204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:40.972938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:40.979794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:40.980282 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:40.980727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:40.981481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:40.981943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:40.982375 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:41.113859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc1b001d6c14a4c8030d9682d7a3a95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f173156588e346d481341b28d4594784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:37:41.122949 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bb7f0d08-65d2-4a6d-8e58-84cf3eca7f18 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 200 len: 1510 microversion: 2.1 time: 0.154487 Sep 03 21:37:41.122949 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3248/6268] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:40 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:37:41.574220 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d282b38-4b4b-4de7-a947-0885d8551629", "name": "network-vif-deleted", "tag": "7d335d3a-4146-4a37-bd83-c7508d034b42"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:37:41.589581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:41.590067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:41.590862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:41.603768 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] Creating event network-vif-deleted:7d335d3a-4146-4a37-bd83-c7508d034b42 for instance 0d282b38-4b4b-4de7-a947-0885d8551629 on nch2-master-1 Sep 03 21:37:41.610761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-a44f11da-b39c-4edf-be9d-55a2b70a928e req-4122f8d4-4ead-4af2-87d2-cf51652e1602 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Sep 03 21:37:41.611372 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3021/6269] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:37:42.145336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:37:42.145966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] [instance: 0d282b38-4b4b-4de7-a947-0885d8551629] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:37:42.152864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:42.153394 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:42.153842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:42.154545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:37:42.155006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:37:42.155440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:37:42.168746 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] HTTP exception thrown: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Request method failure captured: Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 HTTP/1.1 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8kHWwUSDP39JpBbsl9HJ_t1IKMPcwqIWP7CH0Lgu4rUrvgNWko9SMQ66GgPV_sEZmUG5DbKJOjXYrXi3t973vcidT1KQIAgH1o70sMcABK5qZ9AZvm_4azOMDt7vNJNvsuNWbWY7CMLbaMtCEf43s4CBJQ-dFLouOEJvTLH3pa5Co4 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f173156588e346d481341b28d4594784"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f173156588e346d481341b28d4594784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f173156588e346d481341b28d4594784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f173156588e346d481341b28d4594784 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1203597377 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 4cc1b001d6c14a4c8030d9682d7a3a95 Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-ServersNegativeTestJSON-1203597377-project Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '0d282b38-4b4b-4de7-a947-0885d8551629'} Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:37:42.170403 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] Returning 404 to user: Instance 0d282b38-4b4b-4de7-a947-0885d8551629 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f65f1639-5c2b-40de-9509-420f17e8b124 tempest-ServersNegativeTestJSON-1203597377 tempest-ServersNegativeTestJSON-1203597377-project] 10.222.0.16 "GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629" status: 404 len: 111 microversion: 2.1 time: 0.030473 Sep 03 21:37:42.175058 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3249/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:37:42 2022] GET /compute/v2.1/servers/0d282b38-4b4b-4de7-a947-0885d8551629 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 21:38:22.012280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-87c7510b-ab3d-4619-b23b-1739e8669b0a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Action: 'create', calling method: .version_select at 0x7fae66436f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-760909290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSzsBAymgxsr2Cv0uHOXfpJThlsdJCsE2MDQWNZRcBMM3//qCBIxcHjt8JGBwGVnIyEQsLJrwnj4TytajoVQB3DNpVsbKwmvdy+tqKEXNDbWQ02LnOdoHfAEMFlXxRxCg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:22.018068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:22.018717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=28 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:22.032029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-87c7510b-ab3d-4619-b23b-1739e8669b0a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:38:22.037657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-87c7510b-ab3d-4619-b23b-1739e8669b0a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for user 65b80b19aac6432f85b33c3405b26ab0 and project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:38:22.064302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-87c7510b-ab3d-4619-b23b-1739e8669b0a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056735 Sep 03 21:38:22.064929 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3022/6271] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:38:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:22.119500 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2025344973", "imageRef": "0904a5b3-1d88-415d-b430-c1aa50478431", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-760909290", "networks": [{"uuid": "92b66bb1-985c-4295-bfc7-2f786461a699"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:22.128789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:22.129611 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:22.174301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] validate_networks() for [('92b66bb1-985c-4295-bfc7-2f786461a699', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:38:22.545939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:38:22.546389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:38:22.546892 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:38:22.547303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:38:22.547746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:38:22.557082 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:22.557569 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:22.558031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:22.558738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:22.559193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:22.559618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:22.578191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:38:22.583488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for user 65b80b19aac6432f85b33c3405b26ab0 and project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:38:22.595689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:38:22.597952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0904a5b3-1d88-415d-b430-c1aa50478431',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:38:22.643327 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f856e5c3-34b2-40df-ad8c-bd4de0143db8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527707 Sep 03 21:38:22.643966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3250/6272] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:38:22.655189 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9fe5098a-15b1-4014-9093-e64d54dea389 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:22.656056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9fe5098a-15b1-4014-9093-e64d54dea389 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:22.712630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-9fe5098a-15b1-4014-9093-e64d54dea389 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:22.720220 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9fe5098a-15b1-4014-9093-e64d54dea389 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1258 microversion: 2.1 time: 0.069071 Sep 03 21:38:22.720784 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3023/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:22 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:23.746005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:23.747266 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:23.754577 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:23.755072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:23.755694 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:23.756662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:23.757153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:23.757591 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:23.852555 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:23.860773 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-562b880c-9dc2-47f6-8d95-069d8381565c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1328 microversion: 2.1 time: 0.120529 Sep 03 21:38:23.861376 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3251/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:23 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:24.884334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:24.885088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:24.892538 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:24.893058 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:24.893504 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:24.894217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:24.894676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:24.895107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:25.045298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:25.055679 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-293c7232-2952-46d6-bf8d-bdb778911027 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.175242 Sep 03 21:38:25.056357 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3024/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:24 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:26.079293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:26.080076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:26.087283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:26.087943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:26.088492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:26.089397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:26.089966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:26.090564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:26.250244 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:26.259171 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d3895a53-7486-4fc0-819c-41a617e06ca0 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.183615 Sep 03 21:38:26.276284 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3252/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:26 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:27.283339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:27.284726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:27.292627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:27.293489 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:27.294183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:27.295144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:27.295834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:27.296604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:27.440790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:27.448987 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fde2beb1-7925-46d6-b770-29b2fa50d5fa tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.169742 Sep 03 21:38:27.449588 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3025/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:27 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:28.472790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:28.473442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:28.481172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:28.482031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:28.482696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:28.483653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:28.484331 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:28.485268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:28.628490 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:28.636730 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2eada325-d99a-4202-aec8-b677a1cfb4e1 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.167880 Sep 03 21:38:28.637403 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3253/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:28 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:29.661288 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:29.662027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:29.669945 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:29.670910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:29.671470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:29.672323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:29.673040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:29.673988 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:29.821756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:29.829910 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90b1c605-7920-4c50-ac14-54b2b8588e1c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.172890 Sep 03 21:38:29.830518 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3026/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:29 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:30.856064 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:30.856727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:30.864566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:30.865093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:30.865736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:30.866459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:30.866916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:30.867465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:31.004919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:31.013688 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4f996d7f-26f7-4ae6-b4fb-52c18b2e3b7d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.161983 Sep 03 21:38:31.014295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3254/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:30 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:32.037980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:32.038596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:32.045986 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:32.046478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:32.046935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:32.047640 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:32.048113 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:32.048512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:32.196496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:32.204488 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-20f52e42-e5db-4d56-bb42-3e895db5ce3b tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.171012 Sep 03 21:38:32.205087 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3027/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:32 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:32.277728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e71693-ea80-4c58-aec3-c068ea3db13b", "tag": "65bb34ce-8ffc-4c88-9725-87b3210cfd6f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:32.288928 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:32.289440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:32.290056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:32.304097 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] Creating event network-changed:65bb34ce-8ffc-4c88-9725-87b3210cfd6f for instance 15e71693-ea80-4c58-aec3-c068ea3db13b on nch2-master-1 Sep 03 21:38:32.309124 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-a60e36e2-d5ab-4b5f-8024-2bca5582e8b5 req-503fc318-53d9-4abd-96b4-d70a4bbc7279 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036898 Sep 03 21:38:32.309753 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3255/6282] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:33.231539 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:33.232196 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:33.234274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:33.240339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:33.240833 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:33.241308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:33.242017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:33.242482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:33.242916 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:33.376531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:33.384774 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d9c3f35c-eedf-4383-bcd2-f40c926fd147 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.157154 Sep 03 21:38:33.385374 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3028/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:33 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:34.405015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:34.405802 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:34.411497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:34.412200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:34.419283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:34.419768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:34.420209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:34.420926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:34.421370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:34.421796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:34.553822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:34.561811 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-09298527-b192-4173-8b25-a20a5747fd5f tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.157553 Sep 03 21:38:34.562406 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3256/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:34 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:35.585165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:35.585790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:35.592453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:35.592973 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:35.593421 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:35.594135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:35.594594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:35.595032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:35.740802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:35.748792 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-358fdaa3-92e2-4b62-899d-56b79b59b6c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.167561 Sep 03 21:38:35.749406 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3029/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:35 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:36.771635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:36.772258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:36.779121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:36.779610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:36.780055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:36.780754 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:36.781241 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:36.781675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:37.225502 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:37.233262 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a46cf3d-3d3b-434c-b8df-966f79d0fc6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.465559 Sep 03 21:38:37.233828 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3257/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:36 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:37.565428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e71693-ea80-4c58-aec3-c068ea3db13b", "name": "network-vif-plugged", "status": "completed", "tag": "65bb34ce-8ffc-4c88-9725-87b3210cfd6f"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:37.575762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:37.576246 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:37.576681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:37.588856 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] Creating event network-vif-plugged:65bb34ce-8ffc-4c88-9725-87b3210cfd6f for instance 15e71693-ea80-4c58-aec3-c068ea3db13b on nch2-master-1 Sep 03 21:38:37.594018 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-3bbf83ee-979c-4d82-a0be-5a23f896db55 req-4fecfa84-1d94-46a7-844a-ce2df45f4d24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Sep 03 21:38:37.594621 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3030/6287] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:38.256643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:38.257293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:38.264188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:38.264622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:38.265099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:38.265796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:38.266251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:38.266678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:38.397126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:38.405015 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4218841c-32cf-4224-89ed-385e66026772 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1358 microversion: 2.1 time: 0.152112 Sep 03 21:38:38.405586 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3258/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:38 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:39.430901 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:39.431530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:39.437910 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.438405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.438856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.439560 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.440050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.440486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.568771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:39.576559 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e22665bf-ea76-4f6d-bf39-9597bc211ba4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1549 microversion: 2.1 time: 0.150934 Sep 03 21:38:39.577146 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3031/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:39 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:39.599559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:39.600176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:39.607048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.607533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.607971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.608663 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.609143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.609572 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.736242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:39.744553 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e069ce89-c448-4bd8-a714-fd9e1401d40d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1549 microversion: 2.1 time: 0.149690 Sep 03 21:38:39.745153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3259/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:39 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:39.766907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:39.771596 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:39.772369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Searching by: {'deleted': False, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900'} {{(pid=140519) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:38:39.777687 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.778168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.778606 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.779334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.779788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.780218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.803985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.multi_cell_list [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140519) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:38:39.830454 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8cb43526-d1d2-467a-81cb-2ebfa1ea8f6c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067321 Sep 03 21:38:39.831029 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3032/6291] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 21:38:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:39.842651 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:39.843263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:39.849231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.849713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.850151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.850841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:39.851299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:39.851723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:39.982845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:39.991401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9c3a4f5-5b5f-4f35-9a1b-c9c8d4d51251 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1549 microversion: 2.1 time: 0.152571 Sep 03 21:38:39.991973 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3260/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:39 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:41.511443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:41.511957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:41.519494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:41.519974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:41.520413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:41.521142 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:41.521600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:41.522033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:41.550139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:38:41.624207 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cfe2744c-a153-4bd5-8c77-d50797aade2c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 204 len: 0 microversion: 2.1 time: 0.116356 Sep 03 21:38:41.624855 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3033/6293] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:38:41 2022] DELETE /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:38:41.633900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:41.634525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:41.641548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:41.641984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:41.642437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:41.643817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:41.644281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:41.644723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:41.771878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:41.780021 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8a478afb-4834-455a-9734-d4a108387d2d tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1555 microversion: 2.1 time: 0.149725 Sep 03 21:38:41.780602 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3261/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:41 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:38:42.804934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:42.805576 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:42.812361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:42.812846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:42.813319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:42.814016 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:42.814474 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:42.815543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:42.950018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:42.957954 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac86d735-4f9e-4782-a2ea-e5d1ed7f5429 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 200 len: 1555 microversion: 2.1 time: 0.157333 Sep 03 21:38:42.958531 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3034/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:42 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:43.349586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e71693-ea80-4c58-aec3-c068ea3db13b", "name": "network-vif-deleted", "tag": "65bb34ce-8ffc-4c88-9725-87b3210cfd6f"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:43.374840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:43.375378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:43.375785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:43.394726 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] Creating event network-vif-deleted:65bb34ce-8ffc-4c88-9725-87b3210cfd6f for instance 15e71693-ea80-4c58-aec3-c068ea3db13b on nch2-master-1 Sep 03 21:38:43.400138 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-7861cbe3-c24e-454b-9902-f056cd3d8468 req-407145da-79cf-47d8-a460-b7a539f49938 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055256 Sep 03 21:38:43.401375 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3262/6296] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:43.980829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:43.981398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 15e71693-ea80-4c58-aec3-c068ea3db13b] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:43.988829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:43.989341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:43.989811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:43.990535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:43.990991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:43.991420 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:44.004642 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] HTTP exception thrown: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Request method failure captured: Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b HTTP/1.1 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8k_WTjjYS4HZAzS1sVqdTHOAx1PAACRPWtTnLhxy_gykjNAoaripRHwgefriuroZXHa9BdATR1HGygrYtigsTdb3txQCPE_ADpdr1sQMsSWx7nbGzRq6odHWfss7QfClYes_Eo-joBolztFQ9bX5txGk-QOmW9oPSom8cmBkLa8rOI Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: fd7ad842395c4865bcc994a9dc9f9900 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: fd7ad842395c4865bcc994a9dc9f9900 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestMinimumBasicScenario-746967112-project Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 65b80b19aac6432f85b33c3405b26ab0 Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestMinimumBasicScenario-746967112-project Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '15e71693-ea80-4c58-aec3-c068ea3db13b'} Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:38:44.006330 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Returning 404 to user: Instance 15e71693-ea80-4c58-aec3-c068ea3db13b could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c90c7c6-3fbb-45e6-9c03-e4a78656c512 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b" status: 404 len: 111 microversion: 2.1 time: 0.031053 Sep 03 21:38:44.011466 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3035/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:43 2022] GET /compute/v2.1/servers/15e71693-ea80-4c58-aec3-c068ea3db13b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:38:44.019326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b11b71a-8b76-4b81-9930-65fc16a6fa94 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '.version_select at 0x7fae65f7b820>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:44.039332 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b11b71a-8b76-4b81-9930-65fc16a6fa94 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-760909290" status: 202 len: 0 microversion: 2.1 time: 0.025983 Sep 03 21:38:44.040057 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3263/6298] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Sep 3 21:38:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-760909290 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:38:53.043059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e2f087f2-c824-4e7a-8d4d-489024d33fd2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Action: 'create', calling method: .version_select at 0x7fae66307c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2144034335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9E3B1lCpzZq4I5gCOSBUYVU0Kz6MLTJiQJ08reeJvJ5JL8GFZQ6jo6IJG6/HG3XkD4mObUuK88dCSjvGg/nutVweKO0yxnE0Vc9tPRkS6HiTwtIA92/sm8zNkM9rxQWw=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:53.049527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:53.050863 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:53.066533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e2f087f2-c824-4e7a-8d4d-489024d33fd2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:38:53.071753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e2f087f2-c824-4e7a-8d4d-489024d33fd2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for user 65b80b19aac6432f85b33c3405b26ab0 and project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:38:53.095002 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e2f087f2-c824-4e7a-8d4d-489024d33fd2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055955 Sep 03 21:38:53.095595 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3036/6299] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:38:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:38:53.149459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-274003", "imageRef": "514481db-b228-47d0-b9d7-b7accaba947d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2144034335", "networks": [{"uuid": "92b66bb1-985c-4295-bfc7-2f786461a699"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:38:53.161073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:53.205956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] validate_networks() for [('92b66bb1-985c-4295-bfc7-2f786461a699', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:38:53.383862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=66 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:53.578845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:38:53.579267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:38:53.579770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:38:53.580180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:38:53.580621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:38:53.589418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:53.589899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:53.590336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:53.591063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:53.591511 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:53.591933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:53.608830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:38:53.614921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Getting quotas for user 65b80b19aac6432f85b33c3405b26ab0 and project fd7ad842395c4865bcc994a9dc9f9900. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:38:53.627397 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:38:53.629752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='514481db-b228-47d0-b9d7-b7accaba947d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:38:53.674649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7262468-bd25-4992-b3c3-4595182688c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530629 Sep 03 21:38:53.675500 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3264/6300] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:38:53.687451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1986bf45-7cfc-4995-ac8c-4b2f8401bcb8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:53.688076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1986bf45-7cfc-4995-ac8c-4b2f8401bcb8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:53.756656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1986bf45-7cfc-4995-ac8c-4b2f8401bcb8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:53.765662 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1986bf45-7cfc-4995-ac8c-4b2f8401bcb8 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1255 microversion: 2.1 time: 0.082161 Sep 03 21:38:53.766598 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3037/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:53 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1255 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:54.790919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:54.791542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:54.800086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:54.800585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:54.801541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:54.801795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:54.802510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:54.802957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:54.906975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:54.915415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-66aad656-bed6-478e-8071-90d0d35333e6 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1325 microversion: 2.1 time: 0.129277 Sep 03 21:38:54.916211 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3265/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:54 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1325 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:38:55.939011 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:55.940098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:55.942525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:55.950660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:55.951161 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:55.951613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:55.952511 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:55.953017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:55.953459 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:56.098518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:56.107675 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffe1c498-b7d1-4c0e-8b36-4152895c47c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.172579 Sep 03 21:38:56.108269 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3038/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:55 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:57.131842 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:57.133147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:57.141309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:57.141995 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:57.143041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:57.143768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:57.144236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:57.144672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:57.302106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:57.309971 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4eda127b-ac37-4e53-9a99-33fee6a9329c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.182103 Sep 03 21:38:57.310548 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3266/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:57 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:58.334964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:58.335892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:58.343567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:58.344061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:58.344505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:58.345259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:58.345748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:58.346180 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:58.540982 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:58.550653 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd07f25f-2849-40c4-9eb9-7647a38e11c5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.220672 Sep 03 21:38:58.551467 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3039/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:58 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:38:59.574783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:38:59.575449 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:38:59.582441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:59.582932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:59.583372 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:59.584080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:38:59.584535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:38:59.584990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:38:59.723936 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:38:59.733842 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-39631d45-42c5-4532-b459-e2df6f19f384 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.162749 Sep 03 21:38:59.735221 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3267/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:38:59 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:00.758411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:00.759065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:00.767605 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:00.768099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:00.768543 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:00.769284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:00.769742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:00.770174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:00.911736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:00.919628 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ed9d4688-f8fe-4fea-b41b-e7a962dceb43 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.165163 Sep 03 21:39:00.920201 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3040/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:00 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:01.944125 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:01.944933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:01.952248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:01.952731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:01.953199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:01.953903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:01.954361 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:01.954793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:02.093617 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:02.101804 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cdddb616-aa23-4ae6-b58d-fd6f8a8617b5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.161594 Sep 03 21:39:02.102399 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3268/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:01 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:03.125820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:03.126381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:03.132708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:03.133229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:03.133676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:03.134390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:03.134851 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:03.135284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:03.276533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:03.284313 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-17e9bb98-4974-4b09-8fb0-5f9c8fad1cfd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.162631 Sep 03 21:39:03.284938 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3041/6309] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:03 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:03.434977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ea3331-3b01-4dde-8225-90b787a7efea", "tag": "cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:03.447249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:03.448008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:03.448450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:03.460758 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] Creating event network-changed:cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2 for instance 76ea3331-3b01-4dde-8225-90b787a7efea on nch2-master-1 Sep 03 21:39:03.465713 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-15e0b461-2aa1-44b2-83a2-9443604d487a req-d7a54e01-fb73-470a-b3ab-f48198bf1dc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034618 Sep 03 21:39:03.466326 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3269/6310] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:04.309473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:04.310461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:04.313514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:04.321683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:04.322170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:04.322613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:04.323315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:04.323787 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:04.324211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:04.453410 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:04.461490 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-97f4bb56-5510-4840-a188-a225e9d0f316 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.156557 Sep 03 21:39:04.462060 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3042/6311] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:04 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:39:05.482514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:05.483444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:05.489053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:05.489757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:05.496828 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:05.497335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:05.497777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:05.498464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:05.498918 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:05.499357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:05.630539 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:05.638195 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56af109e-0407-452d-a2af-5df75c5a9ea4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.156606 Sep 03 21:39:05.638756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3270/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:05 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:06.661321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:06.661934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:06.668779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:06.669295 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:06.669737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:06.670430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:06.670883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:06.671309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:06.807610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:06.815989 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-324d59f8-0243-4818-bd46-a38f67abad41 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.158012 Sep 03 21:39:06.816549 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3043/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:06 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:07.839213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:07.839853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:07.846792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:07.847815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:07.848270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:07.848975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:07.849486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:07.849859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:07.984513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:07.993209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8315ee3d-052f-4552-9421-0f38864eb6d5 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.157914 Sep 03 21:39:07.993799 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3271/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:07 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:09.016018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:09.016632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:09.024109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:09.024595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:09.025072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:09.025772 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:09.026230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:09.026660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:09.160307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:09.168074 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21e35334-9eb1-4ecd-9a4a-4a9ce468c95a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.156003 Sep 03 21:39:09.168642 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3044/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:09 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:09.769325 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ea3331-3b01-4dde-8225-90b787a7efea", "name": "network-vif-plugged", "status": "completed", "tag": "cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:09.780803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:09.781491 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:09.781965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:09.793667 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] Creating event network-vif-plugged:cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2 for instance 76ea3331-3b01-4dde-8225-90b787a7efea on nch2-master-1 Sep 03 21:39:09.798676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-45c3e367-4e8d-4aa8-a4ec-a5546cd713f4 req-4d36f198-bf35-45ba-8ed1-dbd595280b04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Sep 03 21:39:09.799474 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3272/6316] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:10.190931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:10.191553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:10.198530 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:10.199023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:10.199466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:10.200164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:10.200623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:10.201093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:10.332345 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:10.340422 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1dd07d67-4162-4fe1-a372-0cab81a366c2 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1355 microversion: 2.1 time: 0.153367 Sep 03 21:39:10.341019 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3045/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:10 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1355 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:11.364988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:11.365686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:11.372756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.373279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.373727 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.374418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.374873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.375301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.506373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:11.514182 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a9800946-b7da-4d10-b570-ac449a4ca407 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1545 microversion: 2.1 time: 0.154344 Sep 03 21:39:11.514781 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3273/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:11 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:11.537068 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:11.537694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:11.545024 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.545515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.545959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.547213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.547686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.548119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.677681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:11.685429 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8628d3af-33cf-41e0-af88-688134fab56a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1545 microversion: 2.1 time: 0.152777 Sep 03 21:39:11.685998 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3046/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:11 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:11.708559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:11.713180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:11.713956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Searching by: {'deleted': False, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900'} {{(pid=140520) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 21:39:11.719248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.719732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.720172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.720913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.721382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.721838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.745438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.multi_cell_list [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 21:39:11.772558 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-450e0dc4-3b45-46bb-826e-7f06e67e991e tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.068467 Sep 03 21:39:11.773168 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3274/6320] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Sep 3 21:39:11 2022] GET /compute/v2.1/servers => generated 339 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:11.784859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:11.785607 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:11.791820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.792309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.792753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.793620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:11.794086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:11.794520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:11.923728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:11.932125 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2d9b49ab-4c19-4dfb-9121-52052b269cd4 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1545 microversion: 2.1 time: 0.151143 Sep 03 21:39:11.932705 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3047/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:11 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1545 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:13.410453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:13.410948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:13.417819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:13.418309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:13.418747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:13.419433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:13.419886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:13.420310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:13.445762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:39:13.522551 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-63c9d6da-e3fe-4faf-9349-f1a67b101226 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "DELETE /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 204 len: 0 microversion: 2.1 time: 0.115400 Sep 03 21:39:13.523536 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3275/6322] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:39:13 2022] DELETE /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:39:13.532525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:13.533462 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:13.541208 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:13.541714 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:13.542238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:13.542954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:13.543418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:13.543855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:13.672361 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:13.680104 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c58913cf-b045-4405-b3b8-7204e8ec497c tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1551 microversion: 2.1 time: 0.152348 Sep 03 21:39:13.680687 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3048/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:13 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:39:14.704111 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:14.704827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:14.713153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:14.713649 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:14.714095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:14.714795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:14.715288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:14.715720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:14.910377 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65b80b19aac6432f85b33c3405b26ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd7ad842395c4865bcc994a9dc9f9900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:14.918451 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c356943-bdee-4397-8a57-cdd9534c50cd tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 200 len: 1551 microversion: 2.1 time: 0.218513 Sep 03 21:39:14.919053 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3276/6324] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:14 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 1551 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:15.291955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ea3331-3b01-4dde-8225-90b787a7efea", "name": "network-vif-deleted", "tag": "cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:15.303433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:15.303859 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:15.304290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:15.316646 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] Creating event network-vif-deleted:cc26528c-9a0e-49e6-a8d4-dbd84d8e00a2 for instance 76ea3331-3b01-4dde-8225-90b787a7efea on nch2-master-1 Sep 03 21:39:15.322219 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-798947e7-43d4-4fce-bd68-405920c3afa7 req-1635423c-2476-43a7-845f-5b7a40d403b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033919 Sep 03 21:39:15.325874 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3049/6325] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:15.942540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:15.943172 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] [instance: 76ea3331-3b01-4dde-8225-90b787a7efea] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:15.950212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:15.950709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:15.951160 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:15.951866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:15.952329 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:15.952767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:15.969337 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] HTTP exception thrown: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Request method failure captured: Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea HTTP/1.1 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8k_WTjjYS4HZAzS1sVqdTHOAx1PAACRPWtTnLhxy_gykjNAoaripRHwgefriuroZXHa9BdATR1HGygrYtigsTdb3txQCPE_ADpdr1sQMsSWx7nbGzRq6odHWfss7QfClYes_Eo-joBolztFQ9bX5txGk-QOmW9oPSom8cmBkLa8rOI Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: fd7ad842395c4865bcc994a9dc9f9900 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd7ad842395c4865bcc994a9dc9f9900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: fd7ad842395c4865bcc994a9dc9f9900 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestMinimumBasicScenario-746967112 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestMinimumBasicScenario-746967112-project Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 65b80b19aac6432f85b33c3405b26ab0 Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestMinimumBasicScenario-746967112-project Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '76ea3331-3b01-4dde-8225-90b787a7efea'} Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:39:15.970977 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Returning 404 to user: Instance 76ea3331-3b01-4dde-8225-90b787a7efea could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dad65d2b-1dc6-4314-897d-cb5c2858950a tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea" status: 404 len: 111 microversion: 2.1 time: 0.034430 Sep 03 21:39:15.976261 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3277/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:15 2022] GET /compute/v2.1/servers/76ea3331-3b01-4dde-8225-90b787a7efea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:39:15.982416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-21f2f690-358a-43c1-9adf-40cc543b8256 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] Calling method '.version_select at 0x7fae66307a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:16.002266 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-21f2f690-358a-43c1-9adf-40cc543b8256 tempest-TestMinimumBasicScenario-746967112 tempest-TestMinimumBasicScenario-746967112-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2144034335" status: 202 len: 0 microversion: 2.1 time: 0.024039 Sep 03 21:39:16.002832 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3050/6327] 10.222.0.16 () {58 vars in 1272 bytes} [Sat Sep 3 21:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2144034335 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 21:39:24.970777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:25.144219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2872812c-aa17-4762-adb3-c29c72bebdfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: .version_select at 0x7fae65c93160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1444522930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLT1ZRypGl8YRgR7XrUIvqLap9Fezurl5i6B8fHEsvfxrN4iZ2kMQ2OD3Lp1wKsJhxJe+6Cr8Fko2PrNrKabI9WCxnaDu5AW37znOI1gRYSmdBj7emnWoDnTt6VDW+XFg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:25.149643 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:25.162513 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2872812c-aa17-4762-adb3-c29c72bebdfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:39:25.171464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-2872812c-aa17-4762-adb3-c29c72bebdfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:39:25.195984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2872812c-aa17-4762-adb3-c29c72bebdfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.230397 Sep 03 21:39:25.196578 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3278/6328] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:39:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:30.781330 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=68 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:30.782537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:30.786913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1737097132", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "cb6e387a-2c49-407b-87aa-a6b8d5632ccf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1444522930", "security_groups": [{"name": "tempest-secgroup-smoke-1497090024"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:30.916240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] validate_networks() for [('cb6e387a-2c49-407b-87aa-a6b8d5632ccf', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:39:31.444642 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:39:31.445368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:39:31.446852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:39:31.447786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:39:31.448666 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:39:31.459836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:31.460415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:31.460872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:31.461780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:31.462317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:31.462819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:31.480839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:39:31.486447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:39:31.499472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:39:31.501908 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:39:31.551908 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e0a86cf3-3ae7-41b9-83fb-eb67e9347bc7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772628 Sep 03 21:39:31.552847 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3051/6329] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:39:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:39:31.561193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:31.566492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0c4eb3b2-c35e-43d0-bef0-acb5d69b54e0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:31.567104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0c4eb3b2-c35e-43d0-bef0-acb5d69b54e0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:31.657615 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0c4eb3b2-c35e-43d0-bef0-acb5d69b54e0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:31.667450 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0c4eb3b2-c35e-43d0-bef0-acb5d69b54e0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1267 microversion: 2.1 time: 0.106786 Sep 03 21:39:31.676193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3279/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:31 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:32.692935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:32.693565 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:32.701751 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:32.702552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:32.703507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:32.703725 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:32.704397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:32.704836 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:32.789665 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:32.798745 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-74cac83d-95e1-4269-96d0-904cf904bf59 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1327 microversion: 2.1 time: 0.111358 Sep 03 21:39:32.799797 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3052/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:32 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:33.824194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:33.824818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:33.832943 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:33.833445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:33.833891 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:33.834606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:33.835068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:33.835505 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:34.003459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:34.012148 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3558fff3-b9f8-4c1f-9de3-80e94c78ec0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.191834 Sep 03 21:39:34.012732 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3280/6332] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:33 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:34.222829 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3579dd-5c99-4aae-8416-8e7b6a706674", "tag": "feeceff8-7038-453e-ba7a-dfd656bf53b5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:34.234809 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:34.236135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:34.236749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:34.248927 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] Creating event network-changed:feeceff8-7038-453e-ba7a-dfd656bf53b5 for instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 on nch1-master-1 Sep 03 21:39:34.255157 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-304907c9-4127-4363-bfad-5b57deb7fffd req-06a132db-649c-4f7c-b023-fccc11b2d889 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037387 Sep 03 21:39:34.255909 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3053/6333] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:35.042488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:35.043044 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:35.050689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:35.051170 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:35.051608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:35.052297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:35.052746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:35.053195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:35.184888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:35.192676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a83861e4-bd38-4957-8364-91df866a2c99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.154146 Sep 03 21:39:35.193352 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3281/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:35 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:36.217227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:36.217954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:36.224911 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:36.225403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:36.225846 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:36.226546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:36.227003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:36.227434 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:36.361237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:36.369079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07cb7d96-2462-437e-8462-ce28f417a5b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.157043 Sep 03 21:39:36.369589 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3054/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:36 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:37.392192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:37.392838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:37.399734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:37.400222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:37.400662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:37.401705 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:37.402164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:37.402592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:37.538041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:37.545706 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ac8dd450-1a14-4c45-9ec1-379006f198a6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.157936 Sep 03 21:39:37.546273 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3282/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:37 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:38.570051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:38.570673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:38.578168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:38.578657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:38.579097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:38.579796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:38.580253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:38.580683 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:38.717811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:38.725876 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91cba3d4-8678-47b8-aa8f-7cd9ec322379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.160524 Sep 03 21:39:38.726442 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3055/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:38 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:39.748818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:39.749471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:39.756981 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:39.757463 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:39.757902 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:39.758593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:39.759048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:39.759475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:39.887858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:39.895796 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-91e47f8c-011c-4a3a-ad1c-57d8c10255f9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.150901 Sep 03 21:39:39.896377 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3283/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:39 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:40.919779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:40.920392 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:40.928040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:40.928536 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:40.929001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:40.929712 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:40.930168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:40.930595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:40.961966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3579dd-5c99-4aae-8416-8e7b6a706674", "name": "network-vif-plugged", "status": "completed", "tag": "feeceff8-7038-453e-ba7a-dfd656bf53b5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:40.974060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:40.974625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:40.975134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:40.987195 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] Creating event network-vif-plugged:feeceff8-7038-453e-ba7a-dfd656bf53b5 for instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 on nch1-master-1 Sep 03 21:39:40.993258 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-51fe26f4-334c-46fb-8552-745d178b8f62 req-1c8f334b-f0c0-480d-9629-a5962edb4492 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035549 Sep 03 21:39:40.994176 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3284/6339] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:41.075332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:41.084431 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-44f003cd-9edd-4183-95c3-5dce17f36ea2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.168118 Sep 03 21:39:41.085074 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3056/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:40 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:42.105071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:42.110398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:42.111105 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:42.118197 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:42.118689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:42.119355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:42.120074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:42.120534 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:42.120989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:42.252849 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:42.260713 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8070a84b-c7e0-4b66-9fef-b13624267eb1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1393 microversion: 2.1 time: 0.156666 Sep 03 21:39:42.261313 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3285/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:42 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:43.283651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:43.284267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:43.286316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:43.287103 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:43.293895 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:43.294386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:43.294835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:43.295556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:43.296005 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:43.296442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:43.426022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:43.433861 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fd41180c-ac35-405b-a600-179fa59bde77 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1566 microversion: 2.1 time: 0.154153 Sep 03 21:39:43.434433 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3057/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:43 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:43.456074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:43.456692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:43.463504 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:43.463992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:43.464437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:43.465177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:43.465638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:43.466072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:43.603625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:43.611698 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7d36ba9f-979f-475f-8e27-bf4bf7c27045 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1566 microversion: 2.1 time: 0.159457 Sep 03 21:39:43.612284 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3286/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:43 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:39:45.183099 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3579dd-5c99-4aae-8416-8e7b6a706674", "tag": "feeceff8-7038-453e-ba7a-dfd656bf53b5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:39:45.187921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:39:45.188620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:39:45.201117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:45.201619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:45.202073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:45.202786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:45.203258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:45.203691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:45.212066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:39:45.212584 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:39:45.213283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:39:45.230318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] Creating event network-changed:feeceff8-7038-453e-ba7a-dfd656bf53b5 for instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 on nch1-master-1 Sep 03 21:39:45.236251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-5438e209-933d-4977-96fb-79a3bcdb05a5 req-9861a4d3-0767-4f8c-8e75-4149b73c1a3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056772 Sep 03 21:39:45.236979 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3287/6344] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:39:45.413057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:39:45.421522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fecdc22b-f770-4918-8a08-249c39d91c56 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1566 microversion: 2.1 time: 0.245011 Sep 03 21:39:45.422106 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3058/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:39:45 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:18.714653 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:18.715414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=40 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:18.719980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:18.722283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:18.730267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:18.730764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:18.731214 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:18.731919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:18.732382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:18.732817 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:18.808514 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-085d796c-4658-4fac-a1b3-90220b31a3e2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action" status: 200 len: 24565 microversion: 2.1 time: 0.095733 Sep 03 21:40:18.809193 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3288/6346] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:40:18 2022] POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action => generated 24565 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:40:49.027697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:49.028454 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=40 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:49.033198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:49.033736 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:49.041660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:49.042184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:49.042626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:49.043322 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:49.043774 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:49.044199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:49.109930 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-13510aef-33d1-4737-abab-feabfe5654c9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action" status: 202 len: 0 microversion: 2.1 time: 0.083825 Sep 03 21:40:49.110898 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3059/6347] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:40:49 2022] POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:40:49.122354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:49.123549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:49.127948 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:49.128725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:49.135847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:49.135962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:49.136332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:49.137084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:49.137551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:49.137986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:49.332984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:49.341467 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d414d6b2-3a27-4241-a6c8-61e7e2fec9bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1689 microversion: 2.1 time: 0.223481 Sep 03 21:40:49.342063 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3289/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:49 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:50.369082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:50.369794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:50.376098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:50.376598 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:50.377082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:50.377794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:50.378258 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:50.378695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:50.564293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:50.572161 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d081b835-ff91-48eb-bcd0-3f6bfb265042 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1669 microversion: 2.1 time: 0.209772 Sep 03 21:40:50.572731 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3060/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:50 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:51.670149 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:51.672335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:51.679624 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.680116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.680563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.681295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.681757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.682190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.750449 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b138427-5a7f-4170-a74f-e78fd4576dd5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action" status: 200 len: 32640 microversion: 2.1 time: 0.084256 Sep 03 21:40:51.755998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3290/6350] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:40:51 2022] POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action => generated 32640 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:40:51.762847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:51.763426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:51.770542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.771034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.771481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.772182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.772646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.773117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.837576 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aab1e07d-c891-4810-990c-0454432259a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action" status: 202 len: 0 microversion: 2.1 time: 0.078495 Sep 03 21:40:51.838208 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3061/6351] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:40:51 2022] POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:40:51.847365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:51.848102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:51.855416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.855900 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.856341 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.857157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:51.857618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:51.858046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:51.991001 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:51.999173 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c1584446-0a0f-4f72-81fc-dccb356f4bef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1676 microversion: 2.1 time: 0.156341 Sep 03 21:40:51.999739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3291/6352] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:51 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:53.025268 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:53.025980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:53.032170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:53.032668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:53.033146 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:53.033850 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:53.034310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:53.034742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:53.487033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:53.495397 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ae0b6ade-694a-49fd-b80b-2333612ed256 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1684 microversion: 2.1 time: 0.475919 Sep 03 21:40:53.495962 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3062/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:53 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1684 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:53.591830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:53.594079 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:53.601709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:53.602190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:53.602632 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:53.603323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:53.603778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:53.604204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:53.665172 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-442c845a-d407-45e3-b143-43e83d724787 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action" status: 200 len: 38415 microversion: 2.1 time: 0.077054 Sep 03 21:40:53.665808 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3292/6354] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:40:53 2022] POST /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674/action => generated 38415 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:40:54.938763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:54.939269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:54.947127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:54.947701 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:54.948214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:54.949032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:54.949564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:54.950092 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:54.979073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:40:55.012142 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3579dd-5c99-4aae-8416-8e7b6a706674", "tag": "feeceff8-7038-453e-ba7a-dfd656bf53b5"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:55.026337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:55.026724 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:55.027388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:55.038998 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] Creating event network-changed:feeceff8-7038-453e-ba7a-dfd656bf53b5 for instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 on nch1-master-1 Sep 03 21:40:55.043959 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-358dc775-233e-4b69-9b41-3c095e19fbfe req-30edfea3-3799-40da-8ed6-3aa7d7c145ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098973 Sep 03 21:40:55.044583 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3293/6355] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:40:55.063398 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3fb099a3-0c96-4e5d-8f14-b20ca3d4d64c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 204 len: 0 microversion: 2.1 time: 0.128132 Sep 03 21:40:55.064277 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3063/6356] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:40:54 2022] DELETE /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:40:55.074189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:55.074913 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:55.081176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:55.081881 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:55.082398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:55.083135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:55.083594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:55.084022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:55.227284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:55.235192 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6903bfa0-db6f-4f42-8957-764d60743ff4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1690 microversion: 2.1 time: 0.165400 Sep 03 21:40:55.236031 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3294/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:55 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:56.261893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:56.262594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:56.269393 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:56.269881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:56.270318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:56.271010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:56.271468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:56.272578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:56.429975 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:56.437865 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b02bbf4a-9868-4ae6-9d0a-5b1b4838dc82 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1690 microversion: 2.1 time: 0.180233 Sep 03 21:40:56.438438 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3064/6358] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:56 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:57.462528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:57.463148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:57.470021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:57.470514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:57.470947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:57.471917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:57.472616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:57.473229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:57.538223 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:40:57.547014 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-104baa87-48ce-41cb-bf63-c234aa266aaa tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 200 len: 1504 microversion: 2.1 time: 0.088880 Sep 03 21:40:57.547610 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3295/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:57 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 1504 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:40:57.612705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3579dd-5c99-4aae-8416-8e7b6a706674", "name": "network-vif-deleted", "tag": "feeceff8-7038-453e-ba7a-dfd656bf53b5"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:40:57.624085 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:57.624573 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:57.625041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:57.637521 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] Creating event network-vif-deleted:feeceff8-7038-453e-ba7a-dfd656bf53b5 for instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 on nch1-master-1 Sep 03 21:40:57.642573 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-415583d6-13cd-467c-9b87-99d461f82eed req-8992e527-c516-4478-8766-624eb1c130e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Sep 03 21:40:57.643174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3065/6360] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:40:58.572357 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:40:58.573011 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 6e3579dd-5c99-4aae-8416-8e7b6a706674] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:40:58.579868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:58.580353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:58.580794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:58.581585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:40:58.582042 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:40:58.582472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:40:58.596501 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] HTTP exception thrown: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Request method failure captured: Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 HTTP/1.1 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8mMfuUq0a7B7AEY-Ngn84UZHMIBqTCw9leqOZaTdRfW6H7ezy2djfbUBWgonLxlNCRNR0__0tXsB8d9J9qbr8gtD35u_Zz5xlsFmmS1PTUhI0FHhNSJ2wH9a8UzWEXoefts8CN0HtJCOg72NSRDNqw5bTFJ5iIA-eSMrjHTsgGX3cQ Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 22d9a2cf58104e3988e468a329eb6b80 Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '6e3579dd-5c99-4aae-8416-8e7b6a706674'} Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:40:58.598178 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Returning 404 to user: Instance 6e3579dd-5c99-4aae-8416-8e7b6a706674 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0cd4e30-b639-48ce-938f-13675103fd83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674" status: 404 len: 111 microversion: 2.1 time: 0.031150 Sep 03 21:40:58.603506 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3296/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:40:58 2022] GET /compute/v2.1/servers/6e3579dd-5c99-4aae-8416-8e7b6a706674 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:41:01.532702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2b1b42a6-ed84-4826-9023-280ac53a0706 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '.version_select at 0x7fae66307a60>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:01.552751 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2b1b42a6-ed84-4826-9023-280ac53a0706 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1444522930" status: 202 len: 0 microversion: 2.1 time: 0.025448 Sep 03 21:41:01.553812 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3066/6362] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Sep 3 21:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1444522930 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:41:01.579689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ebb79b70-e558-497d-ad66-eec41864f2e4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: .version_select at 0x7fae65f5c4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1809428312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG3FmuY7bXvQx+tM+ZYGQ0xjnJOQU+FvBSDySJDAohIBoCav3uW8lGZq3RP/gwKckkukCRWyTSEt3FhlDH+M969WPQpv73VIN6hMimHXJZqZoE7OZk9cH5DdwWXkz1ow=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:01.596837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ebb79b70-e558-497d-ad66-eec41864f2e4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:41:01.602832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-ebb79b70-e558-497d-ad66-eec41864f2e4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:41:01.626763 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ebb79b70-e558-497d-ad66-eec41864f2e4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051010 Sep 03 21:41:01.627344 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3297/6363] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:41:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:41:07.455353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1368853372", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "b72d732d-7dfe-4421-bb4d-64c00587ee19"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1809428312", "security_groups": [{"name": "tempest-secgroup-smoke-1938528889"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:07.581326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] validate_networks() for [('b72d732d-7dfe-4421-bb4d-64c00587ee19', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:41:07.630327 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:07.988411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:41:07.989056 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:41:07.989603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:41:07.990285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:41:07.991482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:41:08.002151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:08.002723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:08.003358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:08.004212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:08.004765 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:08.005495 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:08.028280 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:41:08.034190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:41:08.047738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:41:08.050301 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:41:08.100960 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7a6d3ef8-1cd2-407d-8d63-928f2436abeb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650562 Sep 03 21:41:08.101874 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3067/6364] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:41:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:41:08.114029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a4461586-0c68-43f4-bb10-801649977eb4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:08.116174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a4461586-0c68-43f4-bb10-801649977eb4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:08.171903 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a4461586-0c68-43f4-bb10-801649977eb4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:08.179701 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a4461586-0c68-43f4-bb10-801649977eb4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1267 microversion: 2.1 time: 0.070205 Sep 03 21:41:08.180207 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3298/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:08 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:09.203681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-63b22cca-a213-46ca-8ca2-130cbe9d6078 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:09.204307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-63b22cca-a213-46ca-8ca2-130cbe9d6078 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:09.267084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-63b22cca-a213-46ca-8ca2-130cbe9d6078 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:09.274355 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-63b22cca-a213-46ca-8ca2-130cbe9d6078 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1267 microversion: 2.1 time: 0.075779 Sep 03 21:41:09.275127 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3068/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:09 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:10.297303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8c6142a4-eacc-4e58-9d05-20ec12f4377a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:10.298018 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8c6142a4-eacc-4e58-9d05-20ec12f4377a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:10.300175 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=36 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:10.359425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8c6142a4-eacc-4e58-9d05-20ec12f4377a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:10.371709 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8c6142a4-eacc-4e58-9d05-20ec12f4377a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1267 microversion: 2.1 time: 0.078438 Sep 03 21:41:10.372295 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3299/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:10 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:11.394266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-16ca10c3-03ec-461a-8880-6347a1b41b2c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:11.394802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-16ca10c3-03ec-461a-8880-6347a1b41b2c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:11.449759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-16ca10c3-03ec-461a-8880-6347a1b41b2c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:11.456698 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-16ca10c3-03ec-461a-8880-6347a1b41b2c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1267 microversion: 2.1 time: 0.066473 Sep 03 21:41:11.457296 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3069/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:11 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:12.480131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:12.480756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:12.488022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:12.488510 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:12.489003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:12.489695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:12.490157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:12.491249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:12.550833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:12.559151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ecc99122-42a9-490e-bd36-5d49c0cba703 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1271 microversion: 2.1 time: 0.082930 Sep 03 21:41:12.559761 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3300/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:12 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:13.582403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:13.582935 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:13.590830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:13.591316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:13.591754 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:13.592446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:13.592913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:13.593358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:13.659614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:13.667879 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dda69484-5d9b-45ac-bc46-ded5d8915890 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1325 microversion: 2.1 time: 0.089499 Sep 03 21:41:13.668458 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3070/6370] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:13 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:14.556429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3c466-0ca6-421b-a258-4db256cd2238", "tag": "20dc0ab5-5da7-4954-bd75-8e9987e1d28b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:14.570144 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:14.570773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:14.571767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:14.583470 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] Creating event network-changed:20dc0ab5-5da7-4954-bd75-8e9987e1d28b for instance bdb3c466-0ca6-421b-a258-4db256cd2238 on nch2-master-1 Sep 03 21:41:14.588550 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b34e3d24-cdc1-47b9-a367-3d181d0f9a6f req-288ef26b-2e61-4068-a32a-05dbf7eec922 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036335 Sep 03 21:41:14.589415 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3301/6371] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:41:14.691994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:14.692614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:14.700276 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:14.700776 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:14.701317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:14.701967 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:14.702437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:14.702873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:14.838508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:14.846461 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e5dc7f99-9533-4a43-ac66-ce4b646a2352 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.158553 Sep 03 21:41:14.847040 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3071/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:14 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:15.872237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:15.872977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:15.879224 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:15.879715 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:15.880192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:15.880933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:15.881562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:15.882006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:16.119729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:16.127886 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e7309941-9bd3-44c3-a519-4f5dfa46d8ad tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.260725 Sep 03 21:41:16.128488 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3302/6373] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:15 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:41:17.155792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:17.156406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:17.163439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:17.163926 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:17.164370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:17.165106 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:17.165595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:17.166025 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:17.295663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:17.303389 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0f597344-8c71-4d4c-b69c-e8b31a3678fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.151540 Sep 03 21:41:17.303973 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3072/6374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:17 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:18.327371 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:18.327989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:18.334941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:18.335425 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:18.335868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:18.336561 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:18.337038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:18.337476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:18.468146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:18.476589 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f95c3ab3-e86c-49b1-997b-7504a517ac83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.153058 Sep 03 21:41:18.477421 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3303/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:18 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:19.500359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:19.501006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:19.502915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:19.504428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:19.513181 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:19.513678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:19.514122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:19.514822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:19.515281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:19.515717 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:19.653493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:19.661175 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3e54dd53-55fd-4562-b351-caac17db6120 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.164728 Sep 03 21:41:19.661744 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3073/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:19 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:20.497122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3c466-0ca6-421b-a258-4db256cd2238", "name": "network-vif-plugged", "status": "completed", "tag": "20dc0ab5-5da7-4954-bd75-8e9987e1d28b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:20.503346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=8 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:20.504122 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:20.511108 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:20.511589 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:20.512021 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:20.523923 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] Creating event network-vif-plugged:20dc0ab5-5da7-4954-bd75-8e9987e1d28b for instance bdb3c466-0ca6-421b-a258-4db256cd2238 on nch2-master-1 Sep 03 21:41:20.529155 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e6791730-ec41-4f24-ab87-6a831aa083c8 req-e6c658b8-4c87-4df9-9e13-44d77184da6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035728 Sep 03 21:41:20.529880 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3304/6377] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:41:20.684078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:20.684741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:20.691611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:20.692101 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:20.692544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:20.693915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:20.694391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:20.694828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:20.823225 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:20.830985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0d520a5c-4ca2-46fb-975b-d8fcc1218de8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1393 microversion: 2.1 time: 0.150794 Sep 03 21:41:20.831558 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3074/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:20 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:21.855730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:21.856431 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:21.863056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:21.863544 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:21.863988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:21.864686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:21.865176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:21.865604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:21.996143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:22.003981 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-56d9ed6d-ce82-4f4f-b3b7-4235f5568d0d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1565 microversion: 2.1 time: 0.153234 Sep 03 21:41:22.004595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3305/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:21 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:22.027682 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:22.028320 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:22.030235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:22.036623 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:22.037780 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:22.038239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:22.038947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:22.039412 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:22.039849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:22.178753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:22.186886 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-865d3091-6e8d-43b4-8f78-afff2a028b70 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1565 microversion: 2.1 time: 0.163164 Sep 03 21:41:22.187488 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3075/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:22 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:23.748302 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:23.749041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:23.750915 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3c466-0ca6-421b-a258-4db256cd2238", "tag": "20dc0ab5-5da7-4954-bd75-8e9987e1d28b"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:23.756453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:23.756969 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:23.757590 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:23.758896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:23.760040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:23.760482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:23.763105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:23.763802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:23.764252 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:23.777105 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] Creating event network-changed:20dc0ab5-5da7-4954-bd75-8e9987e1d28b for instance bdb3c466-0ca6-421b-a258-4db256cd2238 on nch2-master-1 Sep 03 21:41:23.782214 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-b1e24deb-27f0-4ed9-9031-cffc92c81045 req-c9c97013-4128-4ba8-9ffe-fca1084512a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Sep 03 21:41:23.783022 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3076/6381] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:41:24.002568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:24.029068 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2b04b57d-cd94-4b0f-b3bf-63244f0fb211 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1565 microversion: 2.1 time: 0.284671 Sep 03 21:41:24.029860 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3306/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:23 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1565 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:47.278522 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=7 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:47.279305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=40 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:47.283813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:47.286141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:47.293726 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:47.294214 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:47.294652 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:47.295343 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:47.295796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:47.296219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:47.349114 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e05ffc89-2bd9-4383-937b-005968f0a501 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action" status: 200 len: 24573 microversion: 2.1 time: 0.072322 Sep 03 21:41:47.349753 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3077/6383] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:41:47 2022] POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:41:58.420069 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:41:58.422376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:58.424827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:58.425503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=34 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:58.431305 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:58.431793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:58.432232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:58.433578 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:58.434035 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:58.434461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:58.507358 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3f2fe64b-9f2b-442b-ac92-c218ac76fd7e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action" status: 202 len: 0 microversion: 2.1 time: 0.091773 Sep 03 21:41:58.507993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3307/6384] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:41:58 2022] POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:41:58.516744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:58.517482 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:58.520651 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:58.521647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:58.529372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:58.529873 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:58.530324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:58.531046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:58.531505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:58.531941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:58.667630 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:58.675767 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-056be7cc-637a-41cc-92b8-55e6b3d5f212 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1676 microversion: 2.1 time: 0.163254 Sep 03 21:41:58.676563 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3078/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:58 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:41:59.701120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:41:59.701826 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:41:59.708110 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:59.708598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:59.709077 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:59.709778 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:41:59.710236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:41:59.710666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:41:59.842594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:41:59.850446 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-82dd49f2-fa9b-490e-bd4f-47493694bac9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.154630 Sep 03 21:41:59.851023 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3308/6386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:41:59 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:00.875323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:00.875944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:00.882972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:00.883467 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:00.883917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:00.884622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:00.885128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:00.885563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:01.017924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:01.025700 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5a97fcd-e39b-4609-9bb9-73a5ebadad03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.154279 Sep 03 21:42:01.026278 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3079/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:00 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:02.048962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:02.049586 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:02.056382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:02.056879 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:02.057344 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:02.058598 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:02.059049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:02.059473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:02.191546 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:02.199423 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b84ab84-4baf-4266-b45c-27e64df73440 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.154397 Sep 03 21:42:02.199998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3309/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:02 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:03.223600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:03.224238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:03.232067 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:03.232551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:03.233015 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:03.233719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:03.234176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:03.234602 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:03.363878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:03.372522 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-24384c85-6320-47fa-96a5-8c7e76e37dd1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.153067 Sep 03 21:42:03.373124 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3080/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:03 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:04.395654 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:04.396247 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:04.403733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:04.404219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:04.404659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:04.405393 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:04.405848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:04.406272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:04.544551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:04.552211 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1338b716-d5b7-4034-90ee-897942b853a9 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.160530 Sep 03 21:42:04.552771 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3310/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:04 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:05.576912 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:05.577574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:05.584702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:05.585353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:05.585804 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:05.586512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:05.586981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:05.587418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:05.715942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:05.723771 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-179eb96a-0afb-49a5-b56a-6e3affff68af tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.151370 Sep 03 21:42:05.724341 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3081/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:05 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:06.747750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:06.748364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:06.755049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:06.755538 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:06.755980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:06.756677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:06.757158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:06.757610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:06.886808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:06.894638 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dfc373db-f5b5-43ce-ac62-c334996e5cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.150926 Sep 03 21:42:06.895212 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3311/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:06 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:07.918719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:07.919372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:07.926290 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:07.926779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:07.927231 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:07.927927 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:07.928387 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:07.928817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:08.063922 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:08.072218 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d7b60c4e-f328-4fe3-aa6b-6aa3b7886a99 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.157442 Sep 03 21:42:08.072831 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3082/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:07 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:09.096608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:09.097209 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:09.104219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:09.104711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:09.105210 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:09.105912 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:09.106373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:09.106808 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:09.240229 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:09.248524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-930920de-f581-4093-85c2-1879e560c9dd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.155856 Sep 03 21:42:09.249120 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3312/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:09 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:10.273072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:10.273692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:10.281336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:10.281821 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:10.282265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:10.282963 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:10.283431 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:10.283860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:10.415937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:10.423905 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1c2cabb7-0712-4e1d-a53b-f6b4be7eeabd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.154847 Sep 03 21:42:10.424493 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3083/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:10 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:11.447736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:11.448993 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:11.455864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:11.456354 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:11.456801 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:11.457531 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:11.457998 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:11.458434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:11.587690 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:11.595524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-18cdf61e-a7d4-4d13-a909-ed36682e2079 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.151662 Sep 03 21:42:11.596088 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3313/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:11 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:12.619812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:12.620430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:12.627371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:12.627861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:12.628307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:12.629034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:12.629498 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:12.629928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:12.763976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:12.771981 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-23f924ef-3e1f-471d-b48e-1a19dee8364a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.156150 Sep 03 21:42:12.772555 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3084/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:12 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:13.796264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:13.796888 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:13.803858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:13.804335 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:13.804782 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:13.805519 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:13.806004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:13.806437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:13.937213 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:13.944915 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-86c5b98f-c4ec-49d3-8813-f88103f69017 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1681 microversion: 2.1 time: 0.153171 Sep 03 21:42:13.945519 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3314/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:13 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:14.968957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:14.969579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:14.976487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:14.977010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:14.977456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:14.978160 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:14.978622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:14.979083 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:15.107153 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:15.115234 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-72ffa71f-5c7e-4675-9645-cab3b98c1b8e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1684 microversion: 2.1 time: 0.150208 Sep 03 21:42:15.115805 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3085/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:14 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:39.307799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:42:39.310695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:39.313090 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:39.313877 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:39.315158 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:42:39.315313 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action (ip 10.222.0.16) !!! Sep 03 21:42:39.324153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:39.324647 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:39.325121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:39.325859 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:39.326319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:39.326749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:39.385722 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5a63bb59-f93c-49dc-a836-fd73505e34a1 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action" status: 200 len: 68913 microversion: 2.1 time: 0.082072 Sep 03 21:42:39.386293 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3315/6400] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:42:39 2022] POST /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238/action => generated 68913 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 21:42:46.791807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:46.792486 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:46.795061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=16 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:46.796035 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=48 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:46.805993 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:46.806525 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:46.807012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:46.807750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:46.808253 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:46.808734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:46.837233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:42:46.861665 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb3c466-0ca6-421b-a258-4db256cd2238", "tag": "20dc0ab5-5da7-4954-bd75-8e9987e1d28b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:42:46.874827 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:46.875809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:46.876486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:46.889524 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] Creating event network-changed:20dc0ab5-5da7-4954-bd75-8e9987e1d28b for instance bdb3c466-0ca6-421b-a258-4db256cd2238 on nch2-master-1 Sep 03 21:42:46.896460 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-cf6871f9-2352-499f-8109-5377b214da3d req-427b2191-dc6f-40fa-93d6-5b482d3bb634 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106322 Sep 03 21:42:46.897284 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3316/6401] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:42:46.929624 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-131e69e2-ca99-40e5-bcdb-03f3074b801d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 204 len: 0 microversion: 2.1 time: 0.142112 Sep 03 21:42:46.930967 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3086/6402] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:42:46 2022] DELETE /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:42:46.945134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:46.946328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:46.954178 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:46.954781 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:46.955299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:46.956162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:46.956713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:46.957250 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:47.096135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:47.104145 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bf9defe8-e40d-467b-bfb9-320a7b3680bb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1690 microversion: 2.1 time: 0.165257 Sep 03 21:42:47.104737 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3317/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:46 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:48.128340 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:48.129049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:48.136524 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:48.137049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:48.137494 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:48.138685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:48.139141 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:48.139566 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:48.276931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:48.285345 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-77b7aae2-0df1-4bc3-badb-acdfaa2ae488 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1690 microversion: 2.1 time: 0.161367 Sep 03 21:42:48.285920 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3087/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:48 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:48.928606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb3c466-0ca6-421b-a258-4db256cd2238", "name": "network-vif-deleted", "tag": "20dc0ab5-5da7-4954-bd75-8e9987e1d28b"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:42:48.940869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:48.941677 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:48.942436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:48.955088 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] Creating event network-vif-deleted:20dc0ab5-5da7-4954-bd75-8e9987e1d28b for instance bdb3c466-0ca6-421b-a258-4db256cd2238 on nch2-master-1 Sep 03 21:42:48.960624 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-11702625-016d-4c09-bf9b-1f8d825bea79 req-837cc0d3-6d17-43e0-b5dd-943c5182d504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039893 Sep 03 21:42:48.961269 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3318/6405] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:42:49.308448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:49.309174 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:49.316230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:49.316732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:49.317213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:49.317940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:49.318414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:49.318849 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:49.357767 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:49.358274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:49.358727 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:49.359236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lazy-loading 'fault' on Instance uuid bdb3c466-0ca6-421b-a258-4db256cd2238 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:42:49.409483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:42:49.417342 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-176d1071-bd1e-4816-9014-6c7932aed20b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 200 len: 1508 microversion: 2.1 time: 0.112860 Sep 03 21:42:49.417890 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3088/6406] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:49 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 1508 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:42:50.443147 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:50.443878 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: bdb3c466-0ca6-421b-a258-4db256cd2238] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:42:50.450233 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:50.450758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:50.451201 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:50.451895 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:50.452349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:50.452783 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:50.465818 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] HTTP exception thrown: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Request method failure captured: Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 HTTP/1.1 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8mMfuUq0a7B7AEY-Ngn84UZHMIBqTCw9leqOZaTdRfW6H7ezy2djfbUBWgonLxlNCRNR0__0tXsB8d9J9qbr8gtD35u_Zz5xlsFmmS1PTUhI0FHhNSJ2wH9a8UzWEXoefts8CN0HtJCOg72NSRDNqw5bTFJ5iIA-eSMrjHTsgGX3cQ Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 22d9a2cf58104e3988e468a329eb6b80 Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'bdb3c466-0ca6-421b-a258-4db256cd2238'} Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:42:50.467411 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Returning 404 to user: Instance bdb3c466-0ca6-421b-a258-4db256cd2238 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-883c158e-28d2-45c4-a67c-44cf456e8748 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238" status: 404 len: 111 microversion: 2.1 time: 0.030894 Sep 03 21:42:50.471678 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3319/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:42:50 2022] GET /compute/v2.1/servers/bdb3c466-0ca6-421b-a258-4db256cd2238 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:42:53.457433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ba634d5e-b16c-45c7-9dbc-744a2bae78f2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '.version_select at 0x7fae65d7db80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:42:53.479022 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ba634d5e-b16c-45c7-9dbc-744a2bae78f2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1809428312" status: 202 len: 0 microversion: 2.1 time: 0.025663 Sep 03 21:42:53.479694 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3089/6408] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Sep 3 21:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1809428312 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:42:53.508438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-802d6353-87d8-4c08-a68f-35e6a544e506 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: .version_select at 0x7fae65f96ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-942385009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqRDom3Ci4nqujhdw+MRHH+4CViz9LLIYJiER9ViLlrV8NPu8LJkj9jC6Vc9101u0gJ8fwNws7pr4uvhzAXUqqXYsA/dKepIwzD9kvi36Lw3Q/x4MbKU9pv5UJC7WlrsQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:42:53.526958 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-802d6353-87d8-4c08-a68f-35e6a544e506 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:42:53.533386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-802d6353-87d8-4c08-a68f-35e6a544e506 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:42:53.562264 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-802d6353-87d8-4c08-a68f-35e6a544e506 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058182 Sep 03 21:42:53.562974 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3320/6409] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:42:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:42:59.351348 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1826882240", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "f36c6308-208d-4cde-809c-dfb6f05e8ee5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-942385009", "security_groups": [{"name": "tempest-secgroup-smoke-857572288"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:42:59.419503 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:59.477518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] validate_networks() for [('f36c6308-208d-4cde-809c-dfb6f05e8ee5', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:42:59.946157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:42:59.946941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:42:59.947426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:42:59.947839 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:42:59.948255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:42:59.957942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:59.958428 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:59.958870 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:59.959620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:42:59.960037 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:42:59.960463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:42:59.979122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:42:59.984457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:43:00.000634 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:43:00.003018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:43:00.067268 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-59a855d4-fc8e-40c1-8ae3-2e86e3dfd16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720863 Sep 03 21:43:00.068201 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3090/6410] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:42:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:43:00.081332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-cfe86101-cbc4-4677-b5d1-e9829d726209 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:00.082659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-cfe86101-cbc4-4677-b5d1-e9829d726209 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:00.164234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-cfe86101-cbc4-4677-b5d1-e9829d726209 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:00.173684 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-cfe86101-cbc4-4677-b5d1-e9829d726209 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1266 microversion: 2.1 time: 0.097170 Sep 03 21:43:00.174872 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3321/6411] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:00 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:01.198555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:01.200628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:01.208088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:01.208591 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:01.209426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:01.210151 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:01.210614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:01.211218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:01.306337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:01.315564 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ddd3deed-6014-4cb8-a92e-6574cfce0f7c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1326 microversion: 2.1 time: 0.121047 Sep 03 21:43:01.316158 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3091/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:01 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:02.339982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:02.341379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:02.343457 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:02.350758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:02.351418 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:02.351904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:02.352626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:02.353121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:02.353565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:02.501081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:02.514105 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c8aa0369-6464-4bed-9dba-ea1162e37d04 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.178045 Sep 03 21:43:02.514975 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3322/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:02 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:03.069147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:43:03.084182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:03.084671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:03.085138 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:03.097772 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] Creating event network-changed:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch1-master-1 Sep 03 21:43:03.102919 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4922f717-d6fa-49a9-b423-8456e208a8e8 req-740f38e9-5028-4293-8af9-8c243084826a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038315 Sep 03 21:43:03.103695 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3092/6414] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:43:03.538864 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:03.539512 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:03.547068 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:03.548191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:03.548941 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:03.549664 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:03.550128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:03.550562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:03.686438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:03.694277 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85b0ee2f-9adc-45d6-9e0f-0e295dbf897a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.159717 Sep 03 21:43:03.694856 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3323/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:03 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:04.719368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:04.720079 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:04.726461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:04.726953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:04.727398 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:04.728091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:04.728550 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:04.729004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:04.863857 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:04.871637 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d54fc6b-c603-4e11-a309-6346b645096a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.157418 Sep 03 21:43:04.872207 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3093/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:04 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:05.894450 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:05.895242 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:05.901749 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:05.902240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:05.902680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:05.904118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:05.904734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:05.905496 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:06.056730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:06.065259 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6467a6e2-e06c-4bab-94be-baa8c7f024e6 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.174587 Sep 03 21:43:06.065778 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3324/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:05 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:07.088949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:07.089575 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:07.097022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:07.097547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:07.097998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:07.098704 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:07.099168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:07.099604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:07.237078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:07.244842 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-780c48dc-6eb7-4f40-bfba-7d2a87a5a12a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.159833 Sep 03 21:43:07.245431 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3094/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:07 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:07.943355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "name": "network-vif-plugged", "status": "completed", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:43:07.953167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:07.953652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:07.954161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:07.965025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] Creating event network-vif-plugged:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch1-master-1 Sep 03 21:43:07.970125 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-27c3d462-fdea-4d69-b6a5-d14b0228e0ce req-c50ad6e7-37b7-40eb-974b-1aa56f028e2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096876 Sep 03 21:43:07.971241 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3325/6419] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:43:08.267661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:08.268303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:08.275378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:08.275862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:08.276302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:08.277019 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:08.277487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:08.277969 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:08.411690 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:08.419626 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-00341ed1-2606-4ed7-a169-66d830ae353a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.155805 Sep 03 21:43:08.420276 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3095/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:08 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:09.443337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:09.444049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:09.446872 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:09.453310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:09.453810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:09.454264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:09.454976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:09.455440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:09.455867 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:09.601337 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:09.609801 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3163dc04-10fc-4702-97f4-0d4772e7ec46 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1391 microversion: 2.1 time: 0.170704 Sep 03 21:43:09.610561 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3326/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:09 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:10.633871 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:10.634487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:10.637384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:10.638054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:10.643791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:10.644285 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:10.644732 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:10.645468 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:10.645931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:10.646382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:10.774404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:10.782724 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fbce489a-00e7-4189-a9ba-c4b27b44cf4f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1563 microversion: 2.1 time: 0.152803 Sep 03 21:43:10.783293 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3096/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:10 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:10.805483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:10.806102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:10.808010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:10.814103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:10.814592 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:10.815037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:10.815736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:10.816198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:10.816635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:10.946336 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:10.954033 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0db6729a-1acd-4904-93ee-860b3a0e164f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1563 microversion: 2.1 time: 0.152407 Sep 03 21:43:10.954598 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3327/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:10 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:12.519567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:43:12.520211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:12.528570 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:12.529179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:12.529628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:43:12.530084 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:12.530408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:12.530977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:12.531470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:12.540839 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:12.541340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:12.541967 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:12.554411 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] Creating event network-changed:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch1-master-1 Sep 03 21:43:12.560313 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-15001355-7206-413e-b9b6-4dae85cf99bf req-d92ae974-c7fb-41e7-890a-d7bc32e18fcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034752 Sep 03 21:43:12.563330 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3328/6424] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:43:12.734818 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:43:12.744334 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3b475f05-fb8e-4de2-b171-6e963629e7e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1563 microversion: 2.1 time: 0.228890 Sep 03 21:43:12.760286 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3097/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:43:12 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:43:46.028043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=5 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:46.028788 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=34 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:46.033477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:43:46.035722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:43:46.042625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:46.043113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:46.043553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:46.044249 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:43:46.044706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:43:46.045659 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:43:46.112908 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-87857598-c2ae-48c7-b994-11d5f17bd6c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action" status: 200 len: 24569 microversion: 2.1 time: 0.086720 Sep 03 21:43:46.113756 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3329/6426] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:43:46 2022] POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action => generated 24569 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 21:44:16.593040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:16.594334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=40 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:16.598806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:16.601140 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:16.608298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:16.608820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:16.609292 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:16.610615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:16.611074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:16.611748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:16.652346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:16.659164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Old instance type m1.heat2, new instance type m1.heat {{(pid=140519) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 03 21:44:16.666064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:44:16.666484 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:44:16.666961 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:44:16.667370 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:44:16.667786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:44:16.732542 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b1fddf2-4860-4d17-a942-da562daa07ef tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action" status: 202 len: 0 microversion: 2.1 time: 0.141443 Sep 03 21:44:16.733203 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3098/6427] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:44:16 2022] POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:44:16.742388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:16.743095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:16.746938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:16.747908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:16.752978 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:16.753476 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:16.754055 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:16.754793 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:16.755284 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:16.755770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:16.943762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:16.951672 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fd3be0d7-2f78-4e4b-895c-7e0997774b1b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1691 microversion: 2.1 time: 0.213634 Sep 03 21:44:16.952236 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3330/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:16 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1691 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:17.974681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:17.975233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:17.982407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:17.982896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:17.983334 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:17.984065 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:17.984518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:17.984965 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:18.114363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:18.123186 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-46ebb192-861a-48f2-bc12-91bc67a09614 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1691 microversion: 2.1 time: 0.152386 Sep 03 21:44:18.123955 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3099/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:17 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:44:19.147579 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:19.148238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:19.155940 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:19.157028 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:19.157503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:19.158204 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:19.158672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:19.159104 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:19.290791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:19.298663 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e8b5c304-86c5-42ac-ab45-6c78eeb81a65 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.155020 Sep 03 21:44:19.299263 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3331/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:19 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:20.322137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:20.322757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:20.330302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:20.330794 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:20.331243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:20.331942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:20.332407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:20.332843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:20.471515 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:20.479377 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a97d2a4e-e2c4-46e4-a628-06f3c9345acd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.161164 Sep 03 21:44:20.479942 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3100/6431] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:20 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:21.503847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:21.504467 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:21.511830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:21.512323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:21.512771 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:21.513532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:21.513997 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:21.514433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:21.648775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:21.656637 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-809756ff-1e38-4500-9725-728416664379 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.156625 Sep 03 21:44:21.657341 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3332/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:21 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:22.679670 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:22.680291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:22.687256 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:22.687779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:22.688243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:22.688978 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:22.689441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:22.689882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:22.825955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:22.834260 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a976b237-7c43-4d46-ab42-67783c7682e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.158538 Sep 03 21:44:22.834843 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3101/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:22 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:23.857990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:23.858610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:23.866439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:23.866869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:23.867308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:23.868000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:23.868455 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:23.868884 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:23.996986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:24.004748 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c60c1165-766d-4d85-a1b7-7b38dd2303b0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.150645 Sep 03 21:44:24.005342 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3333/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:23 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:25.029453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:25.030070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:25.037599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:25.038088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:25.038535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:25.039234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:25.039691 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:25.040121 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:25.175977 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:25.183764 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f3ac1dc1-852b-4d80-8da4-962dc151650c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.158252 Sep 03 21:44:25.184341 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3102/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:25 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:26.259820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:26.260434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:26.267252 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:26.267742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:26.268183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:26.268873 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:26.269349 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:26.269775 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:26.400740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:26.408564 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a5c44b9a-b9bf-4d99-a62d-59cc70cc4acb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.204351 Sep 03 21:44:26.409159 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3334/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:26 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:27.431557 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:27.432182 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:27.439934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:27.440425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:27.440886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:27.441748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:27.442211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:27.442646 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:27.575587 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:27.584057 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b28ffbe1-4425-4502-93b0-ffb6e9cfd9c8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.156415 Sep 03 21:44:27.584625 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3103/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:27 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:28.607312 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:28.607851 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:28.615779 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:28.616267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:28.616708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:28.617430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:28.617889 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:28.618318 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:28.747240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:28.754952 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e4d89686-8100-424b-8077-9628fb9edce0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.151606 Sep 03 21:44:28.755516 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3335/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:28 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:29.779017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:29.779546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:29.787034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:29.787528 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:29.787972 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:29.788707 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:29.789193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:29.789627 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:29.925167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:29.933058 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d8d741b5-31c9-4a45-aab7-15a537167c9c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1696 microversion: 2.1 time: 0.157994 Sep 03 21:44:29.933659 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3104/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:29 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:30.961193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:30.961811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:30.968686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:30.969726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:30.970167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:30.970866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:30.971320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:30.971746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:31.208198 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:31.216065 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3df51a7d-a962-45d9-af0a-0a2df58438c4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1695 microversion: 2.1 time: 0.258786 Sep 03 21:44:31.216646 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3336/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:30 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:31.380082 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "name": "network-vif-unplugged", "status": "completed", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:31.390460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:31.391567 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:31.392072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:31.404152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Creating event network-vif-unplugged:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch2-master-1 Sep 03 21:44:31.409684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140519) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:44:31.420542 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-30a70b7e-39c9-48d9-9361-3fac2eb90e9d req-53ee57a1-7647-483c-b9a3-414508875460 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044181 Sep 03 21:44:31.421352 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3105/6441] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:44:32.241776 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:32.242465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:32.249466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:32.250051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:32.250501 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:32.251218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:32.251682 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:32.252117 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:32.393720 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:32.401578 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-13b5349c-f6b3-471f-8978-30436d34925e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1695 microversion: 2.1 time: 0.164014 Sep 03 21:44:32.402153 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3337/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:32 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:44:33.427884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:33.428502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:33.434744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:33.435236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:33.435679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:33.436380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:33.436844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:33.437302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:33.455718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:33.465990 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:33.466465 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:33.466901 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:33.478370 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Creating event network-changed:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch2-master-1 Sep 03 21:44:33.483807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140520) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 03 21:44:33.495389 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-0c6faa30-3bfe-49a0-9742-d725dc8d390c req-002453f7-1631-44af-95d8-d37bffdebdb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043361 Sep 03 21:44:33.495993 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3338/6443] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:44:33.608917 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:33.617811 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-efea5e08-9535-4324-a9f0-51290f2ea048 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1693 microversion: 2.1 time: 0.195789 Sep 03 21:44:33.618404 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3106/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:33 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:34.643414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:34.644208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:34.650537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.651038 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.651487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:34.652200 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.652666 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.653215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:34.789145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:34.797019 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a7e509cf-64a8-4635-ba28-b2f696f1040b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1690 microversion: 2.1 time: 0.158690 Sep 03 21:44:34.797609 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3339/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:34 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:34.819918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:34.820512 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:34.827380 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.828359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.828812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:34.829534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.829991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.830422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:34.888043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-094a4904-cb35-4d69-a79f-7607f5205ea7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action" status: 204 len: 0 microversion: 2.1 time: 0.071913 Sep 03 21:44:34.888704 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3107/6446] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:44:34 2022] POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:44:34.897452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:34.898308 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:34.904541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.905165 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.905635 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:34.906914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:34.907414 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:34.907977 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:35.039162 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:35.047036 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-dde8af40-efd3-4337-83c7-808caf8793ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1690 microversion: 2.1 time: 0.153474 Sep 03 21:44:35.047607 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3340/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:34 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:35.070303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:35.071014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:35.077415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:35.077995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:35.078447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:35.079155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:35.079617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:35.080055 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:35.281664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:35.290106 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a6ce58c2-18e0-4cb6-b571-8e77a04d5677 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1690 microversion: 2.1 time: 0.223979 Sep 03 21:44:35.290826 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3108/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:35 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:36.315362 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:44:36.315988 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:36.322508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:36.322999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:36.323469 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:36.324185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:36.324652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:36.325113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:36.458328 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:44:36.466186 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-50762221-7d5d-41d7-8fb0-4bfe5d0e8473 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1682 microversion: 2.1 time: 0.155616 Sep 03 21:44:36.466758 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3341/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:44:36 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:44:37.360939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "name": "network-vif-plugged", "status": "completed", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:37.371744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:37.372237 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:37.372678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:37.387048 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] Creating event network-vif-plugged:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch2-master-1 Sep 03 21:44:37.391904 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-4d793a33-15e4-45c4-aaf5-23337c4eb8e9 req-2aa6f3e2-d0da-4f24-87c8-4c8852c2f008 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035243 Sep 03 21:44:37.392503 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3109/6450] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:44:58.648548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:44:58.650841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:44:58.653499 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:58.654168 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=70 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:58.660673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:58.661191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:58.661642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:58.662346 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:44:58.662803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:44:58.663234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:44:58.715499 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8ace2731-19b3-4a44-9fb6-2e93daa0d967 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action" status: 200 len: 24579 microversion: 2.1 time: 0.070912 Sep 03 21:44:58.716131 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3342/6451] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:44:58 2022] POST /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55/action => generated 24579 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:45:06.039643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=28 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:06.040615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:06.044717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:06.045213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:06.045508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:06.053628 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:06.054443 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:06.055125 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:06.055846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:06.056307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:06.056436 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:06.056750 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:06.057218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:06.057884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:06.069107 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] Creating event network-changed:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch2-master-1 Sep 03 21:45:06.074902 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-373cb2d5-25d1-4883-a616-ce30bd439b2f req-0fe454be-81d0-4105-b2d4-941e962f99e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Sep 03 21:45:06.075789 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3343/6452] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:06.087107 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:45:06.192302 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-06485185-68cf-403d-9b02-61e09f921591 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 204 len: 0 microversion: 2.1 time: 0.154301 Sep 03 21:45:06.193412 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3110/6453] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:45:06 2022] DELETE /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:45:06.203015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:06.204030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:06.211986 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:06.212869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:06.213550 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:06.214484 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:06.215126 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:06.215794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:06.663621 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:06.671572 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8f449ca4-5a30-4c5f-b89d-cf83d91c7066 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1688 microversion: 2.1 time: 0.473357 Sep 03 21:45:06.672240 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3344/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:06 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1688 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:07.695672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:07.696563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:07.703460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:07.703951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:07.704401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:07.705130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:07.706078 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:07.706509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:07.930633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:07.938723 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-006c491c-4523-4fe7-bfe4-0c6accc0e711 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 200 len: 1569 microversion: 2.1 time: 0.247400 Sep 03 21:45:07.939302 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3111/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:07 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:45:08.090430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf4835e-8f6e-4cb2-a655-78fe1ee3df55", "name": "network-vif-deleted", "tag": "435cfef2-3466-4f66-8a5c-110d1164343a"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:08.101177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:08.101741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:08.102255 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:08.113187 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] Creating event network-vif-deleted:435cfef2-3466-4f66-8a5c-110d1164343a for instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 on nch2-master-1 Sep 03 21:45:08.118971 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ba8ec095-f9f5-4c91-a552-8b19060c88e5 req-285ce4d3-a4a7-485b-b550-ee8483e2d7d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 Sep 03 21:45:08.118971 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3345/6456] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:08.963403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:08.964052 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:08.970989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:08.971981 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:08.972425 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:08.973148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:08.973612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:08.974042 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:08.988134 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] HTTP exception thrown: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Request method failure captured: Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 HTTP/1.1 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8mMfuUq0a7B7AEY-Ngn84UZHMIBqTCw9leqOZaTdRfW6H7ezy2djfbUBWgonLxlNCRNR0__0tXsB8d9J9qbr8gtD35u_Zz5xlsFmmS1PTUhI0FHhNSJ2wH9a8UzWEXoefts8CN0HtJCOg72NSRDNqw5bTFJ5iIA-eSMrjHTsgGX3cQ Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 22d9a2cf58104e3988e468a329eb6b80 Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2cf4835e-8f6e-4cb2-a655-78fe1ee3df55'} Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:45:08.989805 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Returning 404 to user: Instance 2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1d7f0070-9366-4d19-9a06-2bef85153056 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55" status: 404 len: 111 microversion: 2.1 time: 0.031769 Sep 03 21:45:08.994941 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3112/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:08 2022] GET /compute/v2.1/servers/2cf4835e-8f6e-4cb2-a655-78fe1ee3df55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:45:11.939656 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-67cf2d52-4222-4952-90db-550b37029abb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '.version_select at 0x7fae65c50f70>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:11.945949 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-67cf2d52-4222-4952-90db-550b37029abb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:45:12.956123 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [None req-67cf2d52-4222-4952-90db-550b37029abb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [85a7088c-91b6-40bb-b127-781fa886b3dd] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43522. Sep 03 21:45:12.974012 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-67cf2d52-4222-4952-90db-550b37029abb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-942385009" status: 202 len: 0 microversion: 2.1 time: 1.040442 Sep 03 21:45:12.974595 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3346/6458] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 21:45:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-942385009 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:45:13.000349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: .version_select at 0x7fae6b8ad700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-972681550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIwPeZriQW4ZLn/xva8vS5wPO1sOFO04srDswqMo4l6h5nPnOCfQJrqhJ+IxV4NGr/a1tOUwZyXJgGcK1wO5glIXAdmMOvc9ZCHGaxI5rgYw4wZJkr/Rxzrhy1+eSBT5Q=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:13.017275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:45:13.022843 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:45:13.036419 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [21cbac9b-28ae-492d-b04d-cdc7da74f7c2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:45:14.043480 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [21cbac9b-28ae-492d-b04d-cdc7da74f7c2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43526. Sep 03 21:45:14.058051 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dbe1deb2-82cc-4da3-a5dd-b5e645cf07e5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.061585 Sep 03 21:45:14.058648 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3113/6459] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:45:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:19.532768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1343647965", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "d02adc35-12fb-4ffc-9ec4-bf948f276d54"}], "key_name": "tempest-TestNetworkAdvancedServerOps-972681550", "security_groups": [{"name": "tempest-secgroup-smoke-943505445"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:19.546472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=14 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:19.662052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] validate_networks() for [('d02adc35-12fb-4ffc-9ec4-bf948f276d54', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:45:20.181342 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:45:20.182039 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:45:20.182736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:45:20.183368 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:45:20.184034 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:45:20.195475 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:20.196217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:20.196758 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:20.197645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:20.198315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:20.198910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:20.216976 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:45:20.222470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:45:20.235274 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:45:20.238152 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:45:20.288283 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bea4422a-a6f0-40d5-86f9-c24e2ccb0232 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759997 Sep 03 21:45:20.289830 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3347/6460] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:45:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:45:20.298291 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:20.302584 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d4eaf201-2231-49b7-8322-42274a754215 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:20.303510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d4eaf201-2231-49b7-8322-42274a754215 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:20.363585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d4eaf201-2231-49b7-8322-42274a754215 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:20.370840 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d4eaf201-2231-49b7-8322-42274a754215 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1266 microversion: 2.1 time: 0.074301 Sep 03 21:45:20.371419 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3114/6461] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:20 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:21.396734 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b1dfa341-64fd-42a7-8284-2ba6ab6c78de tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:21.398102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b1dfa341-64fd-42a7-8284-2ba6ab6c78de tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:21.458063 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b1dfa341-64fd-42a7-8284-2ba6ab6c78de tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:21.465589 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b1dfa341-64fd-42a7-8284-2ba6ab6c78de tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1266 microversion: 2.1 time: 0.074081 Sep 03 21:45:21.468989 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3348/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:21 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:22.493660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-51dcfc8e-0a25-4c37-96b5-ff0803c69c5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:22.494284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-51dcfc8e-0a25-4c37-96b5-ff0803c69c5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:22.567176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-51dcfc8e-0a25-4c37-96b5-ff0803c69c5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:22.576099 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-51dcfc8e-0a25-4c37-96b5-ff0803c69c5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1266 microversion: 2.1 time: 0.088075 Sep 03 21:45:22.576637 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3115/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:22 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:23.600303 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a848ffce-5c04-4eb8-bd5b-962affdda8c3 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:23.600962 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a848ffce-5c04-4eb8-bd5b-962affdda8c3 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:23.654442 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a848ffce-5c04-4eb8-bd5b-962affdda8c3 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:23.662415 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a848ffce-5c04-4eb8-bd5b-962affdda8c3 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1266 microversion: 2.1 time: 0.066609 Sep 03 21:45:23.662985 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3349/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:23 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:24.685612 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:24.686226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:24.693635 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:24.694117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:24.694559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:24.695251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:24.695706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:24.696133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:24.757834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:24.765502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8dcfcd27-8836-4b14-b189-2ed244e285ee tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1270 microversion: 2.1 time: 0.083825 Sep 03 21:45:24.766076 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3116/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:24 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:25.789602 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:25.790217 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:25.797914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:25.798404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:25.798846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:25.800070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:25.800528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:25.801003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:25.867994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:25.875899 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-3bd1af1e-d842-4029-a454-4d9f9a5cf46b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1324 microversion: 2.1 time: 0.090151 Sep 03 21:45:25.876479 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3350/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:25 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1324 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:45:26.877997 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd", "tag": "6a2300f0-07e2-4aee-989b-5632cd20a755"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:26.888574 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:26.889091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:26.889533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:26.900338 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:26.900992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:26.903470 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] Creating event network-changed:6a2300f0-07e2-4aee-989b-5632cd20a755 for instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd on nch1-master-1 Sep 03 21:45:26.908031 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:26.908371 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-bfb8b331-9113-4ba8-8884-8c8b073671b2 req-989e012a-c05f-4a41-9f7b-55328174feb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034581 Sep 03 21:45:26.908923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:26.909369 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3117/6467] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:26.909483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:26.910086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:26.910552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:26.910987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:27.047669 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:27.056940 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb9f1f10-1382-436b-a642-2a77c33116cc tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.160533 Sep 03 21:45:27.057661 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3351/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:26 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:28.083750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:28.084453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:28.090891 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:28.091378 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:28.091815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:28.092509 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:28.092991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:28.093419 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:28.231620 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:28.239677 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-42e2a4d5-fdda-4588-a203-dd13317af735 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.161496 Sep 03 21:45:28.240259 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3118/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:28 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:29.264423 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:29.265081 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:29.267792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:29.274554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:29.275053 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:29.275532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:29.276245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:29.276728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:29.277179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:29.408831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:29.416651 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7bbd7cc8-0f47-4bc1-9ec2-b70e5e15c8f5 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.156096 Sep 03 21:45:29.417253 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3352/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:29 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:30.442050 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:30.442671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:30.449720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:30.450211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:30.450655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:30.451354 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:30.451812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:30.452239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:30.586303 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:30.593996 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e6c695e7-31c4-4702-874a-124480969357 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.156418 Sep 03 21:45:30.594569 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3119/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:30 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:31.617744 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:31.618358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:31.620225 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:31.626254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:31.626740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:31.627834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:31.628536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:31.629015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:31.629437 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:31.762471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:31.770147 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e42f6cc7-ecd0-4e47-9ad3-30212f368ddb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.156339 Sep 03 21:45:31.770739 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3353/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:31 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:32.622647 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd", "name": "network-vif-plugged", "status": "completed", "tag": "6a2300f0-07e2-4aee-989b-5632cd20a755"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:32.628684 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=8 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:32.634800 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:32.635310 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:32.635745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:32.648160 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] Creating event network-vif-plugged:6a2300f0-07e2-4aee-989b-5632cd20a755 for instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd on nch1-master-1 Sep 03 21:45:32.653285 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-7655bc43-6ec0-49fd-9ad4-c6be7b796a8d req-918e2e51-fa63-4180-8836-04e4c7775847 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034387 Sep 03 21:45:32.654069 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3120/6473] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:32.794139 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:32.794769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:32.801633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:32.802134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:32.802582 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:32.803294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:32.803757 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:32.804194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:32.936608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:32.945257 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fbbe6abb-a4cb-4345-9198-653af03c200b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.155714 Sep 03 21:45:32.945849 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3354/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:32 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:33.972360 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:33.973533 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:33.979914 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:33.980405 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:33.980862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:33.981582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:33.982041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:33.982472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:34.115352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:34.123272 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d595ab95-4940-4715-ad0c-1fb00bc0d0ac tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1391 microversion: 2.1 time: 0.158773 Sep 03 21:45:34.124094 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3121/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:33 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:35.147080 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:35.147691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:35.149564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=10 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:35.155523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:35.156006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:35.156445 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:35.157164 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:35.157616 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:35.158045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:35.290984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:35.298705 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38780296-a1e3-4f5a-b47a-7dbdd7d4130f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1564 microversion: 2.1 time: 0.156119 Sep 03 21:45:35.299267 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3355/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:35 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:35.321553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:35.322170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:35.328974 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:35.329463 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:35.329909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:35.331170 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:35.331632 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:35.332070 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:35.459896 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:35.467597 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8d477257-d157-4a98-a9ce-02f2f153314a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1564 microversion: 2.1 time: 0.149889 Sep 03 21:45:35.468166 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3122/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:35 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:45:37.338671 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd", "tag": "6a2300f0-07e2-4aee-989b-5632cd20a755"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:45:37.343840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:45:37.344452 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:45:37.351660 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:37.356796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:37.357316 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:37.357756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:37.358481 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:37.358923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:37.359441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:37.359990 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:45:37.360481 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:45:37.360936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:45:37.374545 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] Creating event network-changed:6a2300f0-07e2-4aee-989b-5632cd20a755 for instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd on nch1-master-1 Sep 03 21:45:37.382480 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-2a8d241c-d11e-48ed-88bb-995c0bb53bfc req-e9b11a2f-e498-4278-bb99-8b3ebde15de2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047374 Sep 03 21:45:37.383279 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3123/6478] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:45:37.500712 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:45:37.509952 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-498b90c1-e4ec-4523-9eb2-b97079d03092 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1564 microversion: 2.1 time: 0.177815 Sep 03 21:45:37.510553 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3356/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:45:37 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:10.835341 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=36 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:10.841027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:46:10.843402 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:10.851546 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:10.852039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:10.852483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:10.853211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:10.853672 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:10.854102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:10.919805 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-efce2757-b1f0-4b8b-85ab-45939ad20810 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action" status: 200 len: 24576 microversion: 2.1 time: 0.086634 Sep 03 21:46:10.920451 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3124/6480] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:46:10 2022] POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action => generated 24576 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:46:41.453103 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=9 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:41.453866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=44 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:41.459046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:46:41.466138 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:41.466628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:41.467072 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:41.489732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Going to try to stop instance {{(pid=140520) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 21:46:41.529948 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-208ca5c4-3881-4011-83f5-bf0f0f6c361c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action" status: 202 len: 0 microversion: 2.1 time: 0.078543 Sep 03 21:46:41.530542 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3357/6481] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:46:41 2022] POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:46:41.540631 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:41.541368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:41.545147 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:41.545937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:41.551445 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:41.551956 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:41.552397 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:41.553128 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:41.553585 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:41.554010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:41.759769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:41.767630 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-6656b721-ca7f-4e46-946b-e88b39c4ee02 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.231449 Sep 03 21:46:41.768194 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3125/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:41 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:42.793433 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:42.794173 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:42.801146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:42.801641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:42.802094 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:42.802804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:42.803273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:42.803711 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:42.986899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:42.995025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-79325b26-2bc2-4394-b340-abd58f8e3189 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.207147 Sep 03 21:46:42.995600 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3358/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:42 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:44.019882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:44.020802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:44.028756 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:44.029272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:44.029719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:44.030424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:44.030885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:44.031317 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:44.226272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:44.234063 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3aa62630-8ec1-466c-ad0c-b9e4ad0f7563 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.219277 Sep 03 21:46:44.234628 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3126/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:44 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:45.258566 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:45.259180 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:45.265992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:45.266477 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:45.266915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:45.267607 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:45.268058 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:45.268991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:45.399269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:45.407616 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-6db0ccf6-57a6-484d-930e-bbcbffe699d4 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.152927 Sep 03 21:46:45.408207 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3359/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:45 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:46.433728 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:46.434263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:46.441236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:46.441731 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:46.442747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:46.443500 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:46.443971 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:46.444407 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:46.657542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:46.665315 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c6659086-bf1b-4d4b-af4e-7dcc822260b8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.235651 Sep 03 21:46:46.665889 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3127/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:46 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:47.689622 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:47.690237 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:47.697815 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:47.698295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:47.699014 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:47.699714 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:47.700169 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:47.700596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:47.954973 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:47.964522 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-78b8e7b8-7463-4fda-8cfb-06c448548836 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.278741 Sep 03 21:46:47.965126 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3360/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:47 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:48.988114 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:48.988743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:48.995737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:48.996229 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:48.996678 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:48.997423 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:48.997886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:48.998323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:49.133664 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:49.141441 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-85b15b3a-e17f-44c6-b539-7f3dc8728479 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.157550 Sep 03 21:46:49.142058 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3128/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:48 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:50.166306 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:50.166920 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:50.173514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:50.174000 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:50.174438 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:50.175133 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:50.175587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:50.176016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:50.314486 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:50.322314 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fa13a0b9-e4f3-4a23-b155-107926968241 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.159853 Sep 03 21:46:50.322827 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3361/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:50 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:51.346018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:51.346638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:51.353551 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:51.354044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:51.354496 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:51.355197 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:51.355657 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:51.356091 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:51.484338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:51.492948 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bd8ab087-af73-4d49-b378-133af19012bd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.150862 Sep 03 21:46:51.493522 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3129/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:51 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:52.516613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:52.517264 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:52.524811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:52.525340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:52.525789 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:52.526498 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:52.526965 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:52.527404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:52.655932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:52.664365 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-fb473f47-8bec-4ef5-9a96-9da5ef357b7d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.151706 Sep 03 21:46:52.664952 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3362/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:52 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:53.687163 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:53.687815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:53.694919 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:53.695408 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:53.695855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:53.696552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:53.697036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:53.697470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:53.829307 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:53.837067 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8a3a4ea-0532-4c34-a1b0-7f825a75dd4d tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.153773 Sep 03 21:46:53.837639 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3130/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:53 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:54.860495 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:54.861137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:54.868806 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:54.869322 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:54.869764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:54.870456 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:54.870915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:54.871345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:55.003824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:55.012173 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1c98d194-e92c-4ff3-a0e5-12c2bfccc50f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.155609 Sep 03 21:46:55.012736 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3363/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:54 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:56.035663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:56.036339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:56.043490 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:56.043987 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:56.044441 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:56.045184 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:56.045649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:56.046086 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:56.181267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:56.190178 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8a82f48-7cff-4c2f-a604-a4dbeee33c15 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1693 microversion: 2.1 time: 0.158484 Sep 03 21:46:56.190757 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3131/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:56 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:57.214764 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:57.215380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:57.222323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:57.222809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:57.223251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:57.224626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:57.225121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:57.225556 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:57.353601 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:57.361396 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-bad340a7-a6fe-4ca4-919d-0d722593285e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1670 microversion: 2.1 time: 0.150511 Sep 03 21:46:57.361966 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3364/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:57 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:58.457365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:46:58.460172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:58.467013 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:58.467493 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:58.467931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:58.468619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:58.469122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:58.469547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:58.530790 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-86023e42-2716-4891-b863-89a2af39836b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action" status: 200 len: 36488 microversion: 2.1 time: 0.077312 Sep 03 21:46:58.531459 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3132/6496] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:46:58 2022] POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action => generated 36488 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:46:58.543267 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:46:58.550153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:58.550648 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:58.551088 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:58.573599 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Going to try to start instance {{(pid=140520) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 21:46:58.613008 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-92893631-ae5c-46ec-a6b7-377fe3835344 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action" status: 202 len: 0 microversion: 2.1 time: 0.073135 Sep 03 21:46:58.613544 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3365/6497] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:46:58 2022] POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:46:58.623026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:58.623762 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:58.631529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:58.632093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:58.632563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:58.633304 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:58.633763 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:58.634194 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:58.772219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:58.780020 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-41c4174b-b900-49bc-bea4-21340925e77b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1679 microversion: 2.1 time: 0.161273 Sep 03 21:46:58.780730 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3133/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:58 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:46:59.805596 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:46:59.806695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:46:59.813623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:59.814313 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:59.814989 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:59.815833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:46:59.816317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:46:59.816932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:46:59.955037 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:46:59.963617 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-98dc24a2-23bb-416c-8471-da40281c724b tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1679 microversion: 2.1 time: 0.163826 Sep 03 21:46:59.964213 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3366/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:46:59 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:47:00.989686 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:00.990299 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:00.997168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:00.997655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:00.998096 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:00.998788 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:00.999242 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:00.999668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:01.134023 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:47:01.141892 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fb0213de-84b0-4e1b-9ad3-1016a273e66f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1683 microversion: 2.1 time: 0.156952 Sep 03 21:47:01.142536 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3134/6500] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:47:00 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:47:31.360185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:47:31.362595 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:31.365116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=20 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:31.365984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:31.371773 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:31.372273 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:31.372728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:31.373464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:31.373937 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:31.374376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:31.446973 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d2276558-7fef-4669-9905-9b1cb430a61e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action" status: 200 len: 61047 microversion: 2.1 time: 0.090876 Sep 03 21:47:31.447629 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3367/6501] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:47:31 2022] POST /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd/action => generated 61047 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:47:48.670603 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:48.671889 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:48.675649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=20 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:48.676394 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=58 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:48.681332 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:48.682415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:48.682865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:48.683579 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:48.684036 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:48.684464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:48.711309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:47:48.790799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:48.792113 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:48.809571 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-466c57b5-eb3f-49bb-8562-fb50354b1d03 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 204 len: 0 microversion: 2.1 time: 0.143506 Sep 03 21:47:48.810174 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3135/6502] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:47:48 2022] DELETE /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:47:48.819939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:48.820733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:48.827275 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:48.827860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:48.828316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:48.829059 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:48.829535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:48.829959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:48.877824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd", "tag": "6a2300f0-07e2-4aee-989b-5632cd20a755"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:47:48.899980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:48.900474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:48.900934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:48.912320 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] Creating event network-changed:6a2300f0-07e2-4aee-989b-5632cd20a755 for instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd on nch1-master-1 Sep 03 21:47:48.917704 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2d652963-749d-4678-a71b-2858ebbbe31e req-d787fe10-901a-45c4-9fa2-222de5822679 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132900 Sep 03 21:47:48.918306 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3368/6503] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:47:48.978094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:47:48.986070 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b6e6ce1b-b1b3-430d-9408-6542be466505 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1689 microversion: 2.1 time: 0.171246 Sep 03 21:47:48.986638 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3136/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:47:48 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:47:50.011564 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:50.012196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:50.018424 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:50.018914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:50.019360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:50.020060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:50.020521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:50.021006 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:50.152725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:47:50.160631 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-31e2cdbc-52bc-4f19-b9c1-23ca5b3b3529 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1689 microversion: 2.1 time: 0.154389 Sep 03 21:47:50.161733 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3369/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:47:50 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:47:51.043909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd", "name": "network-vif-deleted", "tag": "6a2300f0-07e2-4aee-989b-5632cd20a755"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:47:51.059357 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:51.059878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:51.060326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:51.071921 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] Creating event network-vif-deleted:6a2300f0-07e2-4aee-989b-5632cd20a755 for instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd on nch1-master-1 Sep 03 21:47:51.077103 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-7f3b826b-f4ee-4780-a145-0e7ce48b2bc2 req-8ff44fbf-8c1b-49e2-a077-df7aad41b7c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036793 Sep 03 21:47:51.077702 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3137/6506] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:47:51.184581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:51.185219 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:51.192845 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:51.193369 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:51.193810 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:51.194521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:51.194994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:51.195406 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:51.227215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:51.227706 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:51.228203 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:51.228662 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lazy-loading 'fault' on Instance uuid 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:47:51.270710 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:47:51.278405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-03b4adde-93e4-45d4-9fd2-57c8d4bea16a tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 200 len: 1356 microversion: 2.1 time: 0.097799 Sep 03 21:47:51.278969 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3370/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:47:51 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:47:52.305213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:52.305959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:47:52.312239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:52.312734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:52.313211 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:52.313913 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:47:52.314379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:47:52.314813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:47:52.328142 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] HTTP exception thrown: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Request method failure captured: Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd HTTP/1.1 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8mMfuUq0a7B7AEY-Ngn84UZHMIBqTCw9leqOZaTdRfW6H7ezy2djfbUBWgonLxlNCRNR0__0tXsB8d9J9qbr8gtD35u_Zz5xlsFmmS1PTUhI0FHhNSJ2wH9a8UzWEXoefts8CN0HtJCOg72NSRDNqw5bTFJ5iIA-eSMrjHTsgGX3cQ Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 22d9a2cf58104e3988e468a329eb6b80 Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd'} Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:47:52.329781 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Returning 404 to user: Instance 9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-d65ca803-a0ff-4015-8ce2-a8afe78c5d2e tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd" status: 404 len: 111 microversion: 2.1 time: 0.031810 Sep 03 21:47:52.334847 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3138/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:47:52 2022] GET /compute/v2.1/servers/9a91e6a5-14ca-4e4f-a78e-55b30d2ad8dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:47:55.590002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-eb5efb34-6400-46da-9a10-e062598a2723 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '.version_select at 0x7fae65b791f0>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:47:55.616062 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-eb5efb34-6400-46da-9a10-e062598a2723 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-972681550" status: 202 len: 0 microversion: 2.1 time: 0.029990 Sep 03 21:47:55.616788 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3371/6509] 10.222.0.16 () {58 vars in 1281 bytes} [Sat Sep 3 21:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-972681550 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:47:55.647944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-89705057-9187-44ea-836a-3bdfa80d3cff tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: .version_select at 0x7fae65cdf820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1023326665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU95CFZ1w+x0vQWxGl1tiODJ0jjrxTI9UdlwvZyFdAcaAQkowIedcxb077mWc7CmPtIzZ5tRTGNdzWQlVaBJy/z6tXRRqJxPeRodBSfGLJf0zcasojmQxvBWKa4TC5yIg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:47:55.683798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-89705057-9187-44ea-836a-3bdfa80d3cff tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:47:55.694018 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-89705057-9187-44ea-836a-3bdfa80d3cff tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:47:55.725875 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-89705057-9187-44ea-836a-3bdfa80d3cff tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.082253 Sep 03 21:47:55.726636 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3139/6510] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:47:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:48:01.487029 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1883929846", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "networks": [{"uuid": "507da9ed-a163-4727-8370-412be2e9dd37"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1023326665", "security_groups": [{"name": "tempest-secgroup-smoke-741928372"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:01.499441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=16 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:01.612777 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] validate_networks() for [('507da9ed-a163-4727-8370-412be2e9dd37', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:48:02.199294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:48:02.199725 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:48:02.200367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:48:02.200796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:48:02.201374 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:48:02.217784 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:02.218743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:02.219356 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:02.220319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:02.220960 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:02.221575 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:02.251440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:48:02.257770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Getting quotas for user 22d9a2cf58104e3988e468a329eb6b80 and project 9f2c6e6317c6424f83e70d52aee5b85d. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:48:02.280404 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:48:02.283917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:48:02.342686 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [79f0fa3a-3dec-4691-8b95-1b0105b2573a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:48:03.350224 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [79f0fa3a-3dec-4691-8b95-1b0105b2573a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43838. Sep 03 21:48:03.354436 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f398692f-4ba0-498e-841c-ab0390ccec49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.871710 Sep 03 21:48:03.355364 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3372/6511] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:48:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:48:03.365842 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:03.370179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f87706fe-3a56-426d-9b6e-d263aa3d4cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:03.370793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f87706fe-3a56-426d-9b6e-d263aa3d4cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:03.431157 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f87706fe-3a56-426d-9b6e-d263aa3d4cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:03.440977 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f87706fe-3a56-426d-9b6e-d263aa3d4cb8 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1267 microversion: 2.1 time: 0.078083 Sep 03 21:48:03.441563 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3140/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:03 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:04.466074 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:04.467537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:04.492376 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:04.493310 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:04.496466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:04.498321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:04.499208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:04.499975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:04.599459 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:04.607744 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-54b10438-8557-44ed-aa35-1ad454b0b7fb tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1337 microversion: 2.1 time: 0.146743 Sep 03 21:48:04.621485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3373/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:04 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1337 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:05.633854 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:05.634473 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:05.642374 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:05.642867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:05.643308 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:05.644009 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:05.644466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:05.645062 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:05.858430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:05.868130 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-54def1bf-0f64-4dbe-a940-8822e72a3f23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.238554 Sep 03 21:48:05.869001 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3141/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:05 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:06.012024 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2160b10e-d4a1-4a41-9d58-0ca9fbca93d6", "tag": "29952e83-3b70-460f-b631-1e3001e24b99"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:06.021834 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:06.022315 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:06.022751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:06.033649 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] Creating event network-changed:29952e83-3b70-460f-b631-1e3001e24b99 for instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 on nch2-master-1 Sep 03 21:48:06.038691 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fd15535d-61a4-453f-8941-295ffbd52c4e req-181a96f0-db13-426d-8a38-075acbfac770 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085437 Sep 03 21:48:06.039450 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3374/6515] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:48:06.894168 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:06.894737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:06.902375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:06.902865 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:06.903309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:06.904010 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:06.904470 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:06.904962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:07.039144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:07.046890 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-65ac20fd-41f6-4b56-90dc-366808a8b789 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.156746 Sep 03 21:48:07.047461 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3142/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:06 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:08.070381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:08.071083 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:08.078460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:08.078947 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:08.079386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:08.080161 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:08.080626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:08.081191 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:08.222283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:08.230728 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c95b9422-04ca-4f15-8cd4-ef09c3cbedae tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.164605 Sep 03 21:48:08.231317 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3375/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:08 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:09.254136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:09.254773 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:09.262328 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:09.262812 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:09.263251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:09.263944 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:09.264399 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:09.264828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:09.395315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:09.403079 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-279f5a20-65ae-4ea3-99b8-57b350b9df49 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.152836 Sep 03 21:48:09.403655 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3143/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:09 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:10.426003 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:10.426609 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:10.440708 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:10.440840 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:10.441283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:10.442370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:10.442587 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:10.443002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:10.487323 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160b10e-d4a1-4a41-9d58-0ca9fbca93d6", "name": "network-vif-plugged", "status": "completed", "tag": "29952e83-3b70-460f-b631-1e3001e24b99"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:10.497852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:10.498359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:10.498796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:10.510405 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] Creating event network-vif-plugged:29952e83-3b70-460f-b631-1e3001e24b99 for instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 on nch2-master-1 Sep 03 21:48:10.515475 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-5d669369-b341-4ea0-9a5b-113a819d3839 req-3ea541f3-378f-4037-b134-1cf193caad98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083391 Sep 03 21:48:10.516095 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3144/6519] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:48:10.579769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:10.587790 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f6f44733-15ae-4daf-b60e-c8695ca8f4a7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.165781 Sep 03 21:48:10.588366 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3376/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:10 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:11.612205 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:11.612943 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:11.619519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:11.620017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:11.620502 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:11.621230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:11.621696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:11.622130 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:11.760251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:11.768367 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-2bc40150-210c-4749-8b5c-fa2818ba6a83 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1392 microversion: 2.1 time: 0.161264 Sep 03 21:48:11.768976 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3145/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:11 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:48:12.793107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:12.793723 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:12.796533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:12.797226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:12.802917 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:12.803407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:12.803899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:12.804603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:12.805097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:12.805530 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:12.940655 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:12.948431 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b8dd28e3-d1fa-4b1e-9cb6-93d192f86a5c tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1565 microversion: 2.1 time: 0.159270 Sep 03 21:48:12.949037 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3377/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:12 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:12.971487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:12.972105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:12.979456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:12.979936 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:12.980372 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:12.981094 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:12.981552 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:12.981979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:13.114611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:13.122667 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94c96062-effe-42f1-ab20-c1ca2e7a4f33 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1565 microversion: 2.1 time: 0.154933 Sep 03 21:48:13.123247 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3146/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:12 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:48:14.695979 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:14.697380 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:14.697568 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2160b10e-d4a1-4a41-9d58-0ca9fbca93d6", "tag": "29952e83-3b70-460f-b631-1e3001e24b99"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:14.704766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:14.705461 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:14.706269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:14.706957 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:14.707953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:14.708626 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:14.709297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:14.711318 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:14.711830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:14.712595 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:14.724502 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] Creating event network-changed:29952e83-3b70-460f-b631-1e3001e24b99 for instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 on nch2-master-1 Sep 03 21:48:14.730614 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-03c6d938-3793-4272-812a-36cfa54d7e96 req-464e1274-3049-43bd-b572-4597df0992f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Sep 03 21:48:14.731725 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3147/6524] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:48:14.868470 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:14.876840 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-410df1dc-a90d-4909-83fa-00af89f8ffa0 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1565 microversion: 2.1 time: 0.185777 Sep 03 21:48:14.877507 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3378/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:14 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:36.119254 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:36.120061 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=34 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:36.124694 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:36.126991 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:36.135218 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:36.135716 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:36.136165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:36.136877 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:36.137363 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:36.137792 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:36.196356 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ffc77022-9c56-4406-ab39-af8d4f03c294 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action" status: 200 len: 24534 microversion: 2.1 time: 0.078878 Sep 03 21:48:36.197032 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3148/6526] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:48:36 2022] POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action => generated 24534 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:48:47.286568 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:47.287123 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:47.289767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:47.290560 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=34 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:47.296931 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:47.297419 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:47.297856 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:47.298551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:47.299002 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:47.299429 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:47.323585 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.objects.instance [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lazy-loading 'flavor' on Instance uuid 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 {{(pid=140520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:48:47.387865 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d5034bc-1d57-4078-bc1c-8ccbe0f57704 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action" status: 202 len: 0 microversion: 2.1 time: 0.105164 Sep 03 21:48:47.388428 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3379/6527] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:48:47 2022] POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:48:47.397260 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:47.398578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:47.401556 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:47.402248 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=4 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:47.411105 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:47.411594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:47.412033 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:47.412742 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:47.413230 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:47.413658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:47.551710 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:47.559549 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-474c9bfb-b365-4fd8-9187-d5fa8da84fb7 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1690 microversion: 2.1 time: 0.166735 Sep 03 21:48:47.560115 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3149/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:47 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:48.584692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:48.585439 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:48.593367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:48.593861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:48.594340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:48.595050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:48.595515 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:48.595952 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:48.735803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:48.744858 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-17a7aa9f-792d-4732-b7dd-3f29cfd0ae98 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1673 microversion: 2.1 time: 0.163628 Sep 03 21:48:48.745483 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3380/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:48 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:49.842416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:49.844654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:49.851505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:49.851998 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:49.852442 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:49.853172 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:49.853633 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:49.854063 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:49.905985 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-008c0353-7bd1-4ebe-8905-1b2448d87c7f tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action" status: 200 len: 38362 microversion: 2.1 time: 0.067199 Sep 03 21:48:49.906906 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3150/6530] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:48:49 2022] POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action => generated 38362 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:48:49.918652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:49.919205 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:49.926121 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:49.926639 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:49.927092 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:49.927797 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:49.928261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:49.928695 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:49.998549 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2149b0ed-4113-44d9-9bfb-df1aa8234986 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action" status: 202 len: 0 microversion: 2.1 time: 0.083597 Sep 03 21:48:49.999217 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3381/6531] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:48:49 2022] POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:48:50.008126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:50.008832 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:50.016472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:50.016996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:50.017437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:50.018155 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:50.018610 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:50.019040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:50.241006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:50.249525 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0e8fd2f5-229b-439e-b7fa-4b949f3bfab2 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1679 microversion: 2.1 time: 0.245643 Sep 03 21:48:50.250101 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3151/6532] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:50 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:51.275707 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:51.276421 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:51.282729 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:51.283222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:51.283673 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:51.284373 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:51.284837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:51.285301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:51.421471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:51.430025 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b0935ec-6f91-4496-b680-1f643663f828 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1679 microversion: 2.1 time: 0.159414 Sep 03 21:48:51.430738 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3382/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:51 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:52.456395 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:52.457072 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:52.465601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:52.466098 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:52.466548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:52.467259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:52.467723 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:52.468203 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:52.604081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:52.612042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-07ab35d8-8fa9-4d3c-a2fb-0b17c2f75bfd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1682 microversion: 2.1 time: 0.160983 Sep 03 21:48:52.612613 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3152/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:52 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:52.705675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:52.708025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:52.716871 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:52.717400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:52.717847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:52.718548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:52.719008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:52.719444 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:52.763755 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b62770a2-ed36-4f41-b807-81c0fb308f67 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action" status: 200 len: 38362 microversion: 2.1 time: 0.061794 Sep 03 21:48:52.764688 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3383/6535] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:48:52 2022] POST /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6/action => generated 38362 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 21:48:53.731514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:53.732026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:53.736030 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2160b10e-d4a1-4a41-9d58-0ca9fbca93d6", "tag": "29952e83-3b70-460f-b631-1e3001e24b99"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:53.740475 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:53.741004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:53.741456 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:53.742212 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:53.742680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:53.743344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:53.750497 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:53.751065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:53.751730 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:53.763938 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] Creating event network-changed:29952e83-3b70-460f-b631-1e3001e24b99 for instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 on nch2-master-1 Sep 03 21:48:53.768984 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-4cc7599d-ebe8-444e-a002-7d5b9a9a560b req-7557ae88-455c-46b6-a440-d4fedce8c856 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038682 Sep 03 21:48:53.769662 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3384/6536] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:48:53.774559 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:48:53.860916 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b3a39170-51b8-4c4c-84a0-8c37b665fd37 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 204 len: 0 microversion: 2.1 time: 0.133052 Sep 03 21:48:53.862012 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3153/6537] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:48:53 2022] DELETE /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:48:53.875837 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:53.877327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:53.890939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:53.891964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:53.892844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:53.894215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:53.895150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:53.895954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:54.064874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:54.073365 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-38160cd5-ab76-4e6d-a79e-73861b4a16fd tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1688 microversion: 2.1 time: 0.204375 Sep 03 21:48:54.073950 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3385/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:53 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:48:55.099985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:55.100609 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:55.107460 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:55.107953 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:55.108391 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:55.109126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:55.109583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:55.110548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:55.273109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22d9a2cf58104e3988e468a329eb6b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f2c6e6317c6424f83e70d52aee5b85d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:48:55.281042 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c5b7e2d5-8718-41e0-8ca5-63595d03bafe tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 200 len: 1688 microversion: 2.1 time: 0.185657 Sep 03 21:48:55.281620 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3154/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:55 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:48:55.834134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2160b10e-d4a1-4a41-9d58-0ca9fbca93d6", "name": "network-vif-deleted", "tag": "29952e83-3b70-460f-b631-1e3001e24b99"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:48:55.844323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:55.844818 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:55.845298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:55.856945 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] Creating event network-vif-deleted:29952e83-3b70-460f-b631-1e3001e24b99 for instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 on nch2-master-1 Sep 03 21:48:55.862114 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-afd34544-8634-453c-9337-ed7b47256859 req-81aec04e-75d1-4ddb-8a6e-cf943df4f498 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Sep 03 21:48:55.862644 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3386/6540] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:48:56.304298 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:56.304928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] [instance: 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:48:56.312324 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:56.312813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:56.313302 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:56.314003 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:48:56.314497 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:48:56.314949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:48:56.329361 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.wsgi [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] HTTP exception thrown: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Request method failure captured: Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: request: GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 HTTP/1.1 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Accept: application/json Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Accept-Encoding: identity Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Connection: close Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Content-Length: 0 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Content-Type: application/json Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Host: 10.222.0.16 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: Openstack-System-Scope: None Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: User-Agent: python-urllib3/1.26.12 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Auth-Token: gAAAAABjE8mMfuUq0a7B7AEY-Ngn84UZHMIBqTCw9leqOZaTdRfW6H7ezy2djfbUBWgonLxlNCRNR0__0tXsB8d9J9qbr8gtD35u_Zz5xlsFmmS1PTUhI0FHhNSJ2wH9a8UzWEXoefts8CN0HtJCOg72NSRDNqw5bTFJ5iIA-eSMrjHTsgGX3cQ Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Id: None Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Domain-Name: None Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Identity-Status: Confirmed Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Is-Admin-Project: True Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Id: default Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Domain-Name: Default Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Role: member,reader Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Roles: member,reader Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9f2c6e6317c6424f83e70d52aee5b85d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Id: 9f2c6e6317c6424f83e70d52aee5b85d Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-550178637 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-User: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Id: default Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-User-Domain-Name: Default Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-User-Id: 22d9a2cf58104e3988e468a329eb6b80 Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: X-User-Name: tempest-TestNetworkAdvancedServerOps-550178637-project Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: method: > Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: exception: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: action_args: {'id': '2160b10e-d4a1-4a41-9d58-0ca9fbca93d6'} Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:48:56.331148 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: ERROR nova.api.openstack.wsgi Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Returning 404 to user: Instance 2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 could not be found. {{(pid=140519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4d0e88a2-f4d6-4d32-bbbc-73546fc112be tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6" status: 404 len: 111 microversion: 2.1 time: 0.033535 Sep 03 21:48:56.335834 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3155/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:48:56 2022] GET /compute/v2.1/servers/2160b10e-d4a1-4a41-9d58-0ca9fbca93d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:48:59.582389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-478bb144-f47c-46dd-92f7-d818abc3fd23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] Calling method '.version_select at 0x7fae65f91d30>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:48:59.615062 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-478bb144-f47c-46dd-92f7-d818abc3fd23 tempest-TestNetworkAdvancedServerOps-550178637 tempest-TestNetworkAdvancedServerOps-550178637-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1023326665" status: 202 len: 0 microversion: 2.1 time: 0.036818 Sep 03 21:48:59.615709 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3387/6542] 10.222.0.16 () {58 vars in 1284 bytes} [Sat Sep 3 21:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1023326665 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:49:10.833336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:10.837209 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:11.051939 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4359995f-1c3c-41cc-b42b-2f3f4d57ea35 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Action: 'create', calling method: .version_select at 0x7fae65bf8820>, body: {"keypair": {"name": "tempest-TestShelveInstance-10287340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwLY9Lhawyp/LrDctlcVoODQOtB9bXw6AlPcZh80ygax5Kqm/q7Y9Xrvvj0O9jDI8mU/6Wy3iD6nQEprF+MIWZNX4x41ndMnU7WfcCz52MdbKvoT6AW7G0pXfkUxfSQAg=="}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:49:11.070823 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4359995f-1c3c-41cc-b42b-2f3f4d57ea35 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for project f101b0010f234a4199e698ad0b8decd7. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:49:11.077282 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-4359995f-1c3c-41cc-b42b-2f3f4d57ea35 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for user 03f57e800a6d4ca8a9080aa14d875cf3 and project f101b0010f234a4199e698ad0b8decd7. Resources: {'key_pairs'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:49:11.107050 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4359995f-1c3c-41cc-b42b-2f3f4d57ea35 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.280535 Sep 03 21:49:11.112953 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3156/6543] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:49:10 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:49:12.065321 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:12.066181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:12.070323 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-377821327", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-10287340", "security_groups": [{"name": "tempest-secgroup-smoke-438487399"}], "networks": [{"uuid": "861bd7e8-1914-4136-b3ab-fb02339bf42e"}]}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:49:12.188153 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.network.neutron [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] validate_networks() for [('861bd7e8-1914-4136-b3ab-fb02339bf42e', None, None, None, None, None)] {{(pid=140520) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:49:12.578551 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Flavor limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:49:12.578980 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Image limits 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:49:12.579464 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Flavor pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:49:12.579874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Image pref 0:0:0 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:49:12.580283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.virt.hardware [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:49:12.592320 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:12.593020 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:12.593483 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:12.594231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:12.594691 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:12.595128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:12.613194 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for project f101b0010f234a4199e698ad0b8decd7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:49:12.619289 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for user 03f57e800a6d4ca8a9080aa14d875cf3 and project f101b0010f234a4199e698ad0b8decd7. Resources: {'cores', 'ram', 'instances'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:49:12.632093 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Going to run 1 instances... {{(pid=140520) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:49:12.634606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:49:12.683401 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7fe82515-3f92-4b18-b697-0634635c27d3 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619557 Sep 03 21:49:12.684246 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3388/6544] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:49:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:49:12.696934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3ca166c5-a3e4-4a75-b8c2-ee508cb7384e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:12.698207 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-3ca166c5-a3e4-4a75-b8c2-ee508cb7384e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:12.759365 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-3ca166c5-a3e4-4a75-b8c2-ee508cb7384e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:12.767214 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3ca166c5-a3e4-4a75-b8c2-ee508cb7384e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1244 microversion: 2.1 time: 0.075165 Sep 03 21:49:12.767905 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3157/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:12 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:49:13.799231 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:13.802722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:13.816248 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:13.816756 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:13.817340 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:13.818065 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:13.818768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:13.819261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:13.906798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:13.918382 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c06e6af5-7919-409e-b06b-c99610abc683 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1304 microversion: 2.1 time: 0.129797 Sep 03 21:49:13.919437 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3389/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:13 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:49:14.943622 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:14.944373 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:14.951878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:14.952366 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:14.952830 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:14.953563 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:14.954265 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:14.954741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:15.094136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:15.104477 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a3ed8667-c757-402c-95a5-66345eb93142 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.164699 Sep 03 21:49:15.105096 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3158/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:14 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:15.395107 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:49:15.406048 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:15.407458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:15.407887 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:15.419331 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] Creating event network-changed:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch1-master-1 Sep 03 21:49:15.424466 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-e885763e-8fe9-4451-95ab-a55dabe028de req-fed4880e-f4c5-4f55-bc74-8a5c7e39c32f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Sep 03 21:49:15.424837 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3390/6548] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:49:16.128571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:16.129219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:16.136695 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:16.137216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:16.137658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:16.138352 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:16.138807 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:16.139235 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:16.270519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:16.278835 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7392e1d4-6c29-4502-9ef6-246f75d28f60 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.154242 Sep 03 21:49:16.279417 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3159/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:16 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:17.303311 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:17.304008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:17.310811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:17.311293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:17.311735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:17.312430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:17.312885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:17.313332 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:17.448022 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:17.455808 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4583d5ca-fa4c-4fe1-89cc-f4c71686ee7a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.157493 Sep 03 21:49:17.456384 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3391/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:17 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:49:18.479433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:18.480087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:18.487102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:18.487597 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:18.488045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:18.489034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:18.489499 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:18.489934 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:18.626878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:18.634546 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8e309b2-bce1-4ae7-b070-264d0cd8c35b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.159075 Sep 03 21:49:18.635113 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3160/6551] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:18 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:19.658137 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:19.658865 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:19.665613 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:19.666096 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:19.666535 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:19.667240 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:19.667726 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:19.668151 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:19.804106 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:19.812276 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d705ddc1-f0a3-4d72-b8b4-f2bddefa702c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.158252 Sep 03 21:49:19.812840 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3392/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:19 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:20.835872 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:20.836487 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:20.843968 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:20.844451 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:20.844884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:20.845594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:20.846046 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:20.846478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:20.975216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:20.983154 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-32da82c3-84ad-49d8-9813-d4cd9e851938 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.151128 Sep 03 21:49:20.983724 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3161/6553] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:20 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:21.674916 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "name": "network-vif-plugged", "status": "completed", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:49:21.685211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:21.685746 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:21.686188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:21.697422 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] Creating event network-vif-plugged:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch1-master-1 Sep 03 21:49:21.702407 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8b807d66-59d3-42ce-86db-f282ac7898f5 req-42835056-462a-4c11-b8db-94a2258a4c4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032149 Sep 03 21:49:21.702998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3393/6554] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:49:22.005813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:22.006359 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:22.013297 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:22.013791 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:22.014238 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:22.014942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:22.015403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:22.015844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:22.149321 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:22.157848 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-093c124a-2e41-4265-8f1d-63f1151dcd05 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1369 microversion: 2.1 time: 0.156014 Sep 03 21:49:22.158424 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3162/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:22 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:23.178536 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:23.179939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:23.186097 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:23.187015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:23.195348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:23.195961 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:23.196407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:23.197136 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:23.197594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:23.198023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:23.342215 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:23.350873 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-210dbc63-7536-4bcf-a52e-3c68b46074d7 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1553 microversion: 2.1 time: 0.172426 Sep 03 21:49:23.350873 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3394/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:23 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:23.374022 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:49:23.374582 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:49:23.376447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:23.382741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:23.383233 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:23.383675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:23.384364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:23.384822 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:23.385274 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:23.519918 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:49:23.528108 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-91b6a2ef-4c40-4d1a-979b-e385f75e8002 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1553 microversion: 2.1 time: 0.158675 Sep 03 21:49:23.528669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3163/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:49:23 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:49:25.515833 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:49:25.526183 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:49:25.526675 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:49:25.527700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:49:25.539447 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] Creating event network-changed:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch1-master-1 Sep 03 21:49:25.544424 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8b610472-ff25-4b8e-977e-6de0bf5c4000 req-0d38b291-4392-4e04-8d7b-ee61831b3fad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032992 Sep 03 21:49:25.545198 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3395/6558] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:51:51.388420 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28395305-e252-49c9-92ac-3fa5f0117ad7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:51:51.389336 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:51:51.391270 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:51:51.391436 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action (ip 10.222.0.16) !!! Sep 03 21:51:51.392544 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:51:51.392677 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action (ip 10.222.0.16) !!! Sep 03 21:51:51.393767 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:51:51.393883 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action (ip 10.222.0.16) !!! Sep 03 21:51:51.394697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:51.395526 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=36 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:51.400769 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:51:51.401346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:51.414154 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:51.414648 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:51.415093 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:51.415796 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:51.416263 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:51.416698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:51.442418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lazy-loading 'flavor' on Instance uuid 2e49133a-923d-4b59-9d54-f939027e8b99 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:51:51.823213 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a08a6488-76c3-4d11-a22c-93c85d9d653c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "POST /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action" status: 202 len: 0 microversion: 2.1 time: 0.436476 Sep 03 21:51:51.823824 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3164/6559] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:51:51 2022] POST /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:51:51.830235 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8576e9d9-19e2-4136-8719-7ca8f7a5745b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:51:51.831146 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ca0939e-d101-47d9-8ca9-7ff5fc132ccc] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:51:51.831811 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:51.832563 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=32 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:51.835998 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:51:51.836143 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 (ip 10.222.0.16) !!! Sep 03 21:51:51.843207 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:51.843974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:51.852870 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:51.853384 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:51.853832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:51.854545 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:51.856785 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:51.857295 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:52.072803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:52.081003 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5b09612f-31bc-47ae-9754-1b5358598c18 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.252631 Sep 03 21:51:52.081593 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3396/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:51 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:53.108039 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:53.108734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:53.121994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:53.124563 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44238. Sep 03 21:51:53.128161 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] [28395305-e252-49c9-92ac-3fa5f0117ad7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44236. Sep 03 21:51:53.263353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:53.271145 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-cd0786cc-1638-48d3-9036-780b73656d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.169271 Sep 03 21:51:53.271711 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3165/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:53 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:54.293825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:54.294443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:54.304853 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:54.305379 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:54.305830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:54.306540 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:54.307005 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:54.307474 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:54.314246 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] [8576e9d9-19e2-4136-8719-7ca8f7a5745b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44246. Sep 03 21:51:54.314917 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ca0939e-d101-47d9-8ca9-7ff5fc132ccc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44248. Sep 03 21:51:54.442652 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:54.450389 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f0b3af9f-21a6-44e5-8dc9-84262a6eb075 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.160482 Sep 03 21:51:54.450968 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3397/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:54 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:55.475034 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:55.475649 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:55.482520 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:55.483000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:55.483436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:55.484127 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:55.484583 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:55.485048 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:55.617816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:55.625599 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-79f976de-2cd6-4d93-a62d-af81c3b0b3bd tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.154500 Sep 03 21:51:55.626160 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3166/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:55 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:56.648290 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:56.648923 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:56.655799 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:56.656288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:56.656732 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:56.657945 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:56.658415 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:56.658836 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:56.786521 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:56.794251 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-231942cf-a54a-415a-bbc3-6087407d1d64 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.149933 Sep 03 21:51:56.794933 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3398/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:56 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:57.819193 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:57.819815 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:57.826740 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:57.827236 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:57.827674 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:57.828379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:57.828930 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:57.829771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:57.963964 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:57.971894 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-fef48e2c-6bf4-4712-8a73-d0c9ee176e01 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.156651 Sep 03 21:51:57.972469 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3167/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:57 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:51:58.996227 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:51:58.996953 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:51:59.004319 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:59.004803 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:59.005269 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:59.005966 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:51:59.006426 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:51:59.006862 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:51:59.139070 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:51:59.147609 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-554faede-cfce-4093-9314-d490452524d5 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.155326 Sep 03 21:51:59.148186 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3399/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:51:58 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:00.171261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:00.171828 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:00.178860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:00.179353 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:00.179802 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:00.180535 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:00.181026 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:00.181465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:00.311305 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:00.319740 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-61fe7333-8745-4673-8287-11f6faa683ec tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.152479 Sep 03 21:52:00.320315 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3168/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:00 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:01.343984 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:01.345132 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:01.352084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:01.352571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:01.353056 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:01.353768 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:01.354234 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:01.354672 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:01.483400 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:01.491462 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-85dc586d-92e4-4a6b-9329-bdf4796b9f83 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.151422 Sep 03 21:52:01.492032 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3400/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:01 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:02.515102 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:02.515625 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:02.522621 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:02.523111 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:02.523553 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:02.524257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:02.524719 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:02.525176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:02.654076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:02.662349 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f8b91d77-013e-4728-99a3-d99274a43cd1 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.151272 Sep 03 21:52:02.662921 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3169/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:02 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:03.686128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:03.686743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:03.694226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:03.694717 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:03.695157 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:03.695854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:03.696309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:03.696735 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:03.831218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:03.839001 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-61840278-bb1b-4fe5-a04b-07803a79b79d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1698 microversion: 2.1 time: 0.156790 Sep 03 21:52:03.839875 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3401/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:03 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:04.862617 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:04.863267 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:04.870347 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:04.870840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:04.871284 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:04.871979 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:04.872436 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:04.872866 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:05.006697 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:05.014462 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-09376eda-2c3d-4c3a-bfa4-0969b78e446f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1698 microversion: 2.1 time: 0.155778 Sep 03 21:52:05.015035 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3170/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:04 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:06.039218 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:06.039844 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:06.046769 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:06.047261 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:06.047741 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:06.048432 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:06.048890 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:06.049353 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:06.181150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:06.188941 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f542351c-56b2-44ed-9da5-c6fc30931679 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1698 microversion: 2.1 time: 0.153650 Sep 03 21:52:06.189533 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3402/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:06 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:07.212860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:07.213516 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:07.220876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:07.221390 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:07.221837 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:07.222532 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:07.222994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:07.223426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:07.351673 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:07.359472 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-5df520ea-5258-43ae-b18b-ebdcf4bbb385 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1698 microversion: 2.1 time: 0.150524 Sep 03 21:52:07.360652 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3171/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:07 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:08.383762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:08.384386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:08.391260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:08.391747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:08.392195 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:08.392930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:08.393388 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:08.393822 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:08.499957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "name": "network-vif-plugged", "status": "completed", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:52:08.512073 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:08.512924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:08.513455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:08.529391 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] Creating event network-vif-plugged:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch1-master-1 Sep 03 21:52:08.529641 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:08.535754 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-008073f3-26da-4cb0-9468-8cd08d6eefa6 req-23cfc7b5-9b23-45a1-a566-e0cd9d316eed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039483 Sep 03 21:52:08.536722 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3172/6574] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:52:08.539102 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4e83510b-dc36-4863-9ec9-5eeae8a6a31f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1698 microversion: 2.1 time: 0.159156 Sep 03 21:52:08.550766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3403/6575] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:08 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:09.565455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:09.568422 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:09.575790 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:09.576368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:09.576881 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:09.577799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:09.578492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:09.579679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:09.740426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:09.751024 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-62a7e1f3-d1ca-4991-b652-6f5082008f3d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.191173 Sep 03 21:52:09.767963 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3173/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:09 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:10.782553 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:10.783216 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:10.794271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:10.794765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:10.795208 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:10.795959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:10.796416 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:10.796847 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:10.947841 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:10.957093 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-497b5633-d9d6-4593-a2e0-81b6d51f7f0d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.185265 Sep 03 21:52:10.957918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3404/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:10 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:11.980749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:11.981429 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:11.992942 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:11.993435 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:11.993878 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:11.994578 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:11.995164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:11.995600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:12.147371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:12.155309 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ac5138e7-8cb9-4886-a742-4f14bb92341d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.178400 Sep 03 21:52:12.174918 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3174/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:11 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:13.190148 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:13.191581 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:13.206156 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:13.206934 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:13.207378 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:13.208089 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:13.208552 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:13.209008 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:13.356211 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:13.365211 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-880e92bb-2850-49dc-be24-89e34588407e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.183853 Sep 03 21:52:13.376918 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3405/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:13 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:14.389753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:14.390319 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:14.401051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:14.401547 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:14.401992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:14.402696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:14.403150 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:14.403655 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:14.571226 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:14.580277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-322df47f-a171-48df-aa10-55c2dde6b50e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.194148 Sep 03 21:52:14.593836 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3175/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:14 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:15.603999 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:15.604805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:15.611796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:15.612294 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:15.612742 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:15.613487 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:15.613954 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:15.614402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:15.777794 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:15.789111 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5d525790-e8ff-4f07-babd-180e97b85f5e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.189124 Sep 03 21:52:15.794699 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3406/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:15 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:16.814860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:16.815601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:16.822508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:16.823000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:16.823440 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:16.824132 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:16.824594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:16.825054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:16.975995 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:16.984007 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-ccd169aa-d331-454b-849d-0e7d0634e03f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.173611 Sep 03 21:52:16.984577 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3176/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:16 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:52:18.010199 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:18.010854 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:18.018226 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:18.018713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:18.019158 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:18.019861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:18.020326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:18.020760 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:18.149946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:18.158429 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-30c4a88d-0da1-4e23-b5dc-aa3b36819c5b tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1693 microversion: 2.1 time: 0.151531 Sep 03 21:52:18.159008 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3407/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:18 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:19.182626 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:19.183251 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:19.190219 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:19.190713 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:19.191158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:19.191862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:19.192326 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:19.192761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:19.321994 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:19.329726 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-a03efe91-cd3e-4553-91ba-1f8615be272f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1675 microversion: 2.1 time: 0.150966 Sep 03 21:52:19.330301 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3177/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:19 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:20.354043 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:20.354660 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:20.361956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:20.362430 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:20.362866 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:20.363559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:20.364012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:20.364443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:20.496766 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:20.505487 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-444f0e1d-0fcf-413b-a96f-6c302a134f7f tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1675 microversion: 2.1 time: 0.155322 Sep 03 21:52:20.506063 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3408/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:20 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:21.529198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:21.529825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:21.532668 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=29 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:52:21.538060 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:21.538555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:21.539006 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:21.539709 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:21.540176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:21.540613 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:21.544825 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:52:21.679810 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:21.687530 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-326faec4-ba9f-4a64-9d68-c41bf69f6ece tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1618 microversion: 2.1 time: 0.162292 Sep 03 21:52:21.688111 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3178/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:21 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1618 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:21.710846 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:52:21.711453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:21.718301 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:21.718792 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:21.719236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:21.719930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:21.720389 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:21.720819 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:21.761571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140520) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 21:52:21.825308 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [79f0fa3a-3dec-4691-8b95-1b0105b2573a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 21:52:22.497700 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "name": "network-vif-unplugged", "status": "completed", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:52:22.507483 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:22.507970 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:22.508403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:22.520679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.compute.server_external_events [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] Unable to find a host for instance 2e49133a-923d-4b59-9d54-f939027e8b99. Dropping event network-vif-unplugged {{(pid=140519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 21:52:22.521597 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-36403458-4854-4fac-8311-63da60e368f1 req-463eda2f-fd38-4428-9166-49a9b650b27f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027780 Sep 03 21:52:22.522187 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3179/6587] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 03 21:52:22.833060 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [79f0fa3a-3dec-4691-8b95-1b0105b2573a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44362. Sep 03 21:52:22.836366 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-d6a23a46-f1a8-4bdf-b02a-d2d0003e7253 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "POST /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action" status: 202 len: 0 microversion: 2.1 time: 1.129436 Sep 03 21:52:22.837005 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3409/6588] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:52:21 2022] POST /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:52:22.845257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:22.845924 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:22.852856 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:22.853375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:22.853817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:22.854519 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:22.854980 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:22.855413 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:22.992748 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:23.001248 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4180224f-ab38-40e4-91bf-e78bb56d79cb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1626 microversion: 2.1 time: 0.160019 Sep 03 21:52:23.002393 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3180/6589] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:22 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1626 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:52:24.027399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:24.028327 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:24.029991 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:52:24.037930 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:24.038434 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:24.038885 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:24.039603 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:24.040076 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:24.040514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:24.043366 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:52:24.178260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:24.186202 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-08a0f45f-fa30-4f94-adb2-9b88b2281fda tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1628 microversion: 2.1 time: 0.163557 Sep 03 21:52:24.186776 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3410/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:24 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1628 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:25.198279 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:52:25.208681 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:25.209362 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:25.209798 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:25.211071 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:25.211796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:25.218549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:25.219326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:25.219933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:25.221398 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:25.221772 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] Creating event network-changed:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch2-master-1 Sep 03 21:52:25.222045 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:25.222541 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:25.227462 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-e3e70d07-f27f-4905-8429-199e628e5b36 req-5e9fa564-a6f9-41dd-9bdc-3d4149136bb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Sep 03 21:52:25.228108 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3181/6591] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:52:25.452971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:25.461428 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1b2557d8-9c62-452a-aec0-aa430d6309b6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.254960 Sep 03 21:52:25.462010 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3411/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:25 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:52:26.485741 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:26.486523 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:26.493801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:26.494289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:26.494730 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:26.495424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:26.495880 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:26.496309 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:26.665966 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:26.674578 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-910c1d78-0575-46ad-9ba0-06f53917f548 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.193024 Sep 03 21:52:26.687623 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3182/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:26 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:27.704440 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:27.706770 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:27.714060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:27.714559 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:27.715012 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:27.715740 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:27.716222 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:27.716645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:27.859753 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:27.868027 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-5987097e-9c77-49f1-ba2e-21b0c5fb5fbb tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.169477 Sep 03 21:52:27.868605 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3412/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:27 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:28.895747 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:28.897472 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:28.907344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:28.908564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:28.909133 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:28.910720 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:28.911257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:28.911816 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:29.057430 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:29.065282 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-e84cc842-df73-424d-a149-2a78378b8f6d tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.176937 Sep 03 21:52:29.065853 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3183/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:28 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:30.092288 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:30.094052 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:30.102363 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:30.103185 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:30.103883 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:30.104869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:30.105447 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:30.105956 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:30.257514 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:30.268294 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e462bb93-521f-4274-8181-d6b6d6268742 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.181734 Sep 03 21:52:30.271516 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3413/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:30 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:52:31.294090 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:31.294699 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:31.302266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:31.302744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:31.303178 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:31.303861 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:31.304313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:31.304737 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:31.461371 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:31.469250 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-7dec894f-b568-4c68-a84b-708501c4fec8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.179182 Sep 03 21:52:31.469830 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3184/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:31 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:32.494050 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:32.494709 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:32.502189 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:32.502689 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:32.503143 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:32.503855 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:32.504317 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:32.504751 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:32.697908 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:32.709697 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-0b7194de-eba1-424c-bb21-7a059d76adae tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.219622 Sep 03 21:52:32.710924 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3414/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:32 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:33.735369 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:33.736448 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:33.753382 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:33.753893 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:33.754339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:33.755054 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:33.755514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:33.755957 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:33.897049 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:33.904921 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-29fddf31-6a49-467e-9433-d994d4b09d90 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.173560 Sep 03 21:52:33.905497 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3185/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:33 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:34.929558 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:34.930128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:34.937135 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:34.937949 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:34.938548 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:34.939623 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:34.940407 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:34.940938 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:35.090309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:35.098752 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-2d585315-0991-4554-8794-164c06eb413c tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.173163 Sep 03 21:52:35.099370 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3415/6600] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:34 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:36.123415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:36.124029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:36.131643 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:36.132281 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:36.133012 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:36.133996 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:36.134685 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:36.135306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:36.279537 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:36.288181 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c2330a78-926d-46ac-8cb7-acf98b13b5a8 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.168674 Sep 03 21:52:36.288767 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3186/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:36 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:37.311594 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:37.312245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:37.319193 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:37.319679 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:37.320116 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:37.320861 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:37.321293 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:37.321722 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:37.457620 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:37.465261 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-ff78be78-124c-414c-ba9c-1d9c70dbe399 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.157527 Sep 03 21:52:37.465831 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3416/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:37 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:38.491426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:38.492045 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:38.498947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:38.499439 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:38.499884 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:38.500580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:38.501074 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:38.502122 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:38.632447 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:38.640263 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b4454f91-c35b-4b23-9f8c-85b1b7ac9600 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.153037 Sep 03 21:52:38.640830 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3187/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:38 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:39.663848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:39.664382 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:39.671348 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:39.671838 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:39.672281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:39.673506 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:39.673971 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:39.674402 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:39.789272 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "name": "network-vif-plugged", "status": "completed", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:52:39.801176 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:39.801783 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:39.802266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:39.810345 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:39.817389 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] Creating event network-vif-plugged:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch2-master-1 Sep 03 21:52:39.822146 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e917acc2-fa25-46d5-afcb-b64415a34c91 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.162297 Sep 03 21:52:39.823095 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3417/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:39 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:39.824562 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-21e49dcd-6e77-46e9-925f-f26f623ae071 req-af2f6043-46be-48b4-97cc-3b7153005478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 Sep 03 21:52:39.825091 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3188/6605] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:52:40.847565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:40.848181 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:40.855367 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:40.855858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:40.856296 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:40.857032 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:40.857489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:40.857921 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:40.989047 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:40.997051 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e052b978-a4cf-4736-80af-835aa335967a tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1684 microversion: 2.1 time: 0.153396 Sep 03 21:52:40.997623 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3418/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:40 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:52:42.022706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:52:42.023411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:52:42.029599 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:42.030088 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:42.030534 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:42.031239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:52:42.031702 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:52:42.032135 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:52:42.165705 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:52:42.173638 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-02338679-96aa-406b-a5e4-fdb0c397ce59 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1671 microversion: 2.1 time: 0.156498 Sep 03 21:52:42.174214 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3189/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:52:42 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:53:54.994834 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=23 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:54.995592 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=59 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:55.001642 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=17 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:55.002676 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=53 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:55.004663 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:53:55.004806 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 (ip 10.222.0.16) !!! Sep 03 21:53:55.010370 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:53:55.013798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:53:55.021869 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:55.022355 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:55.022791 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:55.023696 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:55.024155 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:55.024583 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:55.051831 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Going to try to terminate instance {{(pid=140520) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:53:55.074594 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:53:55.085339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:55.085811 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:55.086418 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:55.098259 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] Creating event network-changed:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch2-master-1 Sep 03 21:53:55.103401 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-01fc35b3-fe3f-45f0-9611-1e4fb9d3cbad req-e983f549-b09e-4642-960f-39517bdab523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110598 Sep 03 21:53:55.104139 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3190/6608] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:53:55.152870 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-210d34de-444f-4667-ac3b-2646059ae4ff tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 204 len: 0 microversion: 2.1 time: 0.162554 Sep 03 21:53:55.153871 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3419/6609] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:53:54 2022] DELETE /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:53:55.162858 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:53:55.164051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:53:55.171409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:55.172167 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:55.172819 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:55.173675 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:55.174269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:55.175289 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:55.314400 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:53:55.323004 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b6a81ff-3896-4f4f-8aeb-60e75824c959 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.164500 Sep 03 21:53:55.323586 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3191/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:53:55 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:53:56.348192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:53:56.348914 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:53:56.356084 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:56.356565 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:56.357040 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:56.357738 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:56.358188 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:56.358610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:56.586522 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f57e800a6d4ca8a9080aa14d875cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f101b0010f234a4199e698ad0b8decd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:53:56.594692 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-01bbb379-a506-428c-8547-9ed31be0f60e tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 200 len: 1677 microversion: 2.1 time: 0.250694 Sep 03 21:53:56.595280 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3420/6611] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:53:56 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:53:57.118840 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e49133a-923d-4b59-9d54-f939027e8b99", "name": "network-vif-deleted", "tag": "e521bbd6-f06d-49e2-bcd1-f23665b3f6fe"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:53:57.130064 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:57.130555 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:57.130992 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:57.142385 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] Creating event network-vif-deleted:e521bbd6-f06d-49e2-bcd1-f23665b3f6fe for instance 2e49133a-923d-4b59-9d54-f939027e8b99 on nch2-master-1 Sep 03 21:53:57.147615 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-909b7a03-8261-4c38-ba0a-c1c8ad5bed17 req-f67e7632-830e-4e36-814a-945968b9a6b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Sep 03 21:53:57.148301 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3192/6612] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:53:57.619263 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:53:57.619800 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] [instance: 2e49133a-923d-4b59-9d54-f939027e8b99] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:53:57.626528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:57.627015 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:57.627451 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:57.628628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:53:57.629118 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:53:57.629549 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:53:57.642613 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] HTTP exception thrown: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Request method failure captured: Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 HTTP/1.1 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE8vR0aaDD2M0Uf_R-NZI7uVILM3H0WZxVdQ37mk2Z_Bx18zaGZqI1PI-ATm8-DqlIk1v7nVWEh-3Ua9kq2byZIqmAmIwOMRwXoqtiMZTqsTUcMQRglKcX1Y8Y8Z_p7Kk0tCNs0OLJ3Pf1FbWsQ1LskgfdBlbSdLH0FI1y4kiA8IRVXg Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: f101b0010f234a4199e698ad0b8decd7 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestShelveInstance-940777711 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f101b0010f234a4199e698ad0b8decd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f101b0010f234a4199e698ad0b8decd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f101b0010f234a4199e698ad0b8decd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f101b0010f234a4199e698ad0b8decd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestShelveInstance-940777711 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: f101b0010f234a4199e698ad0b8decd7 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestShelveInstance-940777711 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestShelveInstance-940777711-project Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 03f57e800a6d4ca8a9080aa14d875cf3 Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestShelveInstance-940777711-project Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': '2e49133a-923d-4b59-9d54-f939027e8b99'} Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:53:57.644919 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Returning 404 to user: Instance 2e49133a-923d-4b59-9d54-f939027e8b99 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-b7a9341b-f8cd-42fb-826d-f02ce6b37b52 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99" status: 404 len: 111 microversion: 2.1 time: 0.031362 Sep 03 21:53:57.649409 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3421/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:53:57 2022] GET /compute/v2.1/servers/2e49133a-923d-4b59-9d54-f939027e8b99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:53:57.805698 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-3214aa61-56d8-4643-9d12-6bc890791432 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '.version_select at 0x7fae65da4b80>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:53:57.829407 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-3214aa61-56d8-4643-9d12-6bc890791432 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-10287340" status: 202 len: 0 microversion: 2.1 time: 0.027810 Sep 03 21:53:57.829995 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3193/6614] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Sep 3 21:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-10287340 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:53:57.855102 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-c464ab87-725a-4236-815b-2c21501708f9 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Action: 'create', calling method: .version_select at 0x7fae65c501f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2068992706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7LxgJDVLVMdv0p7MZ2tf9f/ToPw3DyR1nEFGQew1csg//K6tIg98vZhPfcKcFnrQHod97DnjypgwFjkCbYzrGuZj+FkMO6Laj8h3KN9ovxRKtvL5Fne6demN/BH+Xjg=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:53:57.870645 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c464ab87-725a-4236-815b-2c21501708f9 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for project f101b0010f234a4199e698ad0b8decd7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:53:57.875767 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-c464ab87-725a-4236-815b-2c21501708f9 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Getting quotas for user 03f57e800a6d4ca8a9080aa14d875cf3 and project f101b0010f234a4199e698ad0b8decd7. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:53:57.903308 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-c464ab87-725a-4236-815b-2c21501708f9 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052481 Sep 03 21:53:57.903905 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3422/6615] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:53:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:54:00.595669 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-bf3c861e-2014-460c-a9bf-fce5d11aa1f6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] Calling method '.version_select at 0x7fae65ae59d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:00.619088 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-bf3c861e-2014-460c-a9bf-fce5d11aa1f6 tempest-TestShelveInstance-940777711 tempest-TestShelveInstance-940777711-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2068992706" status: 202 len: 0 microversion: 2.1 time: 0.028196 Sep 03 21:54:00.620043 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3194/6616] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Sep 3 21:54:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2068992706 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 21:54:18.017668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:18.019004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=4 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:18.020049 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:18.212946 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-8b32763d-164d-4b3c-99aa-4528b6f75fd8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Action: 'create', calling method: .version_select at 0x7fae65be6430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-209059865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIwFWcwpsHKDSCdunv4uxoRINkvPzLHi19qUTOrMNmI30pOu96W62TRk2hDqsJWeycZiXyrLqV5+rDvjhLoMEFD9z2TA2ZNU/fhBNGRfKUI8u0W8P7IZDB+msxRaiyNjQ=="}} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:54:18.230046 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-8b32763d-164d-4b3c-99aa-4528b6f75fd8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:54:18.235381 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.quota [None req-8b32763d-164d-4b3c-99aa-4528b6f75fd8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for user 229f2394f4a64bb09c05994e012e2a55 and project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'key_pairs'} {{(pid=140520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:54:18.262503 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-8b32763d-164d-4b3c-99aa-4528b6f75fd8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.246584 Sep 03 21:54:18.263111 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3423/6617] 10.222.0.16 () {60 vars in 1159 bytes} [Sat Sep 3 21:54:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:54:19.247384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=10 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:19.248143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:19.252614 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-278825802", "imageRef": "bb6b1dcc-96d7-4d20-8933-997caa341790", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-209059865", "security_groups": [{"name": "tempest-secgroup-smoke-197953488"}], "networks": [{"uuid": "03f7f659-fc1a-451b-a38e-7809fe7e4e4a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:54:19.359266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] validate_networks() for [('03f7f659-fc1a-451b-a38e-7809fe7e4e4a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:54:19.880404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:54:19.880923 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:54:19.881478 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:54:19.881962 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:54:19.882521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:54:19.891346 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:19.891907 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:19.892414 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:19.893245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:19.893766 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:19.894259 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:19.913835 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:54:19.919243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for user 229f2394f4a64bb09c05994e012e2a55 and project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:54:19.932638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:54:19.935040 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bb6b1dcc-96d7-4d20-8933-997caa341790',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:54:19.982990 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b5aa2678-7458-40dd-b68e-bddb974b172e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737242 Sep 03 21:54:19.983949 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3195/6618] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:54:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 21:54:19.996680 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a00248ec-ccbc-43f5-9ea7-1b9f3060f112 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:19.997236 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a00248ec-ccbc-43f5-9ea7-1b9f3060f112 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:20.064004 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a00248ec-ccbc-43f5-9ea7-1b9f3060f112 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:20.071879 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a00248ec-ccbc-43f5-9ea7-1b9f3060f112 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1247 microversion: 2.1 time: 0.080241 Sep 03 21:54:20.072766 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3424/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:19 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:54:21.097476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:21.098199 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:21.105932 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:21.106518 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:21.107029 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:21.107820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:21.108351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:21.108885 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:21.182886 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:21.191256 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-258659ea-f1fb-4bc2-891a-de209bf78658 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1299 microversion: 2.1 time: 0.099591 Sep 03 21:54:21.191955 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3196/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:21 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:22.215547 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:22.216174 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:22.223975 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:22.224466 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:22.224950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:22.225668 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:22.226131 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:22.226567 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:22.458411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:22.467278 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-20be45cf-45d7-4426-9666-8c22e5834ba4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.255404 Sep 03 21:54:22.467998 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3425/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:22 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:22.832817 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:54:22.842461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:22.842955 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:22.843401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:22.855596 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] Creating event network-changed:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:54:22.860808 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-ad08bfdd-b7e4-4786-be01-7b3a739e86b6 req-376cc421-04a4-4e46-9261-3ae7e5eb59f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097202 Sep 03 21:54:22.861462 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3197/6622] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:54:23.492232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:23.492932 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:23.499899 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:23.500386 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:23.500832 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:23.501554 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:23.502016 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:23.502453 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:23.632597 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:23.640383 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-1ba1f5c9-5c75-4df8-aa91-26f9ed11926a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.152364 Sep 03 21:54:23.641218 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3426/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:23 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:54:24.665706 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:24.666401 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:24.672611 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:24.673139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:24.673581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:24.674892 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:24.675381 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:24.675813 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:24.810457 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:24.818256 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-84c91925-348c-4c53-a8db-9069a3d37fc8 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.157942 Sep 03 21:54:24.818817 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3198/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:24 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:25.846196 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:25.846807 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:25.852983 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:25.853471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:25.853911 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:25.854604 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:25.855060 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:25.855489 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:25.984412 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:25.992862 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-da10f128-4bb2-4070-a1e7-923bd6ed7c21 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.150720 Sep 03 21:54:25.993451 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3427/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:25 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:27.016243 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:27.016862 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:27.024403 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:27.025032 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:27.025409 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:27.026126 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:27.026588 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:27.027017 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:27.166799 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:27.175596 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-22160369-77e2-4591-9ba1-02c3d7798d28 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.163292 Sep 03 21:54:27.176360 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3199/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:27 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:28.199128 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:28.199743 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:28.207886 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:28.208731 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:28.209307 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:28.210251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:28.210762 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:28.211281 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:28.352612 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:28.361331 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-259e149e-43c2-46fc-ae4d-40d163529d69 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.166123 Sep 03 21:54:28.362559 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3428/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:28 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:29.079619 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "name": "network-vif-plugged", "status": "completed", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:54:29.089733 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:29.090217 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:29.090661 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:29.102277 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] Creating event network-vif-plugged:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:54:29.107122 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-eeeb75ad-9f30-4f3d-9a4f-36c529838272 req-9b310162-0823-4120-881c-74a67e8414d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086316 Sep 03 21:54:29.107702 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3200/6628] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:54:29.386874 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:29.387441 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:29.394772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:29.395254 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:29.395700 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:29.396391 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:29.396848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:29.397299 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:29.529824 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:29.537671 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-221c88d1-3bbd-4deb-be36-cb7b3ee86dd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.154810 Sep 03 21:54:29.538246 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3429/6629] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:29 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:30.558269 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:30.559119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:30.564505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:30.565261 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:30.572638 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:30.573213 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:30.573711 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:30.574437 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:30.574900 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:30.575336 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:30.712465 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:30.720253 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-f69b5276-6c09-431a-89a7-85a59f39d8ed tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1372 microversion: 2.1 time: 0.163049 Sep 03 21:54:30.720826 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3201/6630] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:30 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:31.743860 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:31.744473 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:31.746364 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=6 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:31.752251 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:31.752736 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:31.753212 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:31.753896 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:31.754352 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:31.754780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:31.885951 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:31.894245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7297c3af-d60a-447d-8c37-5f96c1abe7f7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1557 microversion: 2.1 time: 0.154047 Sep 03 21:54:31.894820 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3430/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:31 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:31.916985 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:54:31.917689 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:54:31.924449 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:31.924949 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:31.925386 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:31.926075 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:31.926527 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:31.926951 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:32.063667 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:54:32.072246 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-dea11139-576f-4ec1-b998-e3b8595b59bb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1557 microversion: 2.1 time: 0.159160 Sep 03 21:54:32.072829 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3202/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:54:31 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:54:33.986950 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:54:33.998262 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:54:33.998747 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:54:33.999177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:54:34.011163 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] Creating event network-changed:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:54:34.016300 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-b63922f2-1690-4739-aa7f-e3c4d8c81555 req-cbc37850-5c43-4d42-8e9e-c1d491a88491 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Sep 03 21:54:34.016920 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3431/6633] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:57:00.134416 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28395305-e252-49c9-92ac-3fa5f0117ad7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:57:00.135399 ncdv-master-1 devstack@n-api.service[140519]: ERROR oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:57:00.136316 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:00.136692 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=36 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:00.137939 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:57:00.138090 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876/action (ip 10.222.0.16) !!! Sep 03 21:57:00.140351 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:57:00.140477 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876/action (ip 10.222.0.16) !!! Sep 03 21:57:00.142291 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:57:00.142401 ncdv-master-1 devstack@n-api.service[140519]: Sat Sep 3 21:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876/action (ip 10.222.0.16) !!! Sep 03 21:57:00.147744 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-425270034"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:00.150123 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:00.167729 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:00.168227 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:00.168676 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:00.170572 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:00.171057 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:00.171510 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:00.520761 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4c1a876d-1d74-4f35-8a99-61f08e1a8671 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "POST /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876/action" status: 202 len: 0 microversion: 2.1 time: 0.387574 Sep 03 21:57:00.521457 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3203/6634] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:57:00 2022] POST /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 21:57:07.852753 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ca0939e-d101-47d9-8ca9-7ff5fc132ccc] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:57:07.854048 ncdv-master-1 devstack@n-api.service[140520]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8576e9d9-19e2-4136-8719-7ca8f7a5745b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 21:57:07.854670 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:07.855533 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=38 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:07.856588 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 21:57:07.856861 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 03 21:57:07.858393 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:57:07.858393 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 03 21:57:07.859621 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 21:57:07.859753 ncdv-master-1 devstack@n-api.service[140520]: Sat Sep 3 21:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 03 21:57:07.865177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "name": "network-vif-plugged", "status": "completed", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:07.879482 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:07.879964 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:07.880399 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:07.893866 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] Creating event network-vif-plugged:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:57:07.901098 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-adbb4946-13e2-41cb-beb1-999bc44619a6 req-7a435c09-0d89-4727-94f0-061ffc2fde2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050131 Sep 03 21:57:07.901720 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3432/6635] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:57:19.173245 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:19.174081 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:19.179738 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1600084365", "imageRef": "c94be9ab-ab27-4550-82b0-a88e1e47620c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-209059865", "security_groups": [{"name": "tempest-secgroup-smoke-197953488"}], "networks": [{"uuid": "03f7f659-fc1a-451b-a38e-7809fe7e4e4a"}]}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:19.205385 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] [481d0dbb-4b74-4b8c-a5bd-220875e9d8a0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45042. Sep 03 21:57:19.206102 ncdv-master-1 devstack@n-api.service[140519]: INFO oslo.messaging._drivers.impl_rabbit [-] [28395305-e252-49c9-92ac-3fa5f0117ad7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45040. Sep 03 21:57:19.295734 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.network.neutron [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] validate_networks() for [('03f7f659-fc1a-451b-a38e-7809fe7e4e4a', None, None, None, None, None)] {{(pid=140519) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 21:57:19.675344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Flavor limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 21:57:19.676273 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Image limits 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 21:57:19.676784 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Flavor pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 21:57:19.677234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Image pref 0:0:0 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 21:57:19.677656 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.virt.hardware [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 21:57:19.686514 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:19.687004 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:19.687446 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:19.688190 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:19.688654 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:19.689120 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:19.706368 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 21:57:19.711696 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.quota [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Getting quotas for user 229f2394f4a64bb09c05994e012e2a55 and project 6ceb7d1e235e467c847a20cbd4b660b6. Resources: {'cores', 'ram', 'instances'} {{(pid=140519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 21:57:19.724136 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Going to run 1 instances... {{(pid=140519) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 21:57:19.726615 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c94be9ab-ab27-4550-82b0-a88e1e47620c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 21:57:19.774774 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-96d9d5de-e583-42db-ae2c-8e7a2fec15dd tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.605138 Sep 03 21:57:19.775434 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3204/6636] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Sep 3 21:57:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 21:57:19.786628 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:19.787408 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:19.798939 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-12e34986-a6f1-43c4-8b63-459d079fe484 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:19.800095 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-12e34986-a6f1-43c4-8b63-459d079fe484 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:19.807847 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] [8576e9d9-19e2-4136-8719-7ca8f7a5745b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45058. Sep 03 21:57:19.810372 ncdv-master-1 devstack@n-api.service[140520]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ca0939e-d101-47d9-8ca9-7ff5fc132ccc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45056. Sep 03 21:57:19.929537 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-12e34986-a6f1-43c4-8b63-459d079fe484 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:19.937788 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-12e34986-a6f1-43c4-8b63-459d079fe484 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1248 microversion: 2.1 time: 0.154873 Sep 03 21:57:19.938690 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3433/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:19 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1248 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:20.963165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:20.963793 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:20.972087 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:20.972680 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:20.973143 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:20.974433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:20.974433 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:20.974759 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:21.051941 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:21.063202 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c8bff8e5-4e4e-4ec9-b2e5-96e215598d75 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1306 microversion: 2.1 time: 0.104087 Sep 03 21:57:21.068950 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3205/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:20 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:57:21.936066 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "name": "network-vif-unplugged", "status": "completed", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:21.954025 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:21.954606 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:21.955816 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:21.969275 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] Creating event network-vif-unplugged:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:57:21.974882 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-09483095-3977-448f-90ee-df3adb12cc35 req-0ed39e83-232f-44b7-8642-2e17b4d8c898 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045467 Sep 03 21:57:21.976074 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3434/6639] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:57:22.089404 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:22.090749 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:22.102200 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:22.102708 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:22.103158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:22.103947 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:22.104411 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:22.104845 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:22.276485 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:22.284776 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-4beec098-3e30-451c-9fef-a19d83cb9b38 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.199395 Sep 03 21:57:22.285915 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3206/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:22 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:23.310268 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:23.311343 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:23.319428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:23.320167 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:23.320790 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:23.321904 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:23.322542 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:23.323129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:23.468177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:23.476260 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-65144cdf-4c9b-4061-8bee-89cd16512b8f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.170597 Sep 03 21:57:23.476864 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3435/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:23 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:24.502198 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:24.504076 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:24.511860 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:24.512604 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:24.513241 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:24.514117 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:24.514999 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:24.515581 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:24.664976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:24.674043 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-34e2d7a3-7316-4033-8263-266be04f3848 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.175597 Sep 03 21:57:24.674860 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3207/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:24 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 21:57:25.698472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:25.699270 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:25.706166 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:25.706713 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:25.707146 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:25.707915 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:25.708443 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:25.708825 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:25.846926 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:25.855279 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-970f9157-7ad9-4673-bd9e-bae84b8db540 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.161194 Sep 03 21:57:25.855877 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3436/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:25 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:26.879461 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:26.880338 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:26.887464 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:26.887952 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:26.888389 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:26.889144 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:26.889600 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:26.890051 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:27.035562 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:27.046862 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-1878d493-171a-4c11-aa1d-eb0d2c2345b0 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.171429 Sep 03 21:57:27.047669 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3208/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:26 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:28.070858 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:28.071488 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:28.078492 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:28.078982 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:28.079428 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:28.080141 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:28.080608 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:28.081192 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:28.225283 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:28.239355 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-a8cd72d6-da0d-4f05-97a7-4f26664f475d tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.172849 Sep 03 21:57:28.240249 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3437/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:28 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:29.262937 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:29.263542 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:29.271379 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:29.271875 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:29.272315 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:29.273044 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:29.273505 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:29.273933 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:29.491989 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:29.499913 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-83bf1644-d495-4653-8c86-379e6b267233 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.240895 Sep 03 21:57:29.500492 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3209/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:29 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:29.801460 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:29.815330 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:29.815829 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:29.816271 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:29.832137 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] Creating event network-changed:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:57:29.837405 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-6ed9229d-5e61-4e2b-8621-2ef793a755a8 req-fda53cde-0f98-4388-8a3e-5d6f9c60c158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041442 Sep 03 21:57:29.838024 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3438/6647] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:57:30.524940 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:30.525580 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:30.527426 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:30.528139 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell0:SELECT=6 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:30.535232 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:30.535743 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:30.536185 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:30.536874 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:30.537350 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:30.537778 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:30.669453 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:30.677346 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-09cc007f-c090-4f76-9beb-43d7e74891c1 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.156370 Sep 03 21:57:30.677914 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3210/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:30 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:31.701804 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:31.702508 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:31.704471 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell0:SELECT=2 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:31.711593 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:31.712086 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:31.712532 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:31.713260 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:31.713718 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:31.714150 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:31.843658 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:31.852119 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-e88583d6-a440-4954-a0ce-78cc1b1988c7 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.154554 Sep 03 21:57:31.852697 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3439/6649] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:31 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:32.875928 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:32.876548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:32.883424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:32.883909 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:32.884349 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:32.885066 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:32.885529 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:32.885954 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:33.018216 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:33.025881 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-b0f31133-cdd4-44bb-9787-dc8afc4e3844 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.153810 Sep 03 21:57:33.026448 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3211/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:32 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:34.048733 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:34.049383 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:34.057010 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:34.057526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:34.057994 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:34.058692 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:34.059176 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:34.059627 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:34.189051 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:34.197318 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-4684208e-5c10-48a2-a696-ec089e702b77 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.152466 Sep 03 21:57:34.197895 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3440/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:34 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:35.170786 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "name": "network-vif-plugged", "status": "completed", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:35.182521 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:35.183014 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:35.183455 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:35.194769 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.compute.server_external_events [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] Creating event network-vif-plugged:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:57:35.199811 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [req-0ff6b7d5-0e95-462b-b88c-90c48db899b1 req-f82107a0-a470-4931-a52a-c45e1698290f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Sep 03 21:57:35.200415 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3212/6652] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:57:35.220571 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:35.221752 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:35.229634 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:35.230258 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:35.230562 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:35.231272 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:35.231728 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:35.232182 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:35.383023 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:35.391175 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-698fb445-f48d-47bd-ba1b-fc6be156b553 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.175365 Sep 03 21:57:35.391843 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3441/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:35 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:36.416506 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:36.417313 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:36.423601 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:36.424099 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:36.424544 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:36.425339 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:36.425801 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:36.426234 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:36.563109 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:36.570749 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-c1f27adf-1ae2-4dfa-9462-82f19e4249c6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1373 microversion: 2.1 time: 0.159465 Sep 03 21:57:36.571322 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3213/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:36 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:37.594523 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:37.595145 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:37.602686 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:37.603177 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:37.603618 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:37.604326 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:37.604787 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:37.605245 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:37.735078 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:37.743141 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-f624bc9c-7623-4504-8ed1-78d5a152f0cf tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1559 microversion: 2.1 time: 0.153218 Sep 03 21:57:37.743715 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3442/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:37 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:37.765377 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:57:37.766001 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:57:37.773257 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:37.773745 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:37.774186 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:37.774883 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:37.775344 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:37.775779 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:37.911458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:57:37.919607 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-db73f2a2-5c64-4fdf-a18d-a8c0dd067e0b tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1559 microversion: 2.1 time: 0.157955 Sep 03 21:57:37.920198 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3214/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:57:37 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:57:39.802684 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:57:39.813007 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:57:39.813493 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:57:39.813933 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:57:39.825082 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] Creating event network-changed:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:57:39.830334 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-72972b38-c249-4ef8-9a47-19826fe0022f req-8de0908a-d87a-476d-b231-667f9840cde8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031898 Sep 03 21:57:39.831102 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3443/6657] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:59:06.989183 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:06.990041 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=58 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:06.995179 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1326867537"}} {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:06.997508 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:07.005337 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:07.005820 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:07.006266 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:07.006959 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:07.007416 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:07.007844 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:07.214935 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-9f7c1e77-786a-4007-b7d5-ed1cf148a24e tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "POST /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6/action" status: 202 len: 0 microversion: 2.1 time: 0.227555 Sep 03 21:59:07.215590 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3215/6658] 10.222.0.16 () {60 vars in 1278 bytes} [Sat Sep 3 21:59:06 2022] POST /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 03 21:59:11.720232 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_api:SELECT=24 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:11.721610 ncdv-master-1 devstack@n-api.service[140520]: DEBUG dbcounter [-] [140520] Writing DB stats nova_cell1:SELECT=48 {{(pid=140520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:11.730120 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "name": "network-vif-plugged", "status": "completed", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:11.744820 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:11.745748 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:11.746387 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:11.767151 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] Creating event network-vif-plugged:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:59:11.774245 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-2f04b300-5e04-4261-b306-b8a3486e2900 req-37bbcb18-0988-4fba-ac72-a3162fc2a6a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057147 Sep 03 21:59:11.775064 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3444/6659] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:59:20.885662 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_api:SELECT=2 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:20.886639 ncdv-master-1 devstack@n-api.service[140519]: DEBUG dbcounter [-] [140519] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:20.891201 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:20.892221 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:20.900358 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:20.901027 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:20.901548 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:20.902335 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:20.902867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:20.903364 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:20.934406 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:59:20.951657 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:20.961992 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:20.962472 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:20.962910 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:20.975592 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] Creating event network-changed:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:59:20.982561 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-ff3d7694-a0b9-4ef8-b6a7-66f9ebea4d04 req-d36e9f9c-f486-489f-8d2c-1a264450ab45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096466 Sep 03 21:59:20.983171 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3445/6660] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 21:59:21.031422 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-94148f78-37c5-4635-89f1-d24792500f39 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 204 len: 0 microversion: 2.1 time: 0.147953 Sep 03 21:59:21.032195 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3216/6661] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:59:20 2022] DELETE /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 21:59:21.041970 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:21.042830 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:21.049413 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:21.050073 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:21.050525 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:21.051228 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:21.051683 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:21.052287 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:21.191905 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:21.199813 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-7986d948-5f4c-448b-936d-a0b898f2c50f tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1683 microversion: 2.1 time: 0.163149 Sep 03 21:59:21.200485 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3446/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:21 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:22.232097 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:22.232806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:22.239750 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:22.240239 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:22.240679 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:22.241415 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:22.241876 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:22.242306 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:22.411255 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:22.419154 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-0b58abe4-2b41-418d-a837-e576f26875e6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1683 microversion: 2.1 time: 0.191350 Sep 03 21:59:22.419724 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3217/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:22 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:23.046780 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff8266c-62da-470f-95ed-1a2c5bffe4f6", "name": "network-vif-deleted", "tag": "a67591b1-47a3-4b18-a4eb-761ff53a0442"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:23.056848 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:23.057358 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:23.057798 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:23.070831 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] Creating event network-vif-deleted:a67591b1-47a3-4b18-a4eb-761ff53a0442 for instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 on nch2-master-1 Sep 03 21:59:23.076311 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-fbfebc57-e270-42e1-98e7-eb8a2f56f9f3 req-bb0ed377-1df3-4bde-bf2d-6ce47e4dce96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086145 Sep 03 21:59:23.076930 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3447/6664] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:59:23.444137 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:23.444753 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:23.452351 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:23.452958 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:23.453476 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:23.454314 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:23.454921 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:23.455384 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:23.494491 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:23.495000 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:23.495375 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:23.495904 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lazy-loading 'fault' on Instance uuid eff8266c-62da-470f-95ed-1a2c5bffe4f6 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:59:23.538492 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:23.546152 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-57a3761f-a0c1-4b3e-928f-7cedcfaf58fb tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 200 len: 1338 microversion: 2.1 time: 0.106087 Sep 03 21:59:23.546721 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3218/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:23 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:24.569350 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:24.570526 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: eff8266c-62da-470f-95ed-1a2c5bffe4f6] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:24.577704 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:24.578190 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:24.578625 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:24.579351 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:24.579809 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:24.580238 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:24.594129 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] HTTP exception thrown: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Request method failure captured: Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 HTTP/1.1 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE80EYxkIUSmPudjVwakFEADjzmp5e4ojYuSpK86BqDsHiVepLXHao4Hpyjq4NVi-GfSCeqIw3c1bCYZFUO42UiGEKxd1qGnuq5zzSqqHTSVQgC67VPj2dUbn7aQ3CJrmPPEVX00EcJF9OZklWOja9mKJrjXZbOghxyH0ESzlHA5X7h4 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6ceb7d1e235e467c847a20cbd4b660b6 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6ceb7d1e235e467c847a20cbd4b660b6 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestSnapshotPattern-1526996057-project Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 229f2394f4a64bb09c05994e012e2a55 Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestSnapshotPattern-1526996057-project Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'eff8266c-62da-470f-95ed-1a2c5bffe4f6'} Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:59:24.595772 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Returning 404 to user: Instance eff8266c-62da-470f-95ed-1a2c5bffe4f6 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-37185f52-50e5-428f-8aaf-65ada7e67c31 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6" status: 404 len: 111 microversion: 2.1 time: 0.032089 Sep 03 21:59:24.601134 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3448/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:24 2022] GET /compute/v2.1/servers/eff8266c-62da-470f-95ed-1a2c5bffe4f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:59:25.907757 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:25.908855 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:25.910633 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:25.915976 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:25.916466 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:25.917240 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:25.917960 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:25.918424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:25.918852 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:25.922974 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:25.923528 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:25.924041 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:25.936838 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] Creating event network-changed:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:59:25.942461 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-8c5de5c8-04f9-4607-83b6-b98bd97b930a req-6e04aeb4-9045-43db-8b54-e8cd4ba6229e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036288 Sep 03 21:59:25.943147 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3449/6667] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:59:25.951984 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Going to try to terminate instance {{(pid=140519) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 21:59:26.042755 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa4327b4-37f1-465f-a88a-0085101904c4 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 204 len: 0 microversion: 2.1 time: 0.138672 Sep 03 21:59:26.045164 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3219/6668] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Sep 3 21:59:25 2022] DELETE /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 21:59:26.054129 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:26.055638 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:26.061868 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:26.062360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:26.062805 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:26.063503 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:26.063959 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:26.064392 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:26.203360 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.policy [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140520) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:26.211209 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-9859046c-77f8-4b2a-9067-2335b7eeee4a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1681 microversion: 2.1 time: 0.161526 Sep 03 21:59:26.211992 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3450/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:26 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:27.235458 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:27.236164 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:27.243931 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:27.244424 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:27.244867 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:27.245589 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:27.246077 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:27.246507 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:27.480450 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:27.488550 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-aa0f709a-f451-4e36-90a5-49513c84690a tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1681 microversion: 2.1 time: 0.257279 Sep 03 21:59:27.502947 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3220/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:27 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:28.137297 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b28105-2d62-456b-bb41-6b06a1742876", "name": "network-vif-deleted", "tag": "49f6ee66-f66d-417b-8ca4-cb792befb7ca"}]} {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 21:59:28.149882 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:28.150365 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:28.150795 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:28.162791 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.compute.server_external_events [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] Creating event network-vif-deleted:49f6ee66-f66d-417b-8ca4-cb792befb7ca for instance c6b28105-2d62-456b-bb41-6b06a1742876 on nch1-master-1 Sep 03 21:59:28.169676 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [req-21d455eb-5a36-4614-a57d-76c51813ccee req-a5e9c6d7-f596-4462-92bc-21d701cfc632 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035941 Sep 03 21:59:28.171750 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3451/6671] 10.222.0.16 () {64 vars in 1317 bytes} [Sat Sep 3 21:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 21:59:28.512882 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:28.513531 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.compute.api [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140519) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:28.520564 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:28.521119 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:28.521571 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:28.522293 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:28.522761 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:28.523202 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:28.557158 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:28.557658 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:28.558165 ncdv-master-1 devstack@n-api.service[140519]: DEBUG oslo_concurrency.lockutils [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:28.558806 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.objects.instance [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lazy-loading 'fault' on Instance uuid c6b28105-2d62-456b-bb41-6b06a1742876 {{(pid=140519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 21:59:28.599771 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.policy [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229f2394f4a64bb09c05994e012e2a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb7d1e235e467c847a20cbd4b660b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140519) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 21:59:28.607640 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-8b584376-bb7b-4125-b62f-c69fc505c902 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 200 len: 1337 microversion: 2.1 time: 0.098669 Sep 03 21:59:28.608412 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3221/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:28 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 1337 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 21:59:29.632411 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '>' {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:29.633179 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.compute.api [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] [instance: c6b28105-2d62-456b-bb41-6b06a1742876] Fetching instance by UUID {{(pid=140520) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 21:59:29.640298 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:29.640796 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:29.641279 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:29.641987 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Acquiring lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 21:59:29.642458 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 21:59:29.642906 ncdv-master-1 devstack@n-api.service[140520]: DEBUG oslo_concurrency.lockutils [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Lock "38d2e9dc-0987-488d-b3fa-dcbf4105c477" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 21:59:29.656640 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.wsgi [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] HTTP exception thrown: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Request method failure captured: Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: request: GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 HTTP/1.1 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Accept: application/json Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Accept-Encoding: identity Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Connection: close Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Content-Length: 0 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Content-Type: application/json Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Host: 10.222.0.16 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: Openstack-System-Scope: None Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: User-Agent: python-urllib3/1.26.12 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Auth-Token: gAAAAABjE80EYxkIUSmPudjVwakFEADjzmp5e4ojYuSpK86BqDsHiVepLXHao4Hpyjq4NVi-GfSCeqIw3c1bCYZFUO42UiGEKxd1qGnuq5zzSqqHTSVQgC67VPj2dUbn7aQ3CJrmPPEVX00EcJF9OZklWOja9mKJrjXZbOghxyH0ESzlHA5X7h4 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Id: None Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Domain-Name: None Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Identity-Status: Confirmed Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Is-Admin-Project: True Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Id: default Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Domain-Name: Default Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Id: 6ceb7d1e235e467c847a20cbd4b660b6 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Project-Name: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Role: member,reader Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Roles: member,reader Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6ceb7d1e235e467c847a20cbd4b660b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}] Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Id: 6ceb7d1e235e467c847a20cbd4b660b6 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-Tenant-Name: tempest-TestSnapshotPattern-1526996057 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-User: tempest-TestSnapshotPattern-1526996057-project Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Id: default Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-User-Domain-Name: Default Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-User-Id: 229f2394f4a64bb09c05994e012e2a55 Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: X-User-Name: tempest-TestSnapshotPattern-1526996057-project Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: method: > Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: exception: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: action_args: {'id': 'c6b28105-2d62-456b-bb41-6b06a1742876'} Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: {{(pid=140520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 21:59:29.658309 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: ERROR nova.api.openstack.wsgi Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: DEBUG nova.api.openstack.wsgi [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Returning 404 to user: Instance c6b28105-2d62-456b-bb41-6b06a1742876 could not be found. {{(pid=140520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: INFO nova.api.openstack.requestlog [None req-11457fd5-5373-4f4e-9594-b0d934e00cd6 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876" status: 404 len: 111 microversion: 2.1 time: 0.031610 Sep 03 21:59:29.662765 ncdv-master-1 devstack@n-api.service[140520]: [pid: 140520|app: 0|req: 3452/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Sep 3 21:59:29 2022] GET /compute/v2.1/servers/c6b28105-2d62-456b-bb41-6b06a1742876 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 21:59:29.821663 ncdv-master-1 devstack@n-api.service[140519]: DEBUG nova.api.openstack.wsgi [None req-90bc0fff-c7e8-4fbd-bafa-12f83b7baf72 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] Calling method '.version_select at 0x7fae65a9a0d0>' {{(pid=140519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 21:59:29.844771 ncdv-master-1 devstack@n-api.service[140519]: INFO nova.api.openstack.requestlog [None req-90bc0fff-c7e8-4fbd-bafa-12f83b7baf72 tempest-TestSnapshotPattern-1526996057 tempest-TestSnapshotPattern-1526996057-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-209059865" status: 202 len: 0 microversion: 2.1 time: 0.026979 Sep 03 21:59:29.845401 ncdv-master-1 devstack@n-api.service[140519]: [pid: 140519|app: 0|req: 3222/6674] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Sep 3 21:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-209059865 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)